2024-07-04T01:25:46.204184538Z 2024-07-04T01:25:46.819417472Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-07-04T01:25:47.649070619Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-07-04T01:25:53.327852891Z [2024-07-04T01:25:53.322+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-07-04T01:25:54.331100127Z [2024-07-04T01:25:54.330+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-07-04T01:26:12.543316781Z 2024-07-04T01:26:13.746641025Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-07-04T01:26:15.974559164Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-07-04T01:26:20.626586083Z [2024-07-04 01:26:20 +0000] [16] [INFO] Starting gunicorn 20.1.0 2024-07-04T01:26:20.677647073Z [2024-07-04 01:26:20 +0000] [16] [INFO] Listening at: http://[::]:8793 (16) 2024-07-04T01:26:20.678102390Z [2024-07-04 01:26:20 +0000] [16] [INFO] Using worker: sync 2024-07-04T01:26:20.736542486Z [2024-07-04 01:26:20 +0000] [18] [INFO] Booting worker with pid: 18 2024-07-04T01:26:20.807038658Z [2024-07-04 01:26:20 +0000] [17] [INFO] Booting worker with pid: 17 2024-07-04T01:26:23.133032286Z 2024-07-04T01:26:23.133053390Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-07-04T01:26:23.133081541Z --- ***** ----- 2024-07-04T01:26:23.133085626Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-07-04 01:26:23 2024-07-04T01:26:23.133088929Z - *** --- * --- 2024-07-04T01:26:23.133092699Z - ** ---------- [config] 2024-07-04T01:26:23.133096401Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f06b6a94220 2024-07-04T01:26:23.133099572Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-07-04T01:26:23.133102849Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-07-04T01:26:23.133107568Z - *** --- * --- .> concurrency: 16 (prefork) 2024-07-04T01:26:23.133110658Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-07-04T01:26:23.133113701Z --- ***** ----- 2024-07-04T01:26:23.133116857Z -------------- [queues] 2024-07-04T01:26:23.133119885Z .> default exchange=default(direct) key=default 2024-07-04T01:26:23.133122958Z 2024-07-04T01:26:23.133125862Z 2024-07-04T01:26:23.133128944Z [tasks] 2024-07-04T01:26:23.133132028Z . airflow.executors.celery_executor.execute_command 2024-07-04T01:26:23.133134977Z 2024-07-04T01:26:31.329719066Z [2024-07-04 01:26:31,324: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-07-04T01:26:31.344095234Z [2024-07-04 01:26:31,343: INFO/MainProcess] mingle: searching for neighbors 2024-07-04T01:26:32.381342728Z [2024-07-04 01:26:32,381: INFO/MainProcess] mingle: all alone 2024-07-04T01:26:32.416214299Z [2024-07-04 01:26:32,416: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-07-04T01:26:32.674290761Z [2024-07-04 01:26:32,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2bf60aaf-9e47-43ba-bd6a-58a5b808a8bd] received 2024-07-04T01:26:32.761476622Z [2024-07-04 01:26:32,761: INFO/ForkPoolWorker-15] [2bf60aaf-9e47-43ba-bd6a-58a5b808a8bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:26:33.208324555Z [2024-07-04 01:26:33,205: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:26:33.621145920Z [2024-07-04 01:26:33,620: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:26:34.280395490Z [2024-07-04 01:26:34,279: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2bf60aaf-9e47-43ba-bd6a-58a5b808a8bd] succeeded in 1.6002449750000096s: None 2024-07-04T01:28:00.849419635Z [2024-07-04 01:28:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5bd2e38-125e-4b99-ba91-ca6878384c24] received 2024-07-04T01:28:00.867310156Z [2024-07-04 01:28:00,866: INFO/ForkPoolWorker-15] [c5bd2e38-125e-4b99-ba91-ca6878384c24] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:28:01.579308390Z [2024-07-04 01:28:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:28:02.107560812Z [2024-07-04 01:28:02,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:28:03.057611733Z [2024-07-04 01:28:03,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5bd2e38-125e-4b99-ba91-ca6878384c24] succeeded in 2.2025787180000407s: None 2024-07-04T01:30:00.623445599Z [2024-07-04 01:30:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb3366e4-e069-4b69-9f49-c371086205b7] received 2024-07-04T01:30:00.648128081Z [2024-07-04 01:30:00,647: INFO/ForkPoolWorker-15] [bb3366e4-e069-4b69-9f49-c371086205b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:30:01.142685498Z [2024-07-04 01:30:01,138: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:30:01.491438257Z [2024-07-04 01:30:01,491: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:30:02.202304518Z [2024-07-04 01:30:02,201: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb3366e4-e069-4b69-9f49-c371086205b7] succeeded in 1.5738016980000111s: None 2024-07-04T01:32:00.697236219Z [2024-07-04 01:32:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02f9d597-297b-49a1-b6b2-4010189b8778] received 2024-07-04T01:32:00.727842327Z [2024-07-04 01:32:00,727: INFO/ForkPoolWorker-15] [02f9d597-297b-49a1-b6b2-4010189b8778] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:32:01.104829731Z [2024-07-04 01:32:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:32:01.460277359Z [2024-07-04 01:32:01,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:32:02.097663555Z [2024-07-04 01:32:02,097: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02f9d597-297b-49a1-b6b2-4010189b8778] succeeded in 1.3924318030000222s: None 2024-07-04T01:32:52.319676517Z [2024-07-04 01:32:52,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2d88e0d-8a28-4b67-bf33-b42558795794] received 2024-07-04T01:32:52.360385444Z [2024-07-04 01:32:52,359: INFO/ForkPoolWorker-15] [b2d88e0d-8a28-4b67-bf33-b42558795794] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:32:52.660974236Z [2024-07-04 01:32:52,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:32:54.069038996Z [2024-07-04 01:32:54,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40c9cd13-5dc6-4c52-97aa-59174c6b4b4c] received 2024-07-04T01:32:54.266522266Z [2024-07-04 01:32:54,265: INFO/ForkPoolWorker-16] [40c9cd13-5dc6-4c52-97aa-59174c6b4b4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:32:54.326792850Z [2024-07-04 01:32:54,326: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:32:54.335629772Z [2024-07-04 01:32:54,335: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:32:54.411016425Z [2024-07-04 01:32:54,410: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:32:54.415646197Z [2024-07-04 01:32:54,415: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:32:54.415655020Z [2024-07-04 01:32:54,415: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:32:54.416293866Z [2024-07-04 01:32:54,415: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:32:54.416303468Z [2024-07-04 01:32:54,415: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:32:54.416344858Z [2024-07-04 01:32:54,416: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:32:54.418925762Z [2024-07-04 01:32:54,416: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:32:54.606714499Z [2024-07-04 01:32:54,606: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:32:54.818326476Z [2024-07-04 01:32:54,813: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:32:57.042291096Z [2024-07-04 01:32:57,040: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:32:57.060015299Z [2024-07-04 01:32:57,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:32:57.096718726Z [2024-07-04 01:32:57,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b2d88e0d-8a28-4b67-bf33-b42558795794] succeeded in 4.769468589999974s: None 2024-07-04T01:32:57.114779854Z [2024-07-04 01:32:57,114: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:32:57.117584092Z [2024-07-04 01:32:57,117: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:32:57.117630776Z [2024-07-04 01:32:57,117: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:32:57.118448140Z [2024-07-04 01:32:57,118: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:32:57.118479027Z [2024-07-04 01:32:57,118: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:32:57.118666235Z [2024-07-04 01:32:57,118: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:32:57.118775002Z [2024-07-04 01:32:57,118: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:32:57.202684741Z [2024-07-04 01:32:57,202: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:32:57.670376210Z [2024-07-04 01:32:57,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7940f3be-7a25-4c2c-af92-339db2f840fb] received 2024-07-04T01:32:57.715527720Z [2024-07-04 01:32:57,715: INFO/ForkPoolWorker-15] [7940f3be-7a25-4c2c-af92-339db2f840fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:32:58.260518194Z [2024-07-04 01:32:58,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:32:59.450149652Z [2024-07-04 01:32:59,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[40c9cd13-5dc6-4c52-97aa-59174c6b4b4c] succeeded in 5.375648472999956s: None 2024-07-04T01:32:59.923606934Z [2024-07-04 01:32:59,923: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:32:59.939315381Z [2024-07-04 01:32:59,938: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:00.010591400Z [2024-07-04 01:33:00,010: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:00.011967883Z [2024-07-04 01:33:00,011: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:00.012009636Z [2024-07-04 01:33:00,011: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:00.012112673Z [2024-07-04 01:33:00,011: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:33:00.012144686Z [2024-07-04 01:33:00,012: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:00.012392106Z [2024-07-04 01:33:00,012: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:00.012426723Z [2024-07-04 01:33:00,012: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:00.114563714Z [2024-07-04 01:33:00,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:00.565012352Z [2024-07-04 01:33:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ac45091-743a-49a9-9d24-b6d4f56b4be5] received 2024-07-04T01:33:00.589294838Z [2024-07-04 01:33:00,589: INFO/ForkPoolWorker-16] [2ac45091-743a-49a9-9d24-b6d4f56b4be5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:33:00.598234760Z [2024-07-04 01:33:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[318b3efc-1878-4946-8dfe-0d1aa48ba392] received 2024-07-04T01:33:00.736721406Z [2024-07-04 01:33:00,735: INFO/ForkPoolWorker-1] [318b3efc-1878-4946-8dfe-0d1aa48ba392] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:33:01.246658726Z [2024-07-04 01:33:01,233: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:33:01.260361472Z [2024-07-04 01:33:01,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7940f3be-7a25-4c2c-af92-339db2f840fb] succeeded in 3.585263407999946s: None 2024-07-04T01:33:01.267446084Z [2024-07-04 01:33:01,262: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:33:02.091924205Z [2024-07-04 01:33:02,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7444eeb5-734d-48af-889d-4a84f216af2f] received 2024-07-04T01:33:02.098747656Z [2024-07-04 01:33:02,098: INFO/ForkPoolWorker-15] [7444eeb5-734d-48af-889d-4a84f216af2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:02.459939153Z [2024-07-04 01:33:02,455: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:02.744720354Z [2024-07-04 01:33:02,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:33:02.748794195Z [2024-07-04 01:33:02,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:02.780242988Z [2024-07-04 01:33:02,780: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:33:02.781275638Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:02.781308775Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:02.781539983Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:33:02.781590315Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:33:02.781828986Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:33:02.781865757Z [2024-07-04 01:33:02,781: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:02.903589900Z [2024-07-04 01:33:02,903: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:02.979091822Z [2024-07-04 01:33:02,978: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:33:02.985088303Z [2024-07-04 01:33:02,984: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:03.040249946Z [2024-07-04 01:33:03,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:33:03.042330009Z [2024-07-04 01:33:03,042: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:03.042473117Z [2024-07-04 01:33:03,042: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:03.043713760Z [2024-07-04 01:33:03,043: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:33:03.043770863Z [2024-07-04 01:33:03,043: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:33:03.044013975Z [2024-07-04 01:33:03,043: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:33:03.044085581Z [2024-07-04 01:33:03,043: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:03.130714212Z [2024-07-04 01:33:03,130: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:03.955969903Z [2024-07-04 01:33:03,955: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:03.959410644Z [2024-07-04 01:33:03,958: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:03.997195932Z [2024-07-04 01:33:03,996: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:03.998606468Z [2024-07-04 01:33:03,998: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:03.998668189Z [2024-07-04 01:33:03,998: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:03.998957861Z [2024-07-04 01:33:03,998: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:33:03.998980426Z [2024-07-04 01:33:03,998: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:03.999261087Z [2024-07-04 01:33:03,999: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:03.999305841Z [2024-07-04 01:33:03,999: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:04.114797109Z [2024-07-04 01:33:04,114: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:04.877664261Z [2024-07-04 01:33:04,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7444eeb5-734d-48af-889d-4a84f216af2f] succeeded in 2.7840963879999663s: None 2024-07-04T01:33:05.274211082Z [2024-07-04 01:33:05,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[832e7a8e-7d39-4a2f-82df-f176ca53a8d4] received 2024-07-04T01:33:05.292317747Z [2024-07-04 01:33:05,291: INFO/ForkPoolWorker-15] [832e7a8e-7d39-4a2f-82df-f176ca53a8d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:33:05.568965793Z [2024-07-04 01:33:05,568: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[318b3efc-1878-4946-8dfe-0d1aa48ba392] succeeded in 4.9612831880000385s: None 2024-07-04T01:33:05.659576448Z [2024-07-04 01:33:05,659: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ac45091-743a-49a9-9d24-b6d4f56b4be5] succeeded in 5.090539212999943s: None 2024-07-04T01:33:05.702712373Z [2024-07-04 01:33:05,699: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:07.062354300Z [2024-07-04 01:33:07,061: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:07.068116640Z [2024-07-04 01:33:07,067: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:07.095165104Z [2024-07-04 01:33:07,094: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:07.096569793Z [2024-07-04 01:33:07,096: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:07.096738558Z [2024-07-04 01:33:07,096: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:07.097186670Z [2024-07-04 01:33:07,097: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:07.097511098Z [2024-07-04 01:33:07,097: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:07.097842761Z [2024-07-04 01:33:07,097: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:07.098252608Z [2024-07-04 01:33:07,098: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:07.098317801Z [2024-07-04 01:33:07,098: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:07.104135686Z [2024-07-04 01:33:07,103: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:07.186156773Z [2024-07-04 01:33:07,185: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:07.673249663Z [2024-07-04 01:33:07,672: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[832e7a8e-7d39-4a2f-82df-f176ca53a8d4] succeeded in 2.3940356790000124s: None 2024-07-04T01:33:08.105976143Z [2024-07-04 01:33:08,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cd5d7d-38be-4842-a0a7-9a5e386db59b] received 2024-07-04T01:33:08.114013903Z [2024-07-04 01:33:08,113: INFO/ForkPoolWorker-15] [f2cd5d7d-38be-4842-a0a7-9a5e386db59b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:08.480690867Z [2024-07-04 01:33:08,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:10.024585083Z [2024-07-04 01:33:10,024: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:10.028947018Z [2024-07-04 01:33:10,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:10.082160503Z [2024-07-04 01:33:10,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:10.085043734Z [2024-07-04 01:33:10,084: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:10.085231637Z [2024-07-04 01:33:10,085: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:10.085428948Z [2024-07-04 01:33:10,085: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:10.085713221Z [2024-07-04 01:33:10,085: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:10.085877282Z [2024-07-04 01:33:10,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:10.086278051Z [2024-07-04 01:33:10,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:10.086436290Z [2024-07-04 01:33:10,086: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:10.095661232Z [2024-07-04 01:33:10,095: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:10.181414603Z [2024-07-04 01:33:10,181: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:10.747162795Z [2024-07-04 01:33:10,746: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2cd5d7d-38be-4842-a0a7-9a5e386db59b] succeeded in 2.639411919000054s: None 2024-07-04T01:33:24.310698905Z [2024-07-04 01:33:24,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c72cc86-4525-4a69-a324-77edc5fdbadd] received 2024-07-04T01:33:24.320428295Z [2024-07-04 01:33:24,320: INFO/ForkPoolWorker-15] [1c72cc86-4525-4a69-a324-77edc5fdbadd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:33:24.723049090Z [2024-07-04 01:33:24,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:33:26.035764375Z [2024-07-04 01:33:26,035: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:26.039396074Z [2024-07-04 01:33:26,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:26.079487622Z [2024-07-04 01:33:26,079: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:26.082381816Z [2024-07-04 01:33:26,082: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:26.082610715Z [2024-07-04 01:33:26,082: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:26.082955612Z [2024-07-04 01:33:26,082: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:26.083154467Z [2024-07-04 01:33:26,082: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:26.083267889Z [2024-07-04 01:33:26,083: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:26.083924217Z [2024-07-04 01:33:26,083: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:33:26.083943072Z [2024-07-04 01:33:26,083: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:26.088605491Z [2024-07-04 01:33:26,088: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:26.183389666Z [2024-07-04 01:33:26,183: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:26.647988415Z [2024-07-04 01:33:26,647: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9965d262-0960-44d4-9bff-2e1b8a4dd444] received 2024-07-04T01:33:26.661906389Z [2024-07-04 01:33:26,660: INFO/ForkPoolWorker-16] [9965d262-0960-44d4-9bff-2e1b8a4dd444] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:33:27.004567426Z [2024-07-04 01:33:27,001: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:33:28.079862079Z [2024-07-04 01:33:28,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1c72cc86-4525-4a69-a324-77edc5fdbadd] succeeded in 3.767801938000048s: None 2024-07-04T01:33:28.289179746Z [2024-07-04 01:33:28,288: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:33:28.292853114Z [2024-07-04 01:33:28,292: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:28.322813356Z [2024-07-04 01:33:28,322: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:33:28.324036742Z [2024-07-04 01:33:28,323: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:28.324055454Z [2024-07-04 01:33:28,323: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:28.324083873Z [2024-07-04 01:33:28,324: INFO/ForkPoolWorker-16] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:28.324214219Z [2024-07-04 01:33:28,324: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:28.324241325Z [2024-07-04 01:33:28,324: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:33:28.324451195Z [2024-07-04 01:33:28,324: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:33:28.324504683Z [2024-07-04 01:33:28,324: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:28.329131150Z [2024-07-04 01:33:28,328: INFO/ForkPoolWorker-16] Creating DAG vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:28.420316468Z [2024-07-04 01:33:28,420: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:29.700403995Z [2024-07-04 01:33:29,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cab90f69-fffe-4c3f-b8e3-961ec53179e7] received 2024-07-04T01:33:29.716875036Z [2024-07-04 01:33:29,716: INFO/ForkPoolWorker-15] [cab90f69-fffe-4c3f-b8e3-961ec53179e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:30.179129017Z [2024-07-04 01:33:30,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:30.238144485Z [2024-07-04 01:33:30,237: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9965d262-0960-44d4-9bff-2e1b8a4dd444] succeeded in 3.5878396560000283s: None 2024-07-04T01:33:31.602124432Z [2024-07-04 01:33:31,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:31.605664506Z [2024-07-04 01:33:31,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:31.640716184Z [2024-07-04 01:33:31,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:31.643146922Z [2024-07-04 01:33:31,642: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:31.643532521Z [2024-07-04 01:33:31,643: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:31.643879598Z [2024-07-04 01:33:31,643: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:31.644342910Z [2024-07-04 01:33:31,643: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:31.646351690Z [2024-07-04 01:33:31,644: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:31.647659063Z [2024-07-04 01:33:31,647: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:31.648159808Z [2024-07-04 01:33:31,647: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:31.658907458Z [2024-07-04 01:33:31,658: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:31.744694838Z [2024-07-04 01:33:31,744: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:32.360236918Z [2024-07-04 01:33:32,359: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cab90f69-fffe-4c3f-b8e3-961ec53179e7] succeeded in 2.6562792949999903s: None 2024-07-04T01:33:33.264027172Z [2024-07-04 01:33:33,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9dff867-7391-4252-bc4c-0de9d01740b4] received 2024-07-04T01:33:33.275479413Z [2024-07-04 01:33:33,275: INFO/ForkPoolWorker-15] [d9dff867-7391-4252-bc4c-0de9d01740b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'split_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:33.599919382Z [2024-07-04 01:33:33,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:34.882617189Z [2024-07-04 01:33:34,882: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:34.886753004Z [2024-07-04 01:33:34,886: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:34.916890487Z [2024-07-04 01:33:34,916: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:34.918237997Z [2024-07-04 01:33:34,918: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:34.918296244Z [2024-07-04 01:33:34,918: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:34.918496778Z [2024-07-04 01:33:34,918: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:34.918668970Z [2024-07-04 01:33:34,918: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:34.918734976Z [2024-07-04 01:33:34,918: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:34.919372005Z [2024-07-04 01:33:34,919: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:34.919385541Z [2024-07-04 01:33:34,919: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:34.925576310Z [2024-07-04 01:33:34,925: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:35.015172049Z [2024-07-04 01:33:35,014: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:35.594760380Z [2024-07-04 01:33:35,594: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9dff867-7391-4252-bc4c-0de9d01740b4] succeeded in 2.3281150179999486s: None 2024-07-04T01:33:36.610083570Z [2024-07-04 01:33:36,609: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51cfc609-7ead-40d4-8a87-253711a29b12] received 2024-07-04T01:33:36.618861534Z [2024-07-04 01:33:36,618: INFO/ForkPoolWorker-15] [51cfc609-7ead-40d4-8a87-253711a29b12] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'collect_metrics', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:33:36.905923416Z [2024-07-04 01:33:36,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:38.218854661Z [2024-07-04 01:33:38,218: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:38.223067593Z [2024-07-04 01:33:38,222: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:38.255750749Z [2024-07-04 01:33:38,255: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:38.258630790Z [2024-07-04 01:33:38,258: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:38.258918482Z [2024-07-04 01:33:38,258: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:38.259032045Z [2024-07-04 01:33:38,258: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:38.259313764Z [2024-07-04 01:33:38,258: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:38.259489219Z [2024-07-04 01:33:38,259: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:38.260140273Z [2024-07-04 01:33:38,259: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:38.260335737Z [2024-07-04 01:33:38,260: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:38.268477003Z [2024-07-04 01:33:38,268: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:38.362330960Z [2024-07-04 01:33:38,362: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:39.079576095Z [2024-07-04 01:33:39,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51cfc609-7ead-40d4-8a87-253711a29b12] succeeded in 2.4677155269999957s: None 2024-07-04T01:33:39.927755949Z [2024-07-04 01:33:39,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e3c4578-b5ea-49a5-ab59-dfdba1dce0aa] received 2024-07-04T01:33:39.943298248Z [2024-07-04 01:33:39,942: INFO/ForkPoolWorker-15] [2e3c4578-b5ea-49a5-ab59-dfdba1dce0aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'send_prometheus', 'scheduled__2024-07-04T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:33:40.521982893Z [2024-07-04 01:33:40,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:33:41.906051001Z [2024-07-04 01:33:41,894: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:33:41.906083756Z [2024-07-04 01:33:41,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:33:41.966181751Z [2024-07-04 01:33:41,962: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:33:41.966206028Z [2024-07-04 01:33:41,963: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:33:41.966211198Z [2024-07-04 01:33:41,963: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:33:41.966215436Z [2024-07-04 01:33:41,963: INFO/ForkPoolWorker-15] Read VIM 1e54348b-b455-4f36-bee8-56b2b5553b71 (basic01_706265) 2024-07-04T01:33:41.966221675Z [2024-07-04 01:33:41,964: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '1e54348b-b455-4f36-bee8-56b2b5553b71', 'name': 'basic01_706265', 'vim_type': 'openstack'}] 2024-07-04T01:33:41.966226618Z [2024-07-04 01:33:41,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:33:41.966231418Z [2024-07-04 01:33:41,964: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:33:41.966236027Z [2024-07-04 01:33:41,965: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:33:41.972185363Z [2024-07-04 01:33:41,971: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71 2024-07-04T01:33:42.057856891Z [2024-07-04 01:33:42,057: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:33:42.604346193Z [2024-07-04 01:33:42,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e3c4578-b5ea-49a5-ab59-dfdba1dce0aa] succeeded in 2.678806645999998s: None 2024-07-04T01:34:00.783511028Z [2024-07-04 01:34:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84d95353-db4b-4274-bcad-6836883b1197] received 2024-07-04T01:34:00.792830109Z [2024-07-04 01:34:00,792: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adc7fe18-f88b-4e9a-b011-6b08070845ff] received 2024-07-04T01:34:00.795066096Z [2024-07-04 01:34:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[737a78dc-80a5-4b2f-9e3b-e41ab1327e25] received 2024-07-04T01:34:00.812772890Z [2024-07-04 01:34:00,812: INFO/ForkPoolWorker-16] [adc7fe18-f88b-4e9a-b011-6b08070845ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:00.820713461Z [2024-07-04 01:34:00,820: INFO/ForkPoolWorker-1] [737a78dc-80a5-4b2f-9e3b-e41ab1327e25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:00.821306818Z [2024-07-04 01:34:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667461f5-bcb1-481d-a12f-238f3834c62d] received 2024-07-04T01:34:00.827402142Z [2024-07-04 01:34:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7efd510d-a7f4-477d-a5c2-108cdf109842] received 2024-07-04T01:34:00.846520122Z [2024-07-04 01:34:00,846: INFO/ForkPoolWorker-15] [84d95353-db4b-4274-bcad-6836883b1197] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:00.950332751Z [2024-07-04 01:34:00,949: INFO/ForkPoolWorker-2] [667461f5-bcb1-481d-a12f-238f3834c62d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:34:01.034207916Z [2024-07-04 01:34:01,033: INFO/ForkPoolWorker-3] [7efd510d-a7f4-477d-a5c2-108cdf109842] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:01.572283460Z [2024-07-04 01:34:01,566: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:34:01.619036056Z [2024-07-04 01:34:01,607: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:01.829608994Z [2024-07-04 01:34:01,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:01.830076132Z [2024-07-04 01:34:01,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:02.432574979Z [2024-07-04 01:34:02,432: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:34:02.739737652Z [2024-07-04 01:34:02,733: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:03.553518710Z [2024-07-04 01:34:03,553: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[667461f5-bcb1-481d-a12f-238f3834c62d] succeeded in 2.7034902110000303s: None 2024-07-04T01:34:04.237438226Z [2024-07-04 01:34:04,237: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:34:04.241417517Z [2024-07-04 01:34:04,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.287867875Z [2024-07-04 01:34:04,287: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:34:04.297167268Z [2024-07-04 01:34:04,296: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.297355122Z [2024-07-04 01:34:04,297: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.297640239Z [2024-07-04 01:34:04,297: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.297789922Z [2024-07-04 01:34:04,297: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:34:04.298147115Z [2024-07-04 01:34:04,297: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:34:04.298737004Z [2024-07-04 01:34:04,298: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.306195893Z [2024-07-04 01:34:04,306: WARNING/ForkPoolWorker-16] Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:04.307785511Z [2024-07-04 01:34:04,306: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:04.310366866Z [2024-07-04 01:34:04,310: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:34:04.313068663Z [2024-07-04 01:34:04,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.336419585Z [2024-07-04 01:34:04,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:34:04.337630406Z [2024-07-04 01:34:04,337: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.337692721Z [2024-07-04 01:34:04,337: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.337992842Z [2024-07-04 01:34:04,337: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.338059919Z [2024-07-04 01:34:04,337: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:34:04.338644723Z [2024-07-04 01:34:04,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:34:04.338709488Z [2024-07-04 01:34:04,338: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.342173744Z [2024-07-04 01:34:04,341: ERROR/ForkPoolWorker-16] [adc7fe18-f88b-4e9a-b011-6b08070845ff] Failed to execute task Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:34:04.342193238Z Traceback (most recent call last): 2024-07-04T01:34:04.342198821Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:34:04.342203897Z args.func(args) 2024-07-04T01:34:04.342209386Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:34:04.342214441Z return func(*args, **kwargs) 2024-07-04T01:34:04.342218930Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:34:04.342223730Z return f(*args, **kwargs) 2024-07-04T01:34:04.342228272Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:34:04.342232693Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:34:04.342237173Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:34:04.342257740Z raise AirflowException( 2024-07-04T01:34:04.342263391Z airflow.exceptions.AirflowException: Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:34:04.361516731Z [2024-07-04 01:34:04,361: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T01:34:04.372458136Z [2024-07-04 01:34:04,371: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.407314806Z [2024-07-04 01:34:04,406: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[adc7fe18-f88b-4e9a-b011-6b08070845ff] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id adc7fe18-f88b-4e9a-b011-6b08070845ff') 2024-07-04T01:34:04.407327536Z Traceback (most recent call last): 2024-07-04T01:34:04.407332632Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:34:04.407336997Z R = retval = fun(*args, **kwargs) 2024-07-04T01:34:04.407341478Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:34:04.407346445Z return self.run(*args, **kwargs) 2024-07-04T01:34:04.407351354Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:34:04.407356067Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:34:04.407360450Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:34:04.407365076Z raise AirflowException(msg) 2024-07-04T01:34:04.407369849Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id adc7fe18-f88b-4e9a-b011-6b08070845ff 2024-07-04T01:34:04.438827500Z [2024-07-04 01:34:04,438: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T01:34:04.441788543Z [2024-07-04 01:34:04,441: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.442038296Z [2024-07-04 01:34:04,441: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.442856498Z [2024-07-04 01:34:04,442: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.443110242Z [2024-07-04 01:34:04,442: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T01:34:04.443605728Z [2024-07-04 01:34:04,443: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:34:04.443832400Z [2024-07-04 01:34:04,443: INFO/ForkPoolWorker-3] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.498211666Z [2024-07-04 01:34:04,497: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:34:04.503343620Z [2024-07-04 01:34:04,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.557461085Z [2024-07-04 01:34:04,557: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:34:04.564007997Z [2024-07-04 01:34:04,563: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.564098594Z [2024-07-04 01:34:04,563: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.564301413Z [2024-07-04 01:34:04,564: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.564366856Z [2024-07-04 01:34:04,564: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:34:04.564658655Z [2024-07-04 01:34:04,564: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:34:04.565318113Z [2024-07-04 01:34:04,565: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.577366457Z [2024-07-04 01:34:04,577: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:34:04.668342732Z [2024-07-04 01:34:04,668: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:34:04.669900469Z [2024-07-04 01:34:04,669: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:34:04.675559586Z [2024-07-04 01:34:04,674: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.777044415Z [2024-07-04 01:34:04,775: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:34:04.779425375Z [2024-07-04 01:34:04,778: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.779432937Z [2024-07-04 01:34:04,778: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.787491269Z [2024-07-04 01:34:04,778: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.787511623Z [2024-07-04 01:34:04,778: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:34:04.787515476Z [2024-07-04 01:34:04,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:34:04.787525612Z [2024-07-04 01:34:04,779: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.787529901Z [2024-07-04 01:34:04,786: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:04.800519480Z [2024-07-04 01:34:04,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:04.816882325Z [2024-07-04 01:34:04,816: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:34:04.826737568Z [2024-07-04 01:34:04,824: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:04.888765252Z [2024-07-04 01:34:04,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:34:04.899433905Z [2024-07-04 01:34:04,899: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:04.899956321Z [2024-07-04 01:34:04,899: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:04.900233922Z [2024-07-04 01:34:04,899: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:04.900340452Z [2024-07-04 01:34:04,900: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:34:04.900620306Z [2024-07-04 01:34:04,900: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:34:04.900923606Z [2024-07-04 01:34:04,900: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:04.904841034Z [2024-07-04 01:34:04,904: ERROR/ForkPoolWorker-1] [737a78dc-80a5-4b2f-9e3b-e41ab1327e25] Failed to execute task Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:34:04.904854570Z Traceback (most recent call last): 2024-07-04T01:34:04.904858663Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:34:04.904862553Z args.func(args) 2024-07-04T01:34:04.904866132Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:34:04.904869749Z return func(*args, **kwargs) 2024-07-04T01:34:04.904872786Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:34:04.904883653Z return f(*args, **kwargs) 2024-07-04T01:34:04.904886908Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:34:04.904889877Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:34:04.904893268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:34:04.904896241Z raise AirflowException( 2024-07-04T01:34:04.904899743Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:34:04.944478144Z [2024-07-04 01:34:04,943: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[737a78dc-80a5-4b2f-9e3b-e41ab1327e25] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 737a78dc-80a5-4b2f-9e3b-e41ab1327e25') 2024-07-04T01:34:04.944496351Z Traceback (most recent call last): 2024-07-04T01:34:04.944500178Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:34:04.944503268Z R = retval = fun(*args, **kwargs) 2024-07-04T01:34:04.944506600Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:34:04.944509891Z return self.run(*args, **kwargs) 2024-07-04T01:34:04.944513827Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:34:04.944517365Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:34:04.944520710Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:34:04.944524320Z raise AirflowException(msg) 2024-07-04T01:34:04.944528417Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 737a78dc-80a5-4b2f-9e3b-e41ab1327e25 2024-07-04T01:34:06.633762776Z [2024-07-04 01:34:06,633: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7efd510d-a7f4-477d-a5c2-108cdf109842] succeeded in 5.79675203499994s: None 2024-07-04T01:34:07.100780385Z [2024-07-04 01:34:07,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84d95353-db4b-4274-bcad-6836883b1197] succeeded in 6.310387688999981s: None 2024-07-04T01:34:15.048703944Z [2024-07-04 01:34:15,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35f0851c-5478-4384-8d08-ce87e72eadb7] received 2024-07-04T01:34:15.061354852Z [2024-07-04 01:34:15,061: INFO/ForkPoolWorker-15] [35f0851c-5478-4384-8d08-ce87e72eadb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:34:15.408344576Z [2024-07-04 01:34:15,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:16.331886843Z [2024-07-04 01:34:16,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f558438-e67e-430e-b342-f3444f2e65bf] received 2024-07-04T01:34:16.342071464Z [2024-07-04 01:34:16,341: INFO/ForkPoolWorker-16] [1f558438-e67e-430e-b342-f3444f2e65bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:34:16.686846066Z [2024-07-04 01:34:16,683: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:16.727500475Z [2024-07-04 01:34:16,727: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:34:16.733015971Z [2024-07-04 01:34:16,732: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:16.767843135Z [2024-07-04 01:34:16,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:34:16.769809207Z [2024-07-04 01:34:16,769: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:16.769951066Z [2024-07-04 01:34:16,769: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:16.770156724Z [2024-07-04 01:34:16,769: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:16.770500763Z [2024-07-04 01:34:16,770: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:34:16.770788514Z [2024-07-04 01:34:16,770: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:34:16.770966150Z [2024-07-04 01:34:16,770: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:16.777478964Z [2024-07-04 01:34:16,777: WARNING/ForkPoolWorker-15] Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:16.778384861Z [2024-07-04 01:34:16,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:34:16.779301873Z [2024-07-04 01:34:16,779: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:34:16.782589000Z [2024-07-04 01:34:16,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:16.805119162Z [2024-07-04 01:34:16,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:34:16.811246857Z [2024-07-04 01:34:16,810: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:16.816738552Z [2024-07-04 01:34:16,816: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:16.818089145Z [2024-07-04 01:34:16,817: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:16.818307567Z [2024-07-04 01:34:16,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:34:16.819537717Z [2024-07-04 01:34:16,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:34:16.819772519Z [2024-07-04 01:34:16,819: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:16.825107518Z [2024-07-04 01:34:16,824: ERROR/ForkPoolWorker-15] [35f0851c-5478-4384-8d08-ce87e72eadb7] Failed to execute task Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:34:16.825120877Z Traceback (most recent call last): 2024-07-04T01:34:16.825124847Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:34:16.825128872Z args.func(args) 2024-07-04T01:34:16.825132533Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:34:16.825136046Z return func(*args, **kwargs) 2024-07-04T01:34:16.825139369Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:34:16.825142511Z return f(*args, **kwargs) 2024-07-04T01:34:16.825145708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:34:16.825148706Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:34:16.825151904Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:34:16.825154780Z raise AirflowException( 2024-07-04T01:34:16.825158537Z airflow.exceptions.AirflowException: Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:34:16.869155345Z [2024-07-04 01:34:16,868: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35f0851c-5478-4384-8d08-ce87e72eadb7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 35f0851c-5478-4384-8d08-ce87e72eadb7') 2024-07-04T01:34:16.869170416Z Traceback (most recent call last): 2024-07-04T01:34:16.869174665Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:34:16.869177702Z R = retval = fun(*args, **kwargs) 2024-07-04T01:34:16.869180731Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:34:16.869184004Z return self.run(*args, **kwargs) 2024-07-04T01:34:16.869187712Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:34:16.869191377Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:34:16.869204813Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:34:16.869208348Z raise AirflowException(msg) 2024-07-04T01:34:16.869212192Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 35f0851c-5478-4384-8d08-ce87e72eadb7 2024-07-04T01:34:17.962238854Z [2024-07-04 01:34:17,961: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:34:17.966621990Z [2024-07-04 01:34:17,966: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:18.026852103Z [2024-07-04 01:34:18,026: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:34:18.028400875Z [2024-07-04 01:34:18,028: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:18.028569560Z [2024-07-04 01:34:18,028: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:18.028724957Z [2024-07-04 01:34:18,028: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:18.028824778Z [2024-07-04 01:34:18,028: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:34:18.029053425Z [2024-07-04 01:34:18,028: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:34:18.029212450Z [2024-07-04 01:34:18,029: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:18.035605556Z [2024-07-04 01:34:18,035: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:18.038125167Z [2024-07-04 01:34:18,036: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:34:18.039320895Z [2024-07-04 01:34:18,039: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:34:18.042290622Z [2024-07-04 01:34:18,042: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:34:18.066018779Z [2024-07-04 01:34:18,065: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:34:18.071000987Z [2024-07-04 01:34:18,067: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:34:18.071014968Z [2024-07-04 01:34:18,067: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:34:18.071019134Z [2024-07-04 01:34:18,067: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:34:18.071023092Z [2024-07-04 01:34:18,067: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:34:18.071026089Z [2024-07-04 01:34:18,068: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:34:18.071029236Z [2024-07-04 01:34:18,068: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:34:18.073956285Z [2024-07-04 01:34:18,073: ERROR/ForkPoolWorker-16] [1f558438-e67e-430e-b342-f3444f2e65bf] Failed to execute task Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:34:18.073967983Z Traceback (most recent call last): 2024-07-04T01:34:18.073971836Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:34:18.073975882Z args.func(args) 2024-07-04T01:34:18.073979376Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:34:18.073982831Z return func(*args, **kwargs) 2024-07-04T01:34:18.073985878Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:34:18.073988997Z return f(*args, **kwargs) 2024-07-04T01:34:18.073992043Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:34:18.073995418Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:34:18.073998480Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:34:18.074001578Z raise AirflowException( 2024-07-04T01:34:18.074005345Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:34:18.116568341Z [2024-07-04 01:34:18,115: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f558438-e67e-430e-b342-f3444f2e65bf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f558438-e67e-430e-b342-f3444f2e65bf') 2024-07-04T01:34:18.116590559Z Traceback (most recent call last): 2024-07-04T01:34:18.116595751Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:34:18.116600381Z R = retval = fun(*args, **kwargs) 2024-07-04T01:34:18.116604478Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:34:18.116608959Z return self.run(*args, **kwargs) 2024-07-04T01:34:18.116613885Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:34:18.116618371Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:34:18.116622424Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:34:18.116626755Z raise AirflowException(msg) 2024-07-04T01:34:18.116631330Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f558438-e67e-430e-b342-f3444f2e65bf 2024-07-04T01:35:00.788721546Z [2024-07-04 01:35:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e31e5de4-f908-44f9-bc73-91eea1a87d14] received 2024-07-04T01:35:00.796601047Z [2024-07-04 01:35:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf8bd5d-02b5-4ceb-a19f-9b83b2d9cfc2] received 2024-07-04T01:35:00.847536275Z [2024-07-04 01:35:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94] received 2024-07-04T01:35:00.852652756Z [2024-07-04 01:35:00,852: INFO/ForkPoolWorker-15] [e31e5de4-f908-44f9-bc73-91eea1a87d14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:00.852974142Z [2024-07-04 01:35:00,850: INFO/ForkPoolWorker-16] [4cf8bd5d-02b5-4ceb-a19f-9b83b2d9cfc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:00.856791674Z [2024-07-04 01:35:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78746536-b3e0-4ab6-aac9-e5003c35ec50] received 2024-07-04T01:35:00.871549651Z [2024-07-04 01:35:00,871: INFO/ForkPoolWorker-1] [dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:00.894064014Z [2024-07-04 01:35:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8ed6736-efe0-44aa-9c2c-a1cdb22690d8] received 2024-07-04T01:35:00.910577360Z [2024-07-04 01:35:00,910: INFO/ForkPoolWorker-2] [78746536-b3e0-4ab6-aac9-e5003c35ec50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:00.931215967Z [2024-07-04 01:35:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e478f30-3050-401c-a731-1a2e5ced4535] received 2024-07-04T01:35:00.954397006Z [2024-07-04 01:35:00,953: INFO/ForkPoolWorker-3] [e8ed6736-efe0-44aa-9c2c-a1cdb22690d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:01.124096654Z [2024-07-04 01:35:01,123: INFO/ForkPoolWorker-4] [0e478f30-3050-401c-a731-1a2e5ced4535] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:01.845556331Z [2024-07-04 01:35:01,841: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:02.126722969Z [2024-07-04 01:35:02,121: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:02.159342098Z [2024-07-04 01:35:02,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:02.365213845Z [2024-07-04 01:35:02,327: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:03.314407689Z [2024-07-04 01:35:03,308: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:03.574980769Z [2024-07-04 01:35:03,460: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:04.225157381Z [2024-07-04 01:35:04,224: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:35:04.240718490Z [2024-07-04 01:35:04,240: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:04.385279307Z [2024-07-04 01:35:04,385: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:35:04.390016877Z [2024-07-04 01:35:04,389: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:04.390036121Z [2024-07-04 01:35:04,389: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:04.390241905Z [2024-07-04 01:35:04,389: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:04.390315737Z [2024-07-04 01:35:04,390: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:35:04.390605418Z [2024-07-04 01:35:04,390: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:04.390666498Z [2024-07-04 01:35:04,390: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:04.644293181Z [2024-07-04 01:35:04,644: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:05.469450130Z [2024-07-04 01:35:05,469: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:35:05.472968684Z [2024-07-04 01:35:05,472: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:05.566372659Z [2024-07-04 01:35:05,566: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:35:05.569724993Z [2024-07-04 01:35:05,569: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:05.569800507Z [2024-07-04 01:35:05,569: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:05.569951395Z [2024-07-04 01:35:05,569: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:05.570009662Z [2024-07-04 01:35:05,569: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:35:05.570288570Z [2024-07-04 01:35:05,570: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:35:05.570346867Z [2024-07-04 01:35:05,570: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:05.678099462Z [2024-07-04 01:35:05,677: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T01:35:05.683068709Z [2024-07-04 01:35:05,682: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:05.800006013Z [2024-07-04 01:35:05,799: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T01:35:05.802049357Z [2024-07-04 01:35:05,801: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:05.802372414Z [2024-07-04 01:35:05,802: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:05.802488730Z [2024-07-04 01:35:05,802: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:05.802731549Z [2024-07-04 01:35:05,802: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:05.802802720Z [2024-07-04 01:35:05,802: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T01:35:05.803066664Z [2024-07-04 01:35:05,802: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:35:05.803138324Z [2024-07-04 01:35:05,803: INFO/ForkPoolWorker-3] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:05.935805143Z [2024-07-04 01:35:05,935: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:05.936747874Z [2024-07-04 01:35:05,936: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:05.942112636Z [2024-07-04 01:35:05,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.029217365Z [2024-07-04 01:35:06,028: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:06.030928388Z [2024-07-04 01:35:06,030: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.031513733Z [2024-07-04 01:35:06,030: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.031754764Z [2024-07-04 01:35:06,031: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.032483851Z [2024-07-04 01:35:06,032: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:06.032780233Z [2024-07-04 01:35:06,032: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:06.032930582Z [2024-07-04 01:35:06,032: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.044100171Z [2024-07-04 01:35:06,043: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:06.045738176Z [2024-07-04 01:35:06,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:06.046878133Z [2024-07-04 01:35:06,046: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:06.052229998Z [2024-07-04 01:35:06,051: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.115023879Z [2024-07-04 01:35:06,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:06.118286617Z [2024-07-04 01:35:06,118: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.121013896Z [2024-07-04 01:35:06,118: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.121254261Z [2024-07-04 01:35:06,120: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.121371282Z [2024-07-04 01:35:06,121: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:06.121677097Z [2024-07-04 01:35:06,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:06.122962393Z [2024-07-04 01:35:06,121: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.143891617Z [2024-07-04 01:35:06,126: ERROR/ForkPoolWorker-15] [e31e5de4-f908-44f9-bc73-91eea1a87d14] Failed to execute task Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:06.143900416Z Traceback (most recent call last): 2024-07-04T01:35:06.143904562Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:06.143908264Z args.func(args) 2024-07-04T01:35:06.143911641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:06.143915324Z return func(*args, **kwargs) 2024-07-04T01:35:06.143918371Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:06.143922130Z return f(*args, **kwargs) 2024-07-04T01:35:06.143928571Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:06.143931662Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:06.143934800Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:06.143937915Z raise AirflowException( 2024-07-04T01:35:06.143942418Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:06.183582716Z [2024-07-04 01:35:06,183: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e31e5de4-f908-44f9-bc73-91eea1a87d14] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e31e5de4-f908-44f9-bc73-91eea1a87d14') 2024-07-04T01:35:06.183599279Z Traceback (most recent call last): 2024-07-04T01:35:06.183603012Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:06.183605848Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:06.183609092Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:06.183611971Z return self.run(*args, **kwargs) 2024-07-04T01:35:06.183615268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:06.183618577Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:06.183621415Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:06.183624974Z raise AirflowException(msg) 2024-07-04T01:35:06.183628525Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e31e5de4-f908-44f9-bc73-91eea1a87d14 2024-07-04T01:35:06.306480497Z [2024-07-04 01:35:06,306: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cf8bd5d-02b5-4ceb-a19f-9b83b2d9cfc2] succeeded in 5.501387824999938s: None 2024-07-04T01:35:06.465136118Z [2024-07-04 01:35:06,464: INFO/ForkPoolWorker-4] Getting VIM list 2024-07-04T01:35:06.468324397Z [2024-07-04 01:35:06,467: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.510637786Z [2024-07-04 01:35:06,510: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-07-04T01:35:06.512104407Z [2024-07-04 01:35:06,511: INFO/ForkPoolWorker-4] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.512120605Z [2024-07-04 01:35:06,512: INFO/ForkPoolWorker-4] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.512263467Z [2024-07-04 01:35:06,512: INFO/ForkPoolWorker-4] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.512273654Z [2024-07-04 01:35:06,512: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-07-04T01:35:06.512495478Z [2024-07-04 01:35:06,512: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:35:06.512504792Z [2024-07-04 01:35:06,512: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.524763897Z [2024-07-04 01:35:06,524: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:06.525374869Z [2024-07-04 01:35:06,524: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:06.526424724Z [2024-07-04 01:35:06,526: INFO/ForkPoolWorker-4] Getting VIM list 2024-07-04T01:35:06.529887976Z [2024-07-04 01:35:06,529: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.549748647Z [2024-07-04 01:35:06,549: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-07-04T01:35:06.552573090Z [2024-07-04 01:35:06,551: INFO/ForkPoolWorker-4] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.552970913Z [2024-07-04 01:35:06,552: INFO/ForkPoolWorker-4] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.554978164Z [2024-07-04 01:35:06,554: INFO/ForkPoolWorker-4] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.555045120Z [2024-07-04 01:35:06,554: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-07-04T01:35:06.555583464Z [2024-07-04 01:35:06,555: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:35:06.555682068Z [2024-07-04 01:35:06,555: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.562134650Z [2024-07-04 01:35:06,561: ERROR/ForkPoolWorker-4] [0e478f30-3050-401c-a731-1a2e5ced4535] Failed to execute task Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:06.562149800Z Traceback (most recent call last): 2024-07-04T01:35:06.562153886Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:06.562157829Z args.func(args) 2024-07-04T01:35:06.562196538Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:06.562201045Z return func(*args, **kwargs) 2024-07-04T01:35:06.562204242Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:06.562210424Z return f(*args, **kwargs) 2024-07-04T01:35:06.562213661Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:06.562216820Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:06.562219841Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:06.562222954Z raise AirflowException( 2024-07-04T01:35:06.562226787Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:06.611157784Z [2024-07-04 01:35:06,610: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[0e478f30-3050-401c-a731-1a2e5ced4535] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e478f30-3050-401c-a731-1a2e5ced4535') 2024-07-04T01:35:06.611172125Z Traceback (most recent call last): 2024-07-04T01:35:06.611175677Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:06.611178528Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:06.611181357Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:06.611184262Z return self.run(*args, **kwargs) 2024-07-04T01:35:06.611187814Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:06.611190997Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:06.611193981Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:06.611197522Z raise AirflowException(msg) 2024-07-04T01:35:06.611201104Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 0e478f30-3050-401c-a731-1a2e5ced4535 2024-07-04T01:35:06.733507304Z [2024-07-04 01:35:06,733: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:35:06.736824621Z [2024-07-04 01:35:06,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.767016472Z [2024-07-04 01:35:06,766: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:35:06.770983696Z [2024-07-04 01:35:06,770: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.772092802Z [2024-07-04 01:35:06,771: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.772396543Z [2024-07-04 01:35:06,772: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.772536736Z [2024-07-04 01:35:06,772: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:35:06.772844449Z [2024-07-04 01:35:06,772: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:35:06.772989393Z [2024-07-04 01:35:06,772: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.780591396Z [2024-07-04 01:35:06,780: WARNING/ForkPoolWorker-1] Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:06.782166899Z [2024-07-04 01:35:06,781: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:06.784231960Z [2024-07-04 01:35:06,783: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:35:06.788679923Z [2024-07-04 01:35:06,788: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:06.833644149Z [2024-07-04 01:35:06,833: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:35:06.838855204Z [2024-07-04 01:35:06,838: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:06.838952579Z [2024-07-04 01:35:06,838: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:06.839141744Z [2024-07-04 01:35:06,838: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:06.840835200Z [2024-07-04 01:35:06,839: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:35:06.841119612Z [2024-07-04 01:35:06,840: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:35:06.841251650Z [2024-07-04 01:35:06,841: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:06.844415081Z [2024-07-04 01:35:06,843: ERROR/ForkPoolWorker-1] [dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94] Failed to execute task Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:06.844430515Z Traceback (most recent call last): 2024-07-04T01:35:06.844435745Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:06.844440587Z args.func(args) 2024-07-04T01:35:06.844445652Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:06.844450649Z return func(*args, **kwargs) 2024-07-04T01:35:06.844471954Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:06.844476876Z return f(*args, **kwargs) 2024-07-04T01:35:06.844485064Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:06.844489173Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:06.844508434Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:06.844512595Z raise AirflowException( 2024-07-04T01:35:06.844517570Z airflow.exceptions.AirflowException: Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:06.892687536Z [2024-07-04 01:35:06,892: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94') 2024-07-04T01:35:06.892729074Z Traceback (most recent call last): 2024-07-04T01:35:06.892735085Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:06.892739642Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:06.892744359Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:06.892749152Z return self.run(*args, **kwargs) 2024-07-04T01:35:06.892755455Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:06.892760386Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:06.892765017Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:06.892770184Z raise AirflowException(msg) 2024-07-04T01:35:06.892776002Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id dc5fecdd-f046-4ff8-8e0d-466ffa6c3a94 2024-07-04T01:35:06.921576115Z [2024-07-04 01:35:06,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de3974f2-cb51-409e-9311-ac3329a60289] received 2024-07-04T01:35:06.930950415Z [2024-07-04 01:35:06,930: INFO/ForkPoolWorker-15] [de3974f2-cb51-409e-9311-ac3329a60289] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:07.234403962Z [2024-07-04 01:35:07,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:07.677419944Z [2024-07-04 01:35:07,676: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e8ed6736-efe0-44aa-9c2c-a1cdb22690d8] succeeded in 6.753995454999995s: None 2024-07-04T01:35:07.897841097Z [2024-07-04 01:35:07,897: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[78746536-b3e0-4ab6-aac9-e5003c35ec50] succeeded in 7.031180785999936s: None 2024-07-04T01:35:08.670091150Z [2024-07-04 01:35:08,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:08.673510946Z [2024-07-04 01:35:08,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:08.705717759Z [2024-07-04 01:35:08,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:08.707040581Z [2024-07-04 01:35:08,706: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:08.707134179Z [2024-07-04 01:35:08,707: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:08.707314603Z [2024-07-04 01:35:08,707: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:08.707413334Z [2024-07-04 01:35:08,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:08.707682333Z [2024-07-04 01:35:08,707: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:08.707816293Z [2024-07-04 01:35:08,707: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:08.789793098Z [2024-07-04 01:35:08,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:09.604033691Z [2024-07-04 01:35:09,603: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de3974f2-cb51-409e-9311-ac3329a60289] succeeded in 2.680186532000107s: None 2024-07-04T01:35:10.541295188Z [2024-07-04 01:35:10,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ba4d1f0-c09b-41f1-9e8c-31ea868233c0] received 2024-07-04T01:35:10.558464439Z [2024-07-04 01:35:10,558: INFO/ForkPoolWorker-15] [4ba4d1f0-c09b-41f1-9e8c-31ea868233c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:35:10.976451380Z [2024-07-04 01:35:10,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:12.378944876Z [2024-07-04 01:35:12,378: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:12.383404647Z [2024-07-04 01:35:12,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:12.419614859Z [2024-07-04 01:35:12,419: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:12.421492466Z [2024-07-04 01:35:12,421: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:12.421749044Z [2024-07-04 01:35:12,421: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:12.422041004Z [2024-07-04 01:35:12,421: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:12.422240909Z [2024-07-04 01:35:12,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:12.422826460Z [2024-07-04 01:35:12,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:12.423584427Z [2024-07-04 01:35:12,423: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:12.526461953Z [2024-07-04 01:35:12,526: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:13.199687180Z [2024-07-04 01:35:13,199: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ba4d1f0-c09b-41f1-9e8c-31ea868233c0] succeeded in 2.651762166000026s: None 2024-07-04T01:35:13.383705012Z [2024-07-04 01:35:13,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53e073b7-58e8-4c49-b87d-183a04e65be7] received 2024-07-04T01:35:13.396421974Z [2024-07-04 01:35:13,396: INFO/ForkPoolWorker-15] [53e073b7-58e8-4c49-b87d-183a04e65be7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:13.744041794Z [2024-07-04 01:35:13,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:15.011901693Z [2024-07-04 01:35:15,011: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:15.015276389Z [2024-07-04 01:35:15,014: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:15.049415147Z [2024-07-04 01:35:15,049: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:15.051346961Z [2024-07-04 01:35:15,051: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:15.051615281Z [2024-07-04 01:35:15,051: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:15.052927203Z [2024-07-04 01:35:15,051: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:15.052938685Z [2024-07-04 01:35:15,051: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:15.052942330Z [2024-07-04 01:35:15,052: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:15.052946568Z [2024-07-04 01:35:15,052: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:15.154134080Z [2024-07-04 01:35:15,153: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:35:15.687115186Z [2024-07-04 01:35:15,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53e073b7-58e8-4c49-b87d-183a04e65be7] succeeded in 2.3009362189999365s: None 2024-07-04T01:35:17.428250920Z [2024-07-04 01:35:17,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f58a310a-6775-45ae-a83d-7da1a4a04907] received 2024-07-04T01:35:17.433247855Z [2024-07-04 01:35:17,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed27f44c-cfe6-41d3-bf66-612621d1e37c] received 2024-07-04T01:35:17.440810040Z [2024-07-04 01:35:17,440: INFO/ForkPoolWorker-15] [f58a310a-6775-45ae-a83d-7da1a4a04907] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:35:17.442175124Z [2024-07-04 01:35:17,441: INFO/ForkPoolWorker-16] [ed27f44c-cfe6-41d3-bf66-612621d1e37c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:35:17.443660025Z [2024-07-04 01:35:17,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[861020b8-71cb-40ff-962e-4c626f649d07] received 2024-07-04T01:35:17.454979975Z [2024-07-04 01:35:17,454: INFO/ForkPoolWorker-1] [861020b8-71cb-40ff-962e-4c626f649d07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:35:17.816459634Z [2024-07-04 01:35:17,812: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:17.833116951Z [2024-07-04 01:35:17,829: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:17.945629035Z [2024-07-04 01:35:17,941: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:19.322679274Z [2024-07-04 01:35:19,322: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:35:19.328042062Z [2024-07-04 01:35:19,326: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:19.369910203Z [2024-07-04 01:35:19,369: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:35:19.372453919Z [2024-07-04 01:35:19,372: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:19.372490728Z [2024-07-04 01:35:19,372: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:19.373025304Z [2024-07-04 01:35:19,372: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:19.373094739Z [2024-07-04 01:35:19,372: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:35:19.373366699Z [2024-07-04 01:35:19,373: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:35:19.373429693Z [2024-07-04 01:35:19,373: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:19.394491228Z [2024-07-04 01:35:19,394: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:19.404185074Z [2024-07-04 01:35:19,396: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:35:19.405320607Z [2024-07-04 01:35:19,405: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:35:19.415733082Z [2024-07-04 01:35:19,415: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:19.463380951Z [2024-07-04 01:35:19,462: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:35:19.468967956Z [2024-07-04 01:35:19,468: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:19.469002824Z [2024-07-04 01:35:19,468: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:19.469175391Z [2024-07-04 01:35:19,468: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:19.469472598Z [2024-07-04 01:35:19,469: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:35:19.469896269Z [2024-07-04 01:35:19,469: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:35:19.470556653Z [2024-07-04 01:35:19,469: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:19.487592068Z [2024-07-04 01:35:19,486: ERROR/ForkPoolWorker-1] [861020b8-71cb-40ff-962e-4c626f649d07] Failed to execute task Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:19.487610236Z Traceback (most recent call last): 2024-07-04T01:35:19.487613875Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:19.487617298Z args.func(args) 2024-07-04T01:35:19.487620760Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:19.487624387Z return func(*args, **kwargs) 2024-07-04T01:35:19.487627388Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:19.487630745Z return f(*args, **kwargs) 2024-07-04T01:35:19.487633746Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:19.487636766Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:19.487639864Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:19.487642867Z raise AirflowException( 2024-07-04T01:35:19.487646339Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:19.621065914Z [2024-07-04 01:35:19,620: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[861020b8-71cb-40ff-962e-4c626f649d07] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 861020b8-71cb-40ff-962e-4c626f649d07') 2024-07-04T01:35:19.621078720Z Traceback (most recent call last): 2024-07-04T01:35:19.621083445Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:19.621086705Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:19.621089688Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:19.621092831Z return self.run(*args, **kwargs) 2024-07-04T01:35:19.621097153Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:19.621101264Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:19.621104264Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:19.621107984Z raise AirflowException(msg) 2024-07-04T01:35:19.621111677Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 861020b8-71cb-40ff-962e-4c626f649d07 2024-07-04T01:35:19.703553958Z [2024-07-04 01:35:19,702: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:35:19.706501107Z [2024-07-04 01:35:19,705: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:19.793745197Z [2024-07-04 01:35:19,793: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:35:19.803407909Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:19.804817672Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:19.804830175Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:19.804833948Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:35:19.804837037Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:35:19.804840074Z [2024-07-04 01:35:19,803: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:19.830963823Z [2024-07-04 01:35:19,824: WARNING/ForkPoolWorker-16] Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:19.830984352Z [2024-07-04 01:35:19,824: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:35:19.830988362Z [2024-07-04 01:35:19,826: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:35:19.855185493Z [2024-07-04 01:35:19,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:19.877434313Z [2024-07-04 01:35:19,872: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:19.883210334Z [2024-07-04 01:35:19,875: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:19.979890469Z [2024-07-04 01:35:19,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:35:19.983156014Z [2024-07-04 01:35:19,982: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:19.983410603Z [2024-07-04 01:35:19,983: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:19.983658205Z [2024-07-04 01:35:19,983: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:19.983813393Z [2024-07-04 01:35:19,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:35:19.984124082Z [2024-07-04 01:35:19,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:35:19.984634113Z [2024-07-04 01:35:19,984: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:19.985503487Z [2024-07-04 01:35:19,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:19.990168320Z [2024-07-04 01:35:19,989: ERROR/ForkPoolWorker-16] [ed27f44c-cfe6-41d3-bf66-612621d1e37c] Failed to execute task Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:19.990183791Z Traceback (most recent call last): 2024-07-04T01:35:19.990192722Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:19.990197051Z args.func(args) 2024-07-04T01:35:19.990200535Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:19.990205025Z return func(*args, **kwargs) 2024-07-04T01:35:19.990207992Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:19.990210958Z return f(*args, **kwargs) 2024-07-04T01:35:19.990214555Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:19.990217573Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:19.990220621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:19.990223569Z raise AirflowException( 2024-07-04T01:35:19.990228242Z airflow.exceptions.AirflowException: Dag 'vim_status_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:19.996739402Z [2024-07-04 01:35:19,995: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:19.996752656Z [2024-07-04 01:35:19,995: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:19.996757438Z [2024-07-04 01:35:19,995: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:19.996761093Z [2024-07-04 01:35:19,996: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:19.996764156Z [2024-07-04 01:35:19,996: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:19.996767163Z [2024-07-04 01:35:19,996: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:20.015155966Z [2024-07-04 01:35:20,010: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:20.016491533Z [2024-07-04 01:35:20,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:35:20.018317761Z [2024-07-04 01:35:20,018: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:35:20.021906116Z [2024-07-04 01:35:20,020: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:35:20.061996756Z [2024-07-04 01:35:20,061: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed27f44c-cfe6-41d3-bf66-612621d1e37c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed27f44c-cfe6-41d3-bf66-612621d1e37c') 2024-07-04T01:35:20.062016174Z Traceback (most recent call last): 2024-07-04T01:35:20.062048869Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:20.062054273Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:20.062059152Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:20.062063617Z return self.run(*args, **kwargs) 2024-07-04T01:35:20.062068808Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:20.062075078Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:20.062079341Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:20.062085621Z raise AirflowException(msg) 2024-07-04T01:35:20.062090458Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id ed27f44c-cfe6-41d3-bf66-612621d1e37c 2024-07-04T01:35:20.087968212Z [2024-07-04 01:35:20,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:35:20.094505092Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:35:20.094520344Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:35:20.094621509Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:35:20.094651025Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:35:20.094923382Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:35:20.094944136Z [2024-07-04 01:35:20,094: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:35:20.105761420Z [2024-07-04 01:35:20,104: ERROR/ForkPoolWorker-15] [f58a310a-6775-45ae-a83d-7da1a4a04907] Failed to execute task Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:35:20.105777085Z Traceback (most recent call last): 2024-07-04T01:35:20.105781426Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:35:20.105787184Z args.func(args) 2024-07-04T01:35:20.105790902Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:35:20.105794640Z return func(*args, **kwargs) 2024-07-04T01:35:20.105797733Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:35:20.105800999Z return f(*args, **kwargs) 2024-07-04T01:35:20.105804124Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:35:20.105819880Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:35:20.105823603Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:35:20.105826762Z raise AirflowException( 2024-07-04T01:35:20.105831608Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_1e54348b-b455-4f36-bee8-56b2b5553b71' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:35:20.166955172Z [2024-07-04 01:35:20,166: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f58a310a-6775-45ae-a83d-7da1a4a04907] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f58a310a-6775-45ae-a83d-7da1a4a04907') 2024-07-04T01:35:20.166984732Z Traceback (most recent call last): 2024-07-04T01:35:20.166989356Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:35:20.166992372Z R = retval = fun(*args, **kwargs) 2024-07-04T01:35:20.166995581Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:35:20.166998506Z return self.run(*args, **kwargs) 2024-07-04T01:35:20.167002975Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:35:20.167006954Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:35:20.167009865Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:35:20.167014169Z raise AirflowException(msg) 2024-07-04T01:35:20.167017616Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id f58a310a-6775-45ae-a83d-7da1a4a04907 2024-07-04T01:36:00.764197177Z [2024-07-04 01:36:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e008f26-b6cd-4859-b77a-df9fc96755e3] received 2024-07-04T01:36:00.768926124Z [2024-07-04 01:36:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3626f3bd-cab7-4c9b-9ca8-19e26eea8d3a] received 2024-07-04T01:36:00.772757017Z [2024-07-04 01:36:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc65bea1-f8a1-44a2-b1c9-dafd959e49f7] received 2024-07-04T01:36:00.789033862Z [2024-07-04 01:36:00,788: INFO/ForkPoolWorker-16] [3626f3bd-cab7-4c9b-9ca8-19e26eea8d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:36:00.829310609Z [2024-07-04 01:36:00,828: INFO/ForkPoolWorker-1] [dc65bea1-f8a1-44a2-b1c9-dafd959e49f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:36:00.846206800Z [2024-07-04 01:36:00,845: INFO/ForkPoolWorker-15] [3e008f26-b6cd-4859-b77a-df9fc96755e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:36:01.258254285Z [2024-07-04 01:36:01,251: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:36:01.445911677Z [2024-07-04 01:36:01,441: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:36:01.552040762Z [2024-07-04 01:36:01,544: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:36:01.944202735Z [2024-07-04 01:36:01,943: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:02.570221649Z [2024-07-04 01:36:02,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e008f26-b6cd-4859-b77a-df9fc96755e3] succeeded in 1.7987027609999586s: None 2024-07-04T01:36:02.969335613Z [2024-07-04 01:36:02,968: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:36:02.973128721Z [2024-07-04 01:36:02,972: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:03.002274433Z [2024-07-04 01:36:03,001: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:36:03.009361345Z [2024-07-04 01:36:03,009: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:36:03.009386909Z [2024-07-04 01:36:03,008: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:03.010549334Z [2024-07-04 01:36:03,010: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:03.010611752Z [2024-07-04 01:36:03,010: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:03.010824928Z [2024-07-04 01:36:03,010: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:36:03.010970049Z [2024-07-04 01:36:03,010: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:36:03.011256472Z [2024-07-04 01:36:03,011: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:36:03.011317011Z [2024-07-04 01:36:03,011: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:03.061466984Z [2024-07-04 01:36:03,061: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:36:03.071018513Z [2024-07-04 01:36:03,070: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:03.071547268Z [2024-07-04 01:36:03,071: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:03.072150451Z [2024-07-04 01:36:03,071: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:36:03.072548778Z [2024-07-04 01:36:03,072: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:36:03.073466771Z [2024-07-04 01:36:03,073: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:36:03.075297841Z [2024-07-04 01:36:03,075: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:03.092590346Z [2024-07-04 01:36:03,092: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:03.161338950Z [2024-07-04 01:36:03,161: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:05.514364616Z [2024-07-04 01:36:05,513: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3626f3bd-cab7-4c9b-9ca8-19e26eea8d3a] succeeded in 4.741466885999898s: None 2024-07-04T01:36:06.300855561Z [2024-07-04 01:36:06,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc65bea1-f8a1-44a2-b1c9-dafd959e49f7] succeeded in 5.5230333100000735s: None 2024-07-04T01:36:38.677101158Z [2024-07-04 01:36:38,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5202f821-91be-4f41-83f2-edae172c5220] received 2024-07-04T01:36:38.685483248Z [2024-07-04 01:36:38,685: INFO/ForkPoolWorker-15] [5202f821-91be-4f41-83f2-edae172c5220] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:36:39.097869438Z [2024-07-04 01:36:39,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:36:40.325196315Z [2024-07-04 01:36:40,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa12a84-8013-40a5-a1b3-8083f66ff0a4] received 2024-07-04T01:36:40.357328612Z [2024-07-04 01:36:40,356: INFO/ForkPoolWorker-16] [2fa12a84-8013-40a5-a1b3-8083f66ff0a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:36:40.860397802Z [2024-07-04 01:36:40,860: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:36:40.863824037Z [2024-07-04 01:36:40,863: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:40.916672158Z [2024-07-04 01:36:40,916: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:36:40.918193762Z [2024-07-04 01:36:40,917: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:40.918545648Z [2024-07-04 01:36:40,918: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:40.918749963Z [2024-07-04 01:36:40,918: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:40.918916765Z [2024-07-04 01:36:40,918: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:40.919003480Z [2024-07-04 01:36:40,918: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:36:40.924463501Z [2024-07-04 01:36:40,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:36:40.924480118Z [2024-07-04 01:36:40,924: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:40.929224244Z [2024-07-04 01:36:40,928: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:41.046602427Z [2024-07-04 01:36:41,041: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:36:41.151397290Z [2024-07-04 01:36:41,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:42.736174935Z [2024-07-04 01:36:42,735: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:36:42.739545778Z [2024-07-04 01:36:42,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:42.778218187Z [2024-07-04 01:36:42,777: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:36:42.779866345Z [2024-07-04 01:36:42,779: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:42.780139396Z [2024-07-04 01:36:42,780: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:42.781109684Z [2024-07-04 01:36:42,780: INFO/ForkPoolWorker-16] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:42.781572871Z [2024-07-04 01:36:42,781: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:42.781670930Z [2024-07-04 01:36:42,781: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:36:42.782919286Z [2024-07-04 01:36:42,782: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:36:42.783105814Z [2024-07-04 01:36:42,782: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:42.790367733Z [2024-07-04 01:36:42,790: INFO/ForkPoolWorker-16] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:42.895266028Z [2024-07-04 01:36:42,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:43.051502607Z [2024-07-04 01:36:43,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60562eb2-7c4b-43a8-86e7-99eca7c4f1c3] received 2024-07-04T01:36:43.088808358Z [2024-07-04 01:36:43,088: INFO/ForkPoolWorker-1] [60562eb2-7c4b-43a8-86e7-99eca7c4f1c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:43.360884709Z [2024-07-04 01:36:43,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5202f821-91be-4f41-83f2-edae172c5220] succeeded in 4.682125842999994s: None 2024-07-04T01:36:43.517177973Z [2024-07-04 01:36:43,512: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:36:44.444319656Z [2024-07-04 01:36:44,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2fa12a84-8013-40a5-a1b3-8083f66ff0a4] succeeded in 4.116215582999985s: None 2024-07-04T01:36:44.896264802Z [2024-07-04 01:36:44,895: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:36:44.899755834Z [2024-07-04 01:36:44,899: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:44.929267340Z [2024-07-04 01:36:44,929: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:36:44.931135744Z [2024-07-04 01:36:44,930: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:44.931162662Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:44.931204668Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:44.931363015Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:44.931400777Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:36:44.931588560Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:36:44.931623127Z [2024-07-04 01:36:44,931: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:44.938660897Z [2024-07-04 01:36:44,938: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:45.017062048Z [2024-07-04 01:36:45,016: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:45.639930474Z [2024-07-04 01:36:45,639: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60562eb2-7c4b-43a8-86e7-99eca7c4f1c3] succeeded in 2.574665947999847s: None 2024-07-04T01:36:46.532097246Z [2024-07-04 01:36:46,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99eaff5e-c70b-4790-b95e-33a991415c47] received 2024-07-04T01:36:46.545871574Z [2024-07-04 01:36:46,545: INFO/ForkPoolWorker-15] [99eaff5e-c70b-4790-b95e-33a991415c47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'split_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:46.859176989Z [2024-07-04 01:36:46,855: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:36:48.178986647Z [2024-07-04 01:36:48,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:36:48.185759677Z [2024-07-04 01:36:48,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:48.234626072Z [2024-07-04 01:36:48,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:36:48.239682052Z [2024-07-04 01:36:48,239: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:48.239704013Z [2024-07-04 01:36:48,239: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:48.239800990Z [2024-07-04 01:36:48,239: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:48.240020268Z [2024-07-04 01:36:48,239: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:48.240092473Z [2024-07-04 01:36:48,239: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:36:48.243622202Z [2024-07-04 01:36:48,240: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:36:48.243880380Z [2024-07-04 01:36:48,243: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:48.254808417Z [2024-07-04 01:36:48,254: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:48.385672180Z [2024-07-04 01:36:48,385: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:49.187101846Z [2024-07-04 01:36:49,184: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99eaff5e-c70b-4790-b95e-33a991415c47] succeeded in 2.650731159000088s: None 2024-07-04T01:36:49.439355532Z [2024-07-04 01:36:49,439: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[424b30ef-c8ee-440e-9e4c-6caed11c602a] received 2024-07-04T01:36:49.457533015Z [2024-07-04 01:36:49,457: INFO/ForkPoolWorker-15] [424b30ef-c8ee-440e-9e4c-6caed11c602a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'collect_metrics', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:36:49.861491004Z [2024-07-04 01:36:49,858: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:36:51.323268009Z [2024-07-04 01:36:51,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:36:51.328954165Z [2024-07-04 01:36:51,326: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:51.365110374Z [2024-07-04 01:36:51,364: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:36:51.366099355Z [2024-07-04 01:36:51,365: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:51.366247998Z [2024-07-04 01:36:51,366: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:51.366410073Z [2024-07-04 01:36:51,366: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:51.366621841Z [2024-07-04 01:36:51,366: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:51.366759319Z [2024-07-04 01:36:51,366: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:36:51.367179566Z [2024-07-04 01:36:51,367: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:36:51.367294937Z [2024-07-04 01:36:51,367: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:51.373025918Z [2024-07-04 01:36:51,372: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:51.461021643Z [2024-07-04 01:36:51,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:52.029180989Z [2024-07-04 01:36:52,028: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[424b30ef-c8ee-440e-9e4c-6caed11c602a] succeeded in 2.5850675480000973s: None 2024-07-04T01:36:52.924831252Z [2024-07-04 01:36:52,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec93bf76-acac-42ae-bf75-303455a005e9] received 2024-07-04T01:36:52.943303349Z [2024-07-04 01:36:52,942: INFO/ForkPoolWorker-15] [ec93bf76-acac-42ae-bf75-303455a005e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'send_prometheus', 'scheduled__2024-07-04T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:36:53.326174214Z [2024-07-04 01:36:53,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:36:54.725618035Z [2024-07-04 01:36:54,725: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:36:54.730089874Z [2024-07-04 01:36:54,729: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:36:54.806615056Z [2024-07-04 01:36:54,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:36:54.807860958Z [2024-07-04 01:36:54,807: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:36:54.807904491Z [2024-07-04 01:36:54,807: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:36:54.807937438Z [2024-07-04 01:36:54,807: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:36:54.808057553Z [2024-07-04 01:36:54,807: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:36:54.808096750Z [2024-07-04 01:36:54,808: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:36:54.808307179Z [2024-07-04 01:36:54,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:36:54.808357927Z [2024-07-04 01:36:54,808: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:36:54.820274756Z [2024-07-04 01:36:54,817: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:36:54.898825819Z [2024-07-04 01:36:54,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:36:55.578626163Z [2024-07-04 01:36:55,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec93bf76-acac-42ae-bf75-303455a005e9] succeeded in 2.649965767999902s: None 2024-07-04T01:37:01.170991995Z [2024-07-04 01:37:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[335df0e5-7404-4e0d-b1eb-0c2638b331e6] received 2024-07-04T01:37:01.174219613Z [2024-07-04 01:37:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a575d64-cc5a-444c-9db4-05c4ba3708e3] received 2024-07-04T01:37:01.178026265Z [2024-07-04 01:37:01,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dccaf4a-aeed-4aca-8c61-5b3e0b4f225f] received 2024-07-04T01:37:01.184721675Z [2024-07-04 01:37:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58739443-e593-490b-8913-671ac7b87783] received 2024-07-04T01:37:01.196472831Z [2024-07-04 01:37:01,196: INFO/ForkPoolWorker-15] [335df0e5-7404-4e0d-b1eb-0c2638b331e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:37:01.212258589Z [2024-07-04 01:37:01,211: INFO/ForkPoolWorker-2] [58739443-e593-490b-8913-671ac7b87783] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:37:01.238378580Z [2024-07-04 01:37:01,238: INFO/ForkPoolWorker-1] [4dccaf4a-aeed-4aca-8c61-5b3e0b4f225f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:37:01.243994727Z [2024-07-04 01:37:01,243: INFO/ForkPoolWorker-16] [9a575d64-cc5a-444c-9db4-05c4ba3708e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:37:01.728773171Z [2024-07-04 01:37:01,725: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:37:01.804337783Z [2024-07-04 01:37:01,797: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:37:01.899029929Z [2024-07-04 01:37:01,891: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:37:01.972984911Z [2024-07-04 01:37:01,969: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:37:03.394189420Z [2024-07-04 01:37:03,393: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:37:03.395172573Z [2024-07-04 01:37:03,394: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:37:03.397331575Z [2024-07-04 01:37:03,396: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:37:03.399603618Z [2024-07-04 01:37:03,399: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:37:03.422224482Z [2024-07-04 01:37:03,421: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:37:03.429316703Z [2024-07-04 01:37:03,428: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:37:03.441395951Z [2024-07-04 01:37:03,441: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:37:03.443124389Z [2024-07-04 01:37:03,442: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:37:03.443191829Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:37:03.443260471Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:37:03.443401292Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:37:03.443467919Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:37:03.443708642Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:37:03.443754431Z [2024-07-04 01:37:03,443: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:37:03.449784845Z [2024-07-04 01:37:03,449: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:37:03.451219184Z [2024-07-04 01:37:03,451: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:37:03.454696569Z [2024-07-04 01:37:03,454: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:37:03.454735324Z [2024-07-04 01:37:03,454: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:37:03.454857287Z [2024-07-04 01:37:03,454: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:37:03.455076082Z [2024-07-04 01:37:03,454: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:37:03.455417349Z [2024-07-04 01:37:03,455: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:37:03.455785425Z [2024-07-04 01:37:03,455: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:37:03.456020958Z [2024-07-04 01:37:03,455: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:37:03.460588145Z [2024-07-04 01:37:03,460: INFO/ForkPoolWorker-15] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:37:03.471352850Z [2024-07-04 01:37:03,471: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:37:03.473758185Z [2024-07-04 01:37:03,473: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:37:03.474932026Z [2024-07-04 01:37:03,474: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:37:03.475107223Z [2024-07-04 01:37:03,474: INFO/ForkPoolWorker-2] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:37:03.477876587Z [2024-07-04 01:37:03,475: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:37:03.477882293Z [2024-07-04 01:37:03,475: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:37:03.477885657Z [2024-07-04 01:37:03,475: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:37:03.477888750Z [2024-07-04 01:37:03,475: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:37:03.484385253Z [2024-07-04 01:37:03,484: INFO/ForkPoolWorker-2] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:37:03.554490508Z [2024-07-04 01:37:03,554: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:37:03.587954399Z [2024-07-04 01:37:03,587: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:37:03.597330781Z [2024-07-04 01:37:03,597: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:37:03.599178030Z [2024-07-04 01:37:03,598: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:37:03.602323657Z [2024-07-04 01:37:03,601: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:37:03.660918131Z [2024-07-04 01:37:03,660: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:37:03.662501185Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:37:03.662630137Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:37:03.662682097Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:37:03.662798741Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:37:03.662837600Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:37:03.663096925Z [2024-07-04 01:37:03,662: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:37:03.663139589Z [2024-07-04 01:37:03,663: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:37:03.668164634Z [2024-07-04 01:37:03,667: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:37:03.753298516Z [2024-07-04 01:37:03,753: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:37:05.375494972Z [2024-07-04 01:37:05,374: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[58739443-e593-490b-8913-671ac7b87783] succeeded in 4.185312794000083s: None 2024-07-04T01:37:05.515505393Z [2024-07-04 01:37:05,515: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[335df0e5-7404-4e0d-b1eb-0c2638b331e6] succeeded in 4.339504845999954s: None 2024-07-04T01:37:06.109240418Z [2024-07-04 01:37:06,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a575d64-cc5a-444c-9db4-05c4ba3708e3] succeeded in 4.932126741000047s: None 2024-07-04T01:37:06.318981236Z [2024-07-04 01:37:06,318: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4dccaf4a-aeed-4aca-8c61-5b3e0b4f225f] succeeded in 5.135797770999943s: None 2024-07-04T01:38:00.674854145Z [2024-07-04 01:38:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee43f028-31d1-4a1d-b6d9-192d3266df3b] received 2024-07-04T01:38:00.678814918Z [2024-07-04 01:38:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2879cdd-493c-441d-b113-8546821a5b7c] received 2024-07-04T01:38:00.693168073Z [2024-07-04 01:38:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[050f9de7-6e36-406e-9ea2-21b2869d6c4b] received 2024-07-04T01:38:00.697231786Z [2024-07-04 01:38:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b19c6203-3c82-43ae-8848-2ff336a5e6da] received 2024-07-04T01:38:00.697759621Z [2024-07-04 01:38:00,697: INFO/ForkPoolWorker-15] [ee43f028-31d1-4a1d-b6d9-192d3266df3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:38:00.700903266Z [2024-07-04 01:38:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24a74bc8-63ce-416c-9798-46ad3aac9723] received 2024-07-04T01:38:00.716986992Z [2024-07-04 01:38:00,716: INFO/ForkPoolWorker-1] [050f9de7-6e36-406e-9ea2-21b2869d6c4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:38:00.744577097Z [2024-07-04 01:38:00,744: INFO/ForkPoolWorker-16] [c2879cdd-493c-441d-b113-8546821a5b7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:38:00.750247887Z [2024-07-04 01:38:00,749: INFO/ForkPoolWorker-2] [b19c6203-3c82-43ae-8848-2ff336a5e6da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:38:00.800278328Z [2024-07-04 01:38:00,799: INFO/ForkPoolWorker-3] [24a74bc8-63ce-416c-9798-46ad3aac9723] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:38:01.309221498Z [2024-07-04 01:38:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:38:01.371932879Z [2024-07-04 01:38:01,367: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:38:01.445122586Z [2024-07-04 01:38:01,441: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:38:01.821708633Z [2024-07-04 01:38:01,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:38:01.848638548Z [2024-07-04 01:38:01,848: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:38:02.046447100Z [2024-07-04 01:38:02,040: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:38:03.072226686Z [2024-07-04 01:38:03,071: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[050f9de7-6e36-406e-9ea2-21b2869d6c4b] succeeded in 2.3664801200000056s: None 2024-07-04T01:38:03.665366391Z [2024-07-04 01:38:03,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:38:03.669156098Z [2024-07-04 01:38:03,668: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:38:03.728041889Z [2024-07-04 01:38:03,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:38:03.732528080Z [2024-07-04 01:38:03,732: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:38:03.735872481Z [2024-07-04 01:38:03,735: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:38:03.735896290Z [2024-07-04 01:38:03,735: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:38:03.735999633Z [2024-07-04 01:38:03,735: INFO/ForkPoolWorker-16] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:38:03.736178812Z [2024-07-04 01:38:03,735: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:38:03.736241847Z [2024-07-04 01:38:03,736: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:38:03.736559550Z [2024-07-04 01:38:03,736: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:38:03.736604849Z [2024-07-04 01:38:03,736: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:38:03.736855205Z [2024-07-04 01:38:03,736: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:38:03.742120757Z [2024-07-04 01:38:03,741: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:38:03.797297070Z [2024-07-04 01:38:03,797: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:38:03.802847192Z [2024-07-04 01:38:03,802: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:38:03.802862465Z [2024-07-04 01:38:03,802: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:38:03.805234908Z [2024-07-04 01:38:03,805: INFO/ForkPoolWorker-2] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:38:03.806365095Z [2024-07-04 01:38:03,805: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:38:03.806646106Z [2024-07-04 01:38:03,806: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:38:03.807370832Z [2024-07-04 01:38:03,807: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:38:03.807702186Z [2024-07-04 01:38:03,807: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:38:03.822823309Z [2024-07-04 01:38:03,821: INFO/ForkPoolWorker-2] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:38:03.915861894Z [2024-07-04 01:38:03,915: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T01:38:03.923114354Z [2024-07-04 01:38:03,922: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:38:03.981296442Z [2024-07-04 01:38:03,981: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:38:03.990467144Z [2024-07-04 01:38:03,990: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T01:38:03.991659376Z [2024-07-04 01:38:03,991: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:38:03.991921813Z [2024-07-04 01:38:03,991: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:38:03.992050806Z [2024-07-04 01:38:03,991: INFO/ForkPoolWorker-3] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:38:03.992242001Z [2024-07-04 01:38:03,992: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:38:03.992346702Z [2024-07-04 01:38:03,992: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T01:38:03.992626031Z [2024-07-04 01:38:03,992: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:38:03.992745086Z [2024-07-04 01:38:03,992: INFO/ForkPoolWorker-3] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:38:03.998363653Z [2024-07-04 01:38:03,998: INFO/ForkPoolWorker-3] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:38:04.056726746Z [2024-07-04 01:38:04,056: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:38:04.174627348Z [2024-07-04 01:38:04,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:38:04.178666729Z [2024-07-04 01:38:04,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:38:04.188036726Z [2024-07-04 01:38:04,187: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:38:04.273494221Z [2024-07-04 01:38:04,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:38:04.275822926Z [2024-07-04 01:38:04,275: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:38:04.276134795Z [2024-07-04 01:38:04,275: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:38:04.276365341Z [2024-07-04 01:38:04,276: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:38:04.276728883Z [2024-07-04 01:38:04,276: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:38:04.276989214Z [2024-07-04 01:38:04,276: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:38:04.277471188Z [2024-07-04 01:38:04,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:38:04.277812384Z [2024-07-04 01:38:04,277: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:38:04.301329884Z [2024-07-04 01:38:04,300: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:38:04.445738626Z [2024-07-04 01:38:04,445: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:38:06.478460069Z [2024-07-04 01:38:06,477: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[24a74bc8-63ce-416c-9798-46ad3aac9723] succeeded in 5.768809401999988s: None 2024-07-04T01:38:06.829915981Z [2024-07-04 01:38:06,829: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b19c6203-3c82-43ae-8848-2ff336a5e6da] succeeded in 6.112909712000146s: None 2024-07-04T01:38:07.600473513Z [2024-07-04 01:38:07,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ee43f028-31d1-4a1d-b6d9-192d3266df3b] succeeded in 6.91875336399994s: None 2024-07-04T01:38:07.601794668Z [2024-07-04 01:38:07,600: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2879cdd-493c-441d-b113-8546821a5b7c] succeeded in 6.919120948999989s: None 2024-07-04T01:39:01.039202232Z [2024-07-04 01:39:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8839edda-52e1-4e18-9646-cdc33f91aab0] received 2024-07-04T01:39:01.043073636Z [2024-07-04 01:39:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[670a0784-2e72-4d11-9f1f-8a18751fabb4] received 2024-07-04T01:39:01.060609652Z [2024-07-04 01:39:01,060: INFO/ForkPoolWorker-16] [670a0784-2e72-4d11-9f1f-8a18751fabb4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:39:01.064313064Z [2024-07-04 01:39:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d39eab6c-9e9a-4050-9448-e10332e9edbd] received 2024-07-04T01:39:01.075875731Z [2024-07-04 01:39:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcafc2c2-264c-4096-a1ea-31d0e7d75196] received 2024-07-04T01:39:01.091639843Z [2024-07-04 01:39:01,091: INFO/ForkPoolWorker-15] [8839edda-52e1-4e18-9646-cdc33f91aab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:39:01.132113966Z [2024-07-04 01:39:01,131: INFO/ForkPoolWorker-2] [bcafc2c2-264c-4096-a1ea-31d0e7d75196] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:39:01.144466142Z [2024-07-04 01:39:01,144: INFO/ForkPoolWorker-1] [d39eab6c-9e9a-4050-9448-e10332e9edbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:39:01.814899447Z [2024-07-04 01:39:01,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:39:01.958104710Z [2024-07-04 01:39:01,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:39:02.306046097Z [2024-07-04 01:39:02,300: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:39:02.571485484Z [2024-07-04 01:39:02,567: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:39:03.417991046Z [2024-07-04 01:39:03,417: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:39:03.421402862Z [2024-07-04 01:39:03,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:39:03.463971998Z [2024-07-04 01:39:03,463: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:39:03.470128125Z [2024-07-04 01:39:03,469: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:39:03.471776280Z [2024-07-04 01:39:03,471: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:39:03.473616293Z [2024-07-04 01:39:03,473: INFO/ForkPoolWorker-15] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:39:03.480855287Z [2024-07-04 01:39:03,480: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:39:03.480911681Z [2024-07-04 01:39:03,480: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:39:03.481621614Z [2024-07-04 01:39:03,480: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:39:03.481704382Z [2024-07-04 01:39:03,481: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:39:03.487061137Z [2024-07-04 01:39:03,486: INFO/ForkPoolWorker-15] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:39:03.655212098Z [2024-07-04 01:39:03,655: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:39:04.108121566Z [2024-07-04 01:39:04,107: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:39:04.111926274Z [2024-07-04 01:39:04,111: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:39:04.138271836Z [2024-07-04 01:39:04,138: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:39:04.140753014Z [2024-07-04 01:39:04,140: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:39:04.140808672Z [2024-07-04 01:39:04,140: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:39:04.141385920Z [2024-07-04 01:39:04,140: INFO/ForkPoolWorker-2] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:39:04.141626081Z [2024-07-04 01:39:04,141: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:39:04.142634251Z [2024-07-04 01:39:04,142: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:39:04.145580613Z [2024-07-04 01:39:04,145: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:39:04.145613382Z [2024-07-04 01:39:04,145: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:39:04.150817622Z [2024-07-04 01:39:04,150: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:39:04.268213158Z [2024-07-04 01:39:04,267: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:39:04.316739499Z [2024-07-04 01:39:04,316: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:39:04.333278145Z [2024-07-04 01:39:04,332: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:39:04.373069156Z [2024-07-04 01:39:04,372: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:39:04.374743769Z [2024-07-04 01:39:04,374: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:39:04.374902599Z [2024-07-04 01:39:04,374: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:39:04.375002475Z [2024-07-04 01:39:04,374: INFO/ForkPoolWorker-16] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:39:04.375195763Z [2024-07-04 01:39:04,375: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:39:04.375300517Z [2024-07-04 01:39:04,375: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:39:04.375750651Z [2024-07-04 01:39:04,375: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:39:04.375898319Z [2024-07-04 01:39:04,375: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:39:04.381842027Z [2024-07-04 01:39:04,381: INFO/ForkPoolWorker-16] Creating DAG vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:39:04.523960248Z [2024-07-04 01:39:04,523: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:39:04.531440898Z [2024-07-04 01:39:04,531: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:39:04.537875998Z [2024-07-04 01:39:04,537: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:39:04.618439880Z [2024-07-04 01:39:04,618: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:39:04.619619222Z [2024-07-04 01:39:04,619: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:39:04.619676154Z [2024-07-04 01:39:04,619: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:39:04.619812925Z [2024-07-04 01:39:04,619: INFO/ForkPoolWorker-1] Read VIM e50fc771-a667-46ce-8b9a-de864a77a9d4 (basic_08_vim_test) 2024-07-04T01:39:04.620248072Z [2024-07-04 01:39:04,619: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e50fc771-a667-46ce-8b9a-de864a77a9d4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-07-04T01:39:04.620310033Z [2024-07-04 01:39:04,620: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:39:04.620611128Z [2024-07-04 01:39:04,620: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:39:04.620748624Z [2024-07-04 01:39:04,620: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:39:04.627576454Z [2024-07-04 01:39:04,627: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4 2024-07-04T01:39:04.715232433Z [2024-07-04 01:39:04,714: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:39:05.452153083Z [2024-07-04 01:39:05,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8839edda-52e1-4e18-9646-cdc33f91aab0] succeeded in 4.408775359999936s: None 2024-07-04T01:39:06.226032092Z [2024-07-04 01:39:06,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[670a0784-2e72-4d11-9f1f-8a18751fabb4] succeeded in 5.179254076999996s: None 2024-07-04T01:39:06.432257651Z [2024-07-04 01:39:06,431: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bcafc2c2-264c-4096-a1ea-31d0e7d75196] succeeded in 5.3532531430000745s: None 2024-07-04T01:39:06.702828132Z [2024-07-04 01:39:06,702: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d39eab6c-9e9a-4050-9448-e10332e9edbd] succeeded in 5.63597850799988s: None 2024-07-04T01:40:00.691471884Z [2024-07-04 01:40:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81c21e0e-8fa6-4cef-8101-d41199b33adf] received 2024-07-04T01:40:00.696909102Z [2024-07-04 01:40:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eab25642-faaa-4253-9776-63ed40001148] received 2024-07-04T01:40:00.699617970Z [2024-07-04 01:40:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7efe4b2d-b26c-42b6-9c7a-edec26c09249] received 2024-07-04T01:40:00.701210030Z [2024-07-04 01:40:00,701: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3599ece-2398-4d86-b957-fea89ce78194] received 2024-07-04T01:40:00.721675383Z [2024-07-04 01:40:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a204d2a-854b-42a2-ab52-20c8d02c1895] received 2024-07-04T01:40:00.730928951Z [2024-07-04 01:40:00,730: INFO/ForkPoolWorker-16] [eab25642-faaa-4253-9776-63ed40001148] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:00.733640313Z [2024-07-04 01:40:00,733: INFO/ForkPoolWorker-2] [a3599ece-2398-4d86-b957-fea89ce78194] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:00.734658266Z [2024-07-04 01:40:00,734: INFO/ForkPoolWorker-1] [7efe4b2d-b26c-42b6-9c7a-edec26c09249] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:40:00.739385283Z [2024-07-04 01:40:00,738: INFO/ForkPoolWorker-15] [81c21e0e-8fa6-4cef-8101-d41199b33adf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:00.744818378Z [2024-07-04 01:40:00,744: INFO/ForkPoolWorker-3] [6a204d2a-854b-42a2-ab52-20c8d02c1895] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:00.749586753Z [2024-07-04 01:40:00,749: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[709986c5-86da-43cb-9b55-3a0be217bf77] received 2024-07-04T01:40:00.757768944Z [2024-07-04 01:40:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a691f86-fcff-47a9-8ddf-ae23b4568315] received 2024-07-04T01:40:00.810341119Z [2024-07-04 01:40:00,809: INFO/ForkPoolWorker-4] [709986c5-86da-43cb-9b55-3a0be217bf77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:01.025471408Z [2024-07-04 01:40:01,024: INFO/ForkPoolWorker-5] [2a691f86-fcff-47a9-8ddf-ae23b4568315] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:01.254126897Z [2024-07-04 01:40:01,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:01.255433671Z [2024-07-04 01:40:01,235: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:01.560305897Z [2024-07-04 01:40:01,555: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:01.946463390Z [2024-07-04 01:40:01,939: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:02.002665073Z [2024-07-04 01:40:01,992: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:02.170193721Z [2024-07-04 01:40:02,165: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:40:02.518105990Z [2024-07-04 01:40:02,517: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:02.546986588Z [2024-07-04 01:40:02,542: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:04.199733876Z [2024-07-04 01:40:04,181: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:40:04.220537374Z [2024-07-04 01:40:04,220: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7efe4b2d-b26c-42b6-9c7a-edec26c09249] succeeded in 3.5179757529999733s: None 2024-07-04T01:40:04.246865789Z [2024-07-04 01:40:04,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.370615336Z [2024-07-04 01:40:04,370: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:40:04.374779730Z [2024-07-04 01:40:04,374: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.374973853Z [2024-07-04 01:40:04,374: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.375201450Z [2024-07-04 01:40:04,374: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.375319675Z [2024-07-04 01:40:04,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:40:04.375617007Z [2024-07-04 01:40:04,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:04.375750550Z [2024-07-04 01:40:04,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.451403341Z [2024-07-04 01:40:04,450: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:40:04.455739607Z [2024-07-04 01:40:04,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.548445859Z [2024-07-04 01:40:04,548: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:40:04.551906721Z [2024-07-04 01:40:04,551: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.551926760Z [2024-07-04 01:40:04,551: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.552030628Z [2024-07-04 01:40:04,551: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.552058761Z [2024-07-04 01:40:04,552: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:40:04.552293372Z [2024-07-04 01:40:04,552: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:04.552323679Z [2024-07-04 01:40:04,552: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.560553230Z [2024-07-04 01:40:04,560: WARNING/ForkPoolWorker-16] Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:04.561233057Z [2024-07-04 01:40:04,560: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:04.565738699Z [2024-07-04 01:40:04,565: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:40:04.578571475Z [2024-07-04 01:40:04,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.587919791Z [2024-07-04 01:40:04,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:04.624384865Z [2024-07-04 01:40:04,623: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T01:40:04.633146017Z [2024-07-04 01:40:04,632: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.634254512Z [2024-07-04 01:40:04,634: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:40:04.638108297Z [2024-07-04 01:40:04,637: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.638189533Z [2024-07-04 01:40:04,638: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.638397297Z [2024-07-04 01:40:04,638: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.638445225Z [2024-07-04 01:40:04,638: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:40:04.639876475Z [2024-07-04 01:40:04,639: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:04.639893710Z [2024-07-04 01:40:04,639: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.645667641Z [2024-07-04 01:40:04,644: ERROR/ForkPoolWorker-16] [eab25642-faaa-4253-9776-63ed40001148] Failed to execute task Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:04.645683823Z Traceback (most recent call last): 2024-07-04T01:40:04.645688076Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:04.645692335Z args.func(args) 2024-07-04T01:40:04.645696527Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:04.645700664Z return func(*args, **kwargs) 2024-07-04T01:40:04.645703901Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:04.645733170Z return f(*args, **kwargs) 2024-07-04T01:40:04.645737168Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:04.645740804Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:04.645743907Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:04.645758050Z raise AirflowException( 2024-07-04T01:40:04.645761870Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:04.696290252Z [2024-07-04 01:40:04,696: INFO/ForkPoolWorker-4] Getting VIM list 2024-07-04T01:40:04.700734527Z [2024-07-04 01:40:04,699: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.700830263Z [2024-07-04 01:40:04,700: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:40:04.702202089Z [2024-07-04 01:40:04,701: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eab25642-faaa-4253-9776-63ed40001148] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eab25642-faaa-4253-9776-63ed40001148') 2024-07-04T01:40:04.702215190Z Traceback (most recent call last): 2024-07-04T01:40:04.702219254Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:04.702222553Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:04.702225706Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:04.702228841Z return self.run(*args, **kwargs) 2024-07-04T01:40:04.702232626Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:04.702236644Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:04.702240222Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:04.702243729Z raise AirflowException(msg) 2024-07-04T01:40:04.702247521Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eab25642-faaa-4253-9776-63ed40001148 2024-07-04T01:40:04.708298469Z [2024-07-04 01:40:04,707: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.728066133Z [2024-07-04 01:40:04,727: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T01:40:04.739001959Z [2024-07-04 01:40:04,734: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.739030169Z [2024-07-04 01:40:04,734: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.739034128Z [2024-07-04 01:40:04,735: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.739038122Z [2024-07-04 01:40:04,735: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T01:40:04.739041225Z [2024-07-04 01:40:04,735: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:40:04.739044489Z [2024-07-04 01:40:04,735: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.743067501Z [2024-07-04 01:40:04,742: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:04.756883723Z [2024-07-04 01:40:04,742: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:04.756906924Z [2024-07-04 01:40:04,755: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T01:40:04.766979575Z [2024-07-04 01:40:04,764: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.813812535Z [2024-07-04 01:40:04,813: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:40:04.816569366Z [2024-07-04 01:40:04,816: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.816583086Z [2024-07-04 01:40:04,816: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.816711019Z [2024-07-04 01:40:04,816: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.816737252Z [2024-07-04 01:40:04,816: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:40:04.817354244Z [2024-07-04 01:40:04,817: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:40:04.817422614Z [2024-07-04 01:40:04,817: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.840812413Z [2024-07-04 01:40:04,840: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-07-04T01:40:04.846778468Z [2024-07-04 01:40:04,846: INFO/ForkPoolWorker-4] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.851614332Z [2024-07-04 01:40:04,851: INFO/ForkPoolWorker-4] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.851805376Z [2024-07-04 01:40:04,851: INFO/ForkPoolWorker-4] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.851989663Z [2024-07-04 01:40:04,851: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-07-04T01:40:04.852745733Z [2024-07-04 01:40:04,852: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:40:04.852942576Z [2024-07-04 01:40:04,852: INFO/ForkPoolWorker-4] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.870316415Z [2024-07-04 01:40:04,870: WARNING/ForkPoolWorker-4] Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:04.874502315Z [2024-07-04 01:40:04,873: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:04.881266772Z [2024-07-04 01:40:04,880: INFO/ForkPoolWorker-4] Getting VIM list 2024-07-04T01:40:04.888050618Z [2024-07-04 01:40:04,887: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T01:40:04.889918241Z [2024-07-04 01:40:04,889: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.891582524Z [2024-07-04 01:40:04,891: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.891822250Z [2024-07-04 01:40:04,891: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.891967237Z [2024-07-04 01:40:04,891: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T01:40:04.892316578Z [2024-07-04 01:40:04,892: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:40:04.892944067Z [2024-07-04 01:40:04,892: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.901459779Z [2024-07-04 01:40:04,900: ERROR/ForkPoolWorker-3] [6a204d2a-854b-42a2-ab52-20c8d02c1895] Failed to execute task Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:04.901481048Z Traceback (most recent call last): 2024-07-04T01:40:04.901485365Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:04.901489133Z args.func(args) 2024-07-04T01:40:04.901492735Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:04.901496359Z return func(*args, **kwargs) 2024-07-04T01:40:04.901499466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:04.901502510Z return f(*args, **kwargs) 2024-07-04T01:40:04.901505704Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:04.901508882Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:04.901514820Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:04.901518273Z raise AirflowException( 2024-07-04T01:40:04.901522272Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:04.919152558Z [2024-07-04 01:40:04,918: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:04.932565740Z [2024-07-04 01:40:04,932: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:04.957326566Z [2024-07-04 01:40:04,956: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6a204d2a-854b-42a2-ab52-20c8d02c1895] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6a204d2a-854b-42a2-ab52-20c8d02c1895') 2024-07-04T01:40:04.957336263Z Traceback (most recent call last): 2024-07-04T01:40:04.957340105Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:04.957343479Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:04.957347240Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:04.957350524Z return self.run(*args, **kwargs) 2024-07-04T01:40:04.957354523Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:04.957370955Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:04.957374200Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:04.957377823Z raise AirflowException(msg) 2024-07-04T01:40:04.957381643Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6a204d2a-854b-42a2-ab52-20c8d02c1895 2024-07-04T01:40:04.965302854Z [2024-07-04 01:40:04,965: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-07-04T01:40:04.967926515Z [2024-07-04 01:40:04,967: INFO/ForkPoolWorker-4] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:04.968135877Z [2024-07-04 01:40:04,967: INFO/ForkPoolWorker-4] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:04.968577617Z [2024-07-04 01:40:04,968: INFO/ForkPoolWorker-4] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:04.968778685Z [2024-07-04 01:40:04,968: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-07-04T01:40:04.969063889Z [2024-07-04 01:40:04,968: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:40:04.969712188Z [2024-07-04 01:40:04,969: INFO/ForkPoolWorker-4] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:04.980075681Z [2024-07-04 01:40:04,974: ERROR/ForkPoolWorker-4] [709986c5-86da-43cb-9b55-3a0be217bf77] Failed to execute task Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:04.980099772Z Traceback (most recent call last): 2024-07-04T01:40:04.980103557Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:04.980106851Z args.func(args) 2024-07-04T01:40:04.980110641Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:04.980118550Z return func(*args, **kwargs) 2024-07-04T01:40:04.980121466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:04.980124227Z return f(*args, **kwargs) 2024-07-04T01:40:04.980127040Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:04.980130010Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:04.980132844Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:04.980135736Z raise AirflowException( 2024-07-04T01:40:04.980139290Z airflow.exceptions.AirflowException: Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:05.032630230Z [2024-07-04 01:40:05,032: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[709986c5-86da-43cb-9b55-3a0be217bf77] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 709986c5-86da-43cb-9b55-3a0be217bf77') 2024-07-04T01:40:05.032653142Z Traceback (most recent call last): 2024-07-04T01:40:05.032657025Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:05.032660200Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:05.032663232Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:05.032678377Z return self.run(*args, **kwargs) 2024-07-04T01:40:05.032681890Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:05.032685677Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:05.032688691Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:05.032692166Z raise AirflowException(msg) 2024-07-04T01:40:05.032695953Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 709986c5-86da-43cb-9b55-3a0be217bf77 2024-07-04T01:40:05.335443755Z [2024-07-04 01:40:05,335: INFO/ForkPoolWorker-5] Getting VIM list 2024-07-04T01:40:05.338620687Z [2024-07-04 01:40:05,338: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:05.378814438Z [2024-07-04 01:40:05,378: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-07-04T01:40:05.380763991Z [2024-07-04 01:40:05,380: INFO/ForkPoolWorker-5] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:05.380902581Z [2024-07-04 01:40:05,380: INFO/ForkPoolWorker-5] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:05.381119491Z [2024-07-04 01:40:05,380: INFO/ForkPoolWorker-5] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:05.381257204Z [2024-07-04 01:40:05,381: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-07-04T01:40:05.382109749Z [2024-07-04 01:40:05,381: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:40:05.382199651Z [2024-07-04 01:40:05,382: INFO/ForkPoolWorker-5] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:05.386789437Z [2024-07-04 01:40:05,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81c21e0e-8fa6-4cef-8101-d41199b33adf] succeeded in 4.691213555000104s: None 2024-07-04T01:40:05.500629384Z [2024-07-04 01:40:05,500: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:06.058847979Z [2024-07-04 01:40:06,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38ef7b7a-7dca-46c0-ac62-3bf7feb400ca] received 2024-07-04T01:40:06.076092895Z [2024-07-04 01:40:06,075: INFO/ForkPoolWorker-15] [38ef7b7a-7dca-46c0-ac62-3bf7feb400ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:06.402340941Z [2024-07-04 01:40:06,399: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:06.803832445Z [2024-07-04 01:40:06,803: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a3599ece-2398-4d86-b957-fea89ce78194] succeeded in 6.098571168000035s: None 2024-07-04T01:40:07.014135262Z [2024-07-04 01:40:07,013: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[2a691f86-fcff-47a9-8ddf-ae23b4568315] succeeded in 6.253685780000069s: None 2024-07-04T01:40:07.563767267Z [2024-07-04 01:40:07,563: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:40:07.567067283Z [2024-07-04 01:40:07,566: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:07.595444806Z [2024-07-04 01:40:07,595: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:40:07.596996237Z [2024-07-04 01:40:07,596: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:07.597139332Z [2024-07-04 01:40:07,596: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:07.597336050Z [2024-07-04 01:40:07,597: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:07.597458879Z [2024-07-04 01:40:07,597: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:40:07.598614066Z [2024-07-04 01:40:07,598: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:07.598731930Z [2024-07-04 01:40:07,598: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:07.701555610Z [2024-07-04 01:40:07,701: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:08.400181695Z [2024-07-04 01:40:08,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d173338e-9c3c-4559-a9e8-1e4fea0da4c8] received 2024-07-04T01:40:08.411951532Z [2024-07-04 01:40:08,411: INFO/ForkPoolWorker-16] [d173338e-9c3c-4559-a9e8-1e4fea0da4c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:40:08.478157225Z [2024-07-04 01:40:08,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38ef7b7a-7dca-46c0-ac62-3bf7feb400ca] succeeded in 2.416152893999879s: None 2024-07-04T01:40:08.736182470Z [2024-07-04 01:40:08,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:09.874900886Z [2024-07-04 01:40:09,874: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:40:09.878137138Z [2024-07-04 01:40:09,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:09.919813987Z [2024-07-04 01:40:09,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:40:09.920996411Z [2024-07-04 01:40:09,920: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:09.921142376Z [2024-07-04 01:40:09,921: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:09.921321926Z [2024-07-04 01:40:09,921: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:09.921433166Z [2024-07-04 01:40:09,921: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:40:09.921746394Z [2024-07-04 01:40:09,921: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:09.921861089Z [2024-07-04 01:40:09,921: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:10.019722379Z [2024-07-04 01:40:10,019: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:10.653165908Z [2024-07-04 01:40:10,651: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d173338e-9c3c-4559-a9e8-1e4fea0da4c8] succeeded in 2.2488483090000955s: None 2024-07-04T01:40:10.998846841Z [2024-07-04 01:40:10,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78a8595b-a5a5-4538-b0fa-7e1a6bbcaae7] received 2024-07-04T01:40:11.015838555Z [2024-07-04 01:40:11,015: INFO/ForkPoolWorker-15] [78a8595b-a5a5-4538-b0fa-7e1a6bbcaae7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:11.313101131Z [2024-07-04 01:40:11,309: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:12.627395839Z [2024-07-04 01:40:12,626: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:40:12.630770347Z [2024-07-04 01:40:12,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:12.671120423Z [2024-07-04 01:40:12,670: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:40:12.673465603Z [2024-07-04 01:40:12,673: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:12.673502239Z [2024-07-04 01:40:12,673: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:12.673718926Z [2024-07-04 01:40:12,673: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:12.673785281Z [2024-07-04 01:40:12,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:40:12.674074901Z [2024-07-04 01:40:12,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:12.674144972Z [2024-07-04 01:40:12,674: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:12.790836946Z [2024-07-04 01:40:12,790: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:40:13.517958562Z [2024-07-04 01:40:13,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78a8595b-a5a5-4538-b0fa-7e1a6bbcaae7] succeeded in 2.5089273670000694s: None 2024-07-04T01:40:15.945029235Z [2024-07-04 01:40:15,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1361a37-8332-4c38-ba34-824f0f2e9c1d] received 2024-07-04T01:40:15.963383678Z [2024-07-04 01:40:15,962: INFO/ForkPoolWorker-15] [e1361a37-8332-4c38-ba34-824f0f2e9c1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:40:16.350302929Z [2024-07-04 01:40:16,347: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:17.303723369Z [2024-07-04 01:40:17,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5800e8ec-eb8f-4be2-a701-da8e457cfddf] received 2024-07-04T01:40:17.305669006Z [2024-07-04 01:40:17,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[247de432-e68b-44e0-a3a4-b07774c70fc1] received 2024-07-04T01:40:17.321015925Z [2024-07-04 01:40:17,320: INFO/ForkPoolWorker-16] [5800e8ec-eb8f-4be2-a701-da8e457cfddf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:40:17.335822363Z [2024-07-04 01:40:17,335: INFO/ForkPoolWorker-1] [247de432-e68b-44e0-a3a4-b07774c70fc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:40:17.527625515Z [2024-07-04 01:40:17,527: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:40:17.534283869Z [2024-07-04 01:40:17,533: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:17.580850197Z [2024-07-04 01:40:17,580: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:40:17.582793455Z [2024-07-04 01:40:17,582: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:17.582815971Z [2024-07-04 01:40:17,582: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:17.583055996Z [2024-07-04 01:40:17,582: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:17.583710102Z [2024-07-04 01:40:17,582: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:40:17.584096380Z [2024-07-04 01:40:17,583: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:17.584216284Z [2024-07-04 01:40:17,584: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:17.593929479Z [2024-07-04 01:40:17,593: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:17.596144469Z [2024-07-04 01:40:17,594: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:40:17.597336107Z [2024-07-04 01:40:17,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:40:17.599976604Z [2024-07-04 01:40:17,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:17.635467127Z [2024-07-04 01:40:17,635: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:40:17.639790938Z [2024-07-04 01:40:17,639: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:17.640467872Z [2024-07-04 01:40:17,639: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:17.640718885Z [2024-07-04 01:40:17,640: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:17.640824408Z [2024-07-04 01:40:17,640: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:40:17.643457378Z [2024-07-04 01:40:17,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:40:17.643668674Z [2024-07-04 01:40:17,643: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:17.650015195Z [2024-07-04 01:40:17,648: ERROR/ForkPoolWorker-15] [e1361a37-8332-4c38-ba34-824f0f2e9c1d] Failed to execute task Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:17.650028945Z Traceback (most recent call last): 2024-07-04T01:40:17.650033275Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:17.650037506Z args.func(args) 2024-07-04T01:40:17.650041898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:17.650045468Z return func(*args, **kwargs) 2024-07-04T01:40:17.650048708Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:17.650052209Z return f(*args, **kwargs) 2024-07-04T01:40:17.650055330Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:17.650058476Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:17.650061617Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:17.650064707Z raise AirflowException( 2024-07-04T01:40:17.650068740Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:17.689016774Z [2024-07-04 01:40:17,685: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:17.694320662Z [2024-07-04 01:40:17,693: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1361a37-8332-4c38-ba34-824f0f2e9c1d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e1361a37-8332-4c38-ba34-824f0f2e9c1d') 2024-07-04T01:40:17.694343935Z Traceback (most recent call last): 2024-07-04T01:40:17.694358320Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:17.694362020Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:17.694365176Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:17.694368369Z return self.run(*args, **kwargs) 2024-07-04T01:40:17.694372100Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:17.694391141Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:17.694394461Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:17.694401758Z raise AirflowException(msg) 2024-07-04T01:40:17.694405930Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e1361a37-8332-4c38-ba34-824f0f2e9c1d 2024-07-04T01:40:17.701746520Z [2024-07-04 01:40:17,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:18.880122761Z [2024-07-04 01:40:18,879: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:40:18.887534341Z [2024-07-04 01:40:18,887: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:18.970218312Z [2024-07-04 01:40:18,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:40:18.971556360Z [2024-07-04 01:40:18,971: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:18.971692674Z [2024-07-04 01:40:18,971: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:18.971891493Z [2024-07-04 01:40:18,971: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:18.971987667Z [2024-07-04 01:40:18,971: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:40:18.972440804Z [2024-07-04 01:40:18,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:40:18.973245256Z [2024-07-04 01:40:18,973: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:18.988236789Z [2024-07-04 01:40:18,987: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:18.989284182Z [2024-07-04 01:40:18,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:40:18.990276501Z [2024-07-04 01:40:18,990: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:40:18.993612450Z [2024-07-04 01:40:18,993: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:19.016544141Z [2024-07-04 01:40:19,016: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:40:19.018585252Z [2024-07-04 01:40:19,018: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:19.018819399Z [2024-07-04 01:40:19,018: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:19.021926643Z [2024-07-04 01:40:19,018: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:19.024663586Z [2024-07-04 01:40:19,024: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:40:19.025212811Z [2024-07-04 01:40:19,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:40:19.025533861Z [2024-07-04 01:40:19,025: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:19.030498498Z [2024-07-04 01:40:19,029: ERROR/ForkPoolWorker-16] [5800e8ec-eb8f-4be2-a701-da8e457cfddf] Failed to execute task Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:19.030519128Z Traceback (most recent call last): 2024-07-04T01:40:19.030523076Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:19.030527323Z args.func(args) 2024-07-04T01:40:19.030530942Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:19.030546403Z return func(*args, **kwargs) 2024-07-04T01:40:19.030550274Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:19.030553792Z return f(*args, **kwargs) 2024-07-04T01:40:19.030556898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:19.030560244Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:19.030563336Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:19.030566469Z raise AirflowException( 2024-07-04T01:40:19.030570543Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:19.097287812Z [2024-07-04 01:40:19,096: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5800e8ec-eb8f-4be2-a701-da8e457cfddf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5800e8ec-eb8f-4be2-a701-da8e457cfddf') 2024-07-04T01:40:19.097314255Z Traceback (most recent call last): 2024-07-04T01:40:19.097318640Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:19.097322476Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:19.097325674Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:19.097328773Z return self.run(*args, **kwargs) 2024-07-04T01:40:19.097333009Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:19.097337080Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:19.097348993Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:19.097353148Z raise AirflowException(msg) 2024-07-04T01:40:19.097362999Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5800e8ec-eb8f-4be2-a701-da8e457cfddf 2024-07-04T01:40:19.253924818Z [2024-07-04 01:40:19,253: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:40:19.267528696Z [2024-07-04 01:40:19,266: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:19.312942747Z [2024-07-04 01:40:19,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:40:19.314760954Z [2024-07-04 01:40:19,314: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:19.314961777Z [2024-07-04 01:40:19,314: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:19.315151993Z [2024-07-04 01:40:19,314: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:19.315254485Z [2024-07-04 01:40:19,315: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:40:19.315567149Z [2024-07-04 01:40:19,315: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:40:19.315630497Z [2024-07-04 01:40:19,315: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:19.327283476Z [2024-07-04 01:40:19,326: WARNING/ForkPoolWorker-1] Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:19.328505760Z [2024-07-04 01:40:19,327: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:40:19.330395039Z [2024-07-04 01:40:19,330: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:40:19.333226509Z [2024-07-04 01:40:19,332: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:40:19.402099586Z [2024-07-04 01:40:19,401: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:40:19.404061627Z [2024-07-04 01:40:19,403: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:40:19.404120592Z [2024-07-04 01:40:19,404: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:40:19.404262210Z [2024-07-04 01:40:19,404: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:40:19.404300724Z [2024-07-04 01:40:19,404: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:40:19.404548660Z [2024-07-04 01:40:19,404: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:40:19.404580215Z [2024-07-04 01:40:19,404: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:40:19.413307437Z [2024-07-04 01:40:19,410: ERROR/ForkPoolWorker-1] [247de432-e68b-44e0-a3a4-b07774c70fc1] Failed to execute task Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:40:19.413334000Z Traceback (most recent call last): 2024-07-04T01:40:19.413338184Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:40:19.413341593Z args.func(args) 2024-07-04T01:40:19.413345411Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:40:19.413349606Z return func(*args, **kwargs) 2024-07-04T01:40:19.413352594Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:40:19.413371624Z return f(*args, **kwargs) 2024-07-04T01:40:19.413377273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:40:19.413382015Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:40:19.413387356Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:40:19.413395957Z raise AirflowException( 2024-07-04T01:40:19.413401526Z airflow.exceptions.AirflowException: Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:40:19.475142953Z [2024-07-04 01:40:19,474: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[247de432-e68b-44e0-a3a4-b07774c70fc1] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 247de432-e68b-44e0-a3a4-b07774c70fc1') 2024-07-04T01:40:19.475167883Z Traceback (most recent call last): 2024-07-04T01:40:19.475172146Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:40:19.475175336Z R = retval = fun(*args, **kwargs) 2024-07-04T01:40:19.475178321Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:40:19.475181444Z return self.run(*args, **kwargs) 2024-07-04T01:40:19.475184918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:40:19.475188561Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:40:19.475191905Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:40:19.475195761Z raise AirflowException(msg) 2024-07-04T01:40:19.475199497Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 247de432-e68b-44e0-a3a4-b07774c70fc1 2024-07-04T01:41:00.733388006Z [2024-07-04 01:41:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f2284c-12dd-4ee2-b58e-619715b13d3b] received 2024-07-04T01:41:00.737893008Z [2024-07-04 01:41:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64b967c9-8415-4b21-9f4a-7f4003bf81b1] received 2024-07-04T01:41:00.745844783Z [2024-07-04 01:41:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4add98f0-173d-4440-b046-68d568594cd8] received 2024-07-04T01:41:00.748449262Z [2024-07-04 01:41:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b92884-8216-4701-b38a-25e89b22a3ef] received 2024-07-04T01:41:00.761925637Z [2024-07-04 01:41:00,761: INFO/ForkPoolWorker-15] [e0f2284c-12dd-4ee2-b58e-619715b13d3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:00.774580285Z [2024-07-04 01:41:00,774: INFO/ForkPoolWorker-16] [64b967c9-8415-4b21-9f4a-7f4003bf81b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:00.781715416Z [2024-07-04 01:41:00,781: INFO/ForkPoolWorker-1] [4add98f0-173d-4440-b046-68d568594cd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:00.784374452Z [2024-07-04 01:41:00,783: INFO/ForkPoolWorker-2] [d1b92884-8216-4701-b38a-25e89b22a3ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:01.227094238Z [2024-07-04 01:41:01,220: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:01.262541289Z [2024-07-04 01:41:01,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:01.457645667Z [2024-07-04 01:41:01,452: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:01.463133538Z [2024-07-04 01:41:01,458: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:02.531527683Z [2024-07-04 01:41:02,531: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:41:02.535074811Z [2024-07-04 01:41:02,534: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.584347123Z [2024-07-04 01:41:02,583: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:41:02.588129372Z [2024-07-04 01:41:02,587: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.588268228Z [2024-07-04 01:41:02,588: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.588505975Z [2024-07-04 01:41:02,588: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.588647206Z [2024-07-04 01:41:02,588: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:41:02.589044467Z [2024-07-04 01:41:02,588: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:41:02.589184379Z [2024-07-04 01:41:02,589: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.735392965Z [2024-07-04 01:41:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:41:02.752526416Z [2024-07-04 01:41:02,752: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:41:02.757031003Z [2024-07-04 01:41:02,756: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.794556582Z [2024-07-04 01:41:02,794: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:41:02.800615479Z [2024-07-04 01:41:02,800: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:41:02.801181875Z [2024-07-04 01:41:02,799: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.802513866Z [2024-07-04 01:41:02,802: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.802615805Z [2024-07-04 01:41:02,802: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.802797671Z [2024-07-04 01:41:02,802: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.802943487Z [2024-07-04 01:41:02,802: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:41:02.803258881Z [2024-07-04 01:41:02,803: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:41:02.803268552Z [2024-07-04 01:41:02,803: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.809862789Z [2024-07-04 01:41:02,809: WARNING/ForkPoolWorker-2] Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:02.810929862Z [2024-07-04 01:41:02,810: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:02.811904839Z [2024-07-04 01:41:02,811: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T01:41:02.814537796Z [2024-07-04 01:41:02,814: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.822991674Z [2024-07-04 01:41:02,822: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:41:02.826638384Z [2024-07-04 01:41:02,825: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.848158748Z [2024-07-04 01:41:02,847: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T01:41:02.849263978Z [2024-07-04 01:41:02,849: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.849923467Z [2024-07-04 01:41:02,849: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.850152134Z [2024-07-04 01:41:02,849: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.850266525Z [2024-07-04 01:41:02,850: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T01:41:02.850550916Z [2024-07-04 01:41:02,850: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:41:02.850735282Z [2024-07-04 01:41:02,850: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.855913629Z [2024-07-04 01:41:02,854: ERROR/ForkPoolWorker-2] [d1b92884-8216-4701-b38a-25e89b22a3ef] Failed to execute task Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:41:02.855937528Z Traceback (most recent call last): 2024-07-04T01:41:02.855941974Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:41:02.855945793Z args.func(args) 2024-07-04T01:41:02.855949465Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:41:02.855953121Z return func(*args, **kwargs) 2024-07-04T01:41:02.855956221Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:41:02.855981002Z return f(*args, **kwargs) 2024-07-04T01:41:02.855984335Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:41:02.855987462Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:41:02.855990633Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:41:02.855993634Z raise AirflowException( 2024-07-04T01:41:02.855997370Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:41:02.858319832Z [2024-07-04 01:41:02,858: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:41:02.859679756Z [2024-07-04 01:41:02,859: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.859973211Z [2024-07-04 01:41:02,859: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.860165559Z [2024-07-04 01:41:02,859: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.860373204Z [2024-07-04 01:41:02,860: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:41:02.860734286Z [2024-07-04 01:41:02,860: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:41:02.860840415Z [2024-07-04 01:41:02,860: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.869459428Z [2024-07-04 01:41:02,869: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:41:02.870577752Z [2024-07-04 01:41:02,870: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.870607392Z [2024-07-04 01:41:02,870: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.870722443Z [2024-07-04 01:41:02,870: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.870766144Z [2024-07-04 01:41:02,870: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:41:02.871148256Z [2024-07-04 01:41:02,870: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:41:02.871231512Z [2024-07-04 01:41:02,871: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.877467949Z [2024-07-04 01:41:02,877: WARNING/ForkPoolWorker-15] Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:02.878364590Z [2024-07-04 01:41:02,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:02.885679084Z [2024-07-04 01:41:02,885: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:41:02.893240077Z [2024-07-04 01:41:02,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:02.899444636Z [2024-07-04 01:41:02,898: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d1b92884-8216-4701-b38a-25e89b22a3ef] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b92884-8216-4701-b38a-25e89b22a3ef') 2024-07-04T01:41:02.899458394Z Traceback (most recent call last): 2024-07-04T01:41:02.899462253Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:41:02.899465552Z R = retval = fun(*args, **kwargs) 2024-07-04T01:41:02.899468778Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:41:02.899471902Z return self.run(*args, **kwargs) 2024-07-04T01:41:02.899475463Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:41:02.899479000Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:41:02.899482389Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:41:02.899486240Z raise AirflowException(msg) 2024-07-04T01:41:02.899489931Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id d1b92884-8216-4701-b38a-25e89b22a3ef 2024-07-04T01:41:02.913221277Z [2024-07-04 01:41:02,913: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:41:02.915158036Z [2024-07-04 01:41:02,914: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:02.915203155Z [2024-07-04 01:41:02,915: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:02.915290450Z [2024-07-04 01:41:02,915: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:02.915331090Z [2024-07-04 01:41:02,915: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:41:02.915539551Z [2024-07-04 01:41:02,915: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:41:02.915584910Z [2024-07-04 01:41:02,915: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:02.921982714Z [2024-07-04 01:41:02,921: ERROR/ForkPoolWorker-15] [e0f2284c-12dd-4ee2-b58e-619715b13d3b] Failed to execute task Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:41:02.921999599Z Traceback (most recent call last): 2024-07-04T01:41:02.922004308Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:41:02.922007960Z args.func(args) 2024-07-04T01:41:02.922011450Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:41:02.922015047Z return func(*args, **kwargs) 2024-07-04T01:41:02.922018280Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:41:02.922032979Z return f(*args, **kwargs) 2024-07-04T01:41:02.922036018Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:41:02.922039212Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:41:02.922042272Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:41:02.922045226Z raise AirflowException( 2024-07-04T01:41:02.922048942Z airflow.exceptions.AirflowException: Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:41:02.952804554Z [2024-07-04 01:41:02,952: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0f2284c-12dd-4ee2-b58e-619715b13d3b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e0f2284c-12dd-4ee2-b58e-619715b13d3b') 2024-07-04T01:41:02.952829487Z Traceback (most recent call last): 2024-07-04T01:41:02.952833649Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:41:02.952836769Z R = retval = fun(*args, **kwargs) 2024-07-04T01:41:02.952839865Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:41:02.952842982Z return self.run(*args, **kwargs) 2024-07-04T01:41:02.952846442Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:41:02.952850299Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:41:02.952853443Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:41:02.952857025Z raise AirflowException(msg) 2024-07-04T01:41:02.952860761Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e0f2284c-12dd-4ee2-b58e-619715b13d3b 2024-07-04T01:41:02.966170042Z [2024-07-04 01:41:02,965: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:41:04.665990360Z [2024-07-04 01:41:04,665: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[64b967c9-8415-4b21-9f4a-7f4003bf81b1] succeeded in 3.925162187000069s: None 2024-07-04T01:41:05.094773824Z [2024-07-04 01:41:05,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4add98f0-173d-4440-b046-68d568594cd8] succeeded in 4.3459876300000815s: None 2024-07-04T01:41:14.547419958Z [2024-07-04 01:41:14,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaa66fe4-d14b-4baf-8233-5c8ad8815df2] received 2024-07-04T01:41:14.555797012Z [2024-07-04 01:41:14,555: INFO/ForkPoolWorker-15] [eaa66fe4-d14b-4baf-8233-5c8ad8815df2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:41:14.559201184Z [2024-07-04 01:41:14,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ac0238b-3dbd-4d73-9aaf-73687b4601d6] received 2024-07-04T01:41:14.566281595Z [2024-07-04 01:41:14,566: INFO/ForkPoolWorker-16] [4ac0238b-3dbd-4d73-9aaf-73687b4601d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:41:14.884221037Z [2024-07-04 01:41:14,880: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:14.910279994Z [2024-07-04 01:41:14,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:16.025884412Z [2024-07-04 01:41:16,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:41:16.031386456Z [2024-07-04 01:41:16,030: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:16.072321087Z [2024-07-04 01:41:16,071: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:41:16.077527495Z [2024-07-04 01:41:16,077: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:16.079516138Z [2024-07-04 01:41:16,079: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:16.079685126Z [2024-07-04 01:41:16,079: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:16.079868414Z [2024-07-04 01:41:16,079: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:41:16.080372555Z [2024-07-04 01:41:16,080: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:41:16.080544998Z [2024-07-04 01:41:16,080: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:16.091067209Z [2024-07-04 01:41:16,090: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:16.092052646Z [2024-07-04 01:41:16,091: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:41:16.093136181Z [2024-07-04 01:41:16,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:41:16.098224251Z [2024-07-04 01:41:16,097: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:16.124635464Z [2024-07-04 01:41:16,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:41:16.127795346Z [2024-07-04 01:41:16,127: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:16.128041324Z [2024-07-04 01:41:16,127: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:16.129477629Z [2024-07-04 01:41:16,129: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:16.130387696Z [2024-07-04 01:41:16,129: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:41:16.130400893Z [2024-07-04 01:41:16,130: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:41:16.130728881Z [2024-07-04 01:41:16,130: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:16.136934729Z [2024-07-04 01:41:16,135: ERROR/ForkPoolWorker-15] [eaa66fe4-d14b-4baf-8233-5c8ad8815df2] Failed to execute task Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:41:16.136950792Z Traceback (most recent call last): 2024-07-04T01:41:16.136955604Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:41:16.136960492Z args.func(args) 2024-07-04T01:41:16.136965110Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:41:16.136969297Z return func(*args, **kwargs) 2024-07-04T01:41:16.136973103Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:41:16.136976955Z return f(*args, **kwargs) 2024-07-04T01:41:16.136983539Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:41:16.136987322Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:41:16.136991029Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:41:16.136994834Z raise AirflowException( 2024-07-04T01:41:16.136999438Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:41:16.139654092Z [2024-07-04 01:41:16,138: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:41:16.143935456Z [2024-07-04 01:41:16,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:16.191228561Z [2024-07-04 01:41:16,190: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eaa66fe4-d14b-4baf-8233-5c8ad8815df2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaa66fe4-d14b-4baf-8233-5c8ad8815df2') 2024-07-04T01:41:16.191255296Z Traceback (most recent call last): 2024-07-04T01:41:16.191259685Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:41:16.191263026Z R = retval = fun(*args, **kwargs) 2024-07-04T01:41:16.191266252Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:41:16.191269572Z return self.run(*args, **kwargs) 2024-07-04T01:41:16.191273731Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:41:16.191277525Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:41:16.191280903Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:41:16.191285070Z raise AirflowException(msg) 2024-07-04T01:41:16.191289641Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id eaa66fe4-d14b-4baf-8233-5c8ad8815df2 2024-07-04T01:41:16.194530878Z [2024-07-04 01:41:16,194: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:41:16.196991283Z [2024-07-04 01:41:16,196: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:16.197368966Z [2024-07-04 01:41:16,197: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:16.197630025Z [2024-07-04 01:41:16,197: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:16.197812341Z [2024-07-04 01:41:16,197: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:41:16.199371883Z [2024-07-04 01:41:16,199: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:41:16.199398081Z [2024-07-04 01:41:16,199: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:16.215142844Z [2024-07-04 01:41:16,214: WARNING/ForkPoolWorker-16] Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:16.216503549Z [2024-07-04 01:41:16,215: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:41:16.217872767Z [2024-07-04 01:41:16,217: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:41:16.221763757Z [2024-07-04 01:41:16,221: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:41:16.248643824Z [2024-07-04 01:41:16,248: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:41:16.252872952Z [2024-07-04 01:41:16,252: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:41:16.253228586Z [2024-07-04 01:41:16,252: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:41:16.254050789Z [2024-07-04 01:41:16,253: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:41:16.254372350Z [2024-07-04 01:41:16,254: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:41:16.256355054Z [2024-07-04 01:41:16,255: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:41:16.256406451Z [2024-07-04 01:41:16,255: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:41:16.264632559Z [2024-07-04 01:41:16,263: ERROR/ForkPoolWorker-16] [4ac0238b-3dbd-4d73-9aaf-73687b4601d6] Failed to execute task Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse.. 2024-07-04T01:41:16.264666179Z Traceback (most recent call last): 2024-07-04T01:41:16.264673620Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T01:41:16.264679829Z args.func(args) 2024-07-04T01:41:16.264685770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T01:41:16.264692517Z return func(*args, **kwargs) 2024-07-04T01:41:16.264698165Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T01:41:16.264703638Z return f(*args, **kwargs) 2024-07-04T01:41:16.264729640Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T01:41:16.264735301Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T01:41:16.264740910Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T01:41:16.264746406Z raise AirflowException( 2024-07-04T01:41:16.264752689Z airflow.exceptions.AirflowException: Dag 'vim_status_e50fc771-a667-46ce-8b9a-de864a77a9d4' could not be found; either it does not exist or it failed to parse. 2024-07-04T01:41:16.299243663Z [2024-07-04 01:41:16,298: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ac0238b-3dbd-4d73-9aaf-73687b4601d6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4ac0238b-3dbd-4d73-9aaf-73687b4601d6') 2024-07-04T01:41:16.299259815Z Traceback (most recent call last): 2024-07-04T01:41:16.299263742Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T01:41:16.299266858Z R = retval = fun(*args, **kwargs) 2024-07-04T01:41:16.299270350Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T01:41:16.299273751Z return self.run(*args, **kwargs) 2024-07-04T01:41:16.299277229Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T01:41:16.299281416Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T01:41:16.299284384Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T01:41:16.299287989Z raise AirflowException(msg) 2024-07-04T01:41:16.299292026Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4ac0238b-3dbd-4d73-9aaf-73687b4601d6 2024-07-04T01:42:00.761593799Z [2024-07-04 01:42:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[761c630f-96a3-45ea-ab92-fdaf3780465e] received 2024-07-04T01:42:00.776949072Z [2024-07-04 01:42:00,776: INFO/ForkPoolWorker-15] [761c630f-96a3-45ea-ab92-fdaf3780465e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:42:00.810139024Z [2024-07-04 01:42:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29bb08aa-e67c-4210-9c66-62fdae75f80e] received 2024-07-04T01:42:00.817547211Z [2024-07-04 01:42:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[256a0632-0ad1-4e53-86ad-0e8aa8cabe1f] received 2024-07-04T01:42:00.836444467Z [2024-07-04 01:42:00,836: INFO/ForkPoolWorker-1] [256a0632-0ad1-4e53-86ad-0e8aa8cabe1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:42:00.865150240Z [2024-07-04 01:42:00,864: INFO/ForkPoolWorker-16] [29bb08aa-e67c-4210-9c66-62fdae75f80e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:42:01.236102750Z [2024-07-04 01:42:01,217: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:42:01.327975772Z [2024-07-04 01:42:01,323: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:42:01.353799692Z [2024-07-04 01:42:01,349: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:42:01.855607886Z [2024-07-04 01:42:01,854: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:42:02.467164362Z [2024-07-04 01:42:02,466: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[29bb08aa-e67c-4210-9c66-62fdae75f80e] succeeded in 1.653080861000035s: None 2024-07-04T01:42:02.795033343Z [2024-07-04 01:42:02,794: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:42:02.798332190Z [2024-07-04 01:42:02,797: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:42:02.829073895Z [2024-07-04 01:42:02,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:42:02.830402763Z [2024-07-04 01:42:02,830: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:42:02.830447909Z [2024-07-04 01:42:02,830: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:42:02.830594500Z [2024-07-04 01:42:02,830: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:42:02.830689967Z [2024-07-04 01:42:02,830: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:42:02.832004767Z [2024-07-04 01:42:02,831: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:42:02.832050934Z [2024-07-04 01:42:02,831: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:42:02.848578326Z [2024-07-04 01:42:02,848: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:42:02.851835426Z [2024-07-04 01:42:02,851: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:42:02.887071859Z [2024-07-04 01:42:02,886: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:42:02.890016601Z [2024-07-04 01:42:02,889: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:42:02.890325559Z [2024-07-04 01:42:02,890: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:42:02.890418369Z [2024-07-04 01:42:02,890: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:42:02.890539993Z [2024-07-04 01:42:02,890: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:42:02.891348235Z [2024-07-04 01:42:02,891: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:42:02.891576589Z [2024-07-04 01:42:02,891: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:42:02.918599244Z [2024-07-04 01:42:02,918: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:42:02.971843569Z [2024-07-04 01:42:02,971: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:42:05.036284844Z [2024-07-04 01:42:05,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[256a0632-0ad1-4e53-86ad-0e8aa8cabe1f] succeeded in 4.215382860000091s: None 2024-07-04T01:42:05.357119610Z [2024-07-04 01:42:05,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[761c630f-96a3-45ea-ab92-fdaf3780465e] succeeded in 4.592233986999872s: None 2024-07-04T01:43:01.237334670Z [2024-07-04 01:43:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07c046be-8547-48b4-b689-9fbbc53a4474] received 2024-07-04T01:43:01.264463827Z [2024-07-04 01:43:01,263: INFO/ForkPoolWorker-15] [07c046be-8547-48b4-b689-9fbbc53a4474] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:43:01.279696163Z [2024-07-04 01:43:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24c678a4-8a09-4604-ba36-bf85435aa0a1] received 2024-07-04T01:43:01.320231882Z [2024-07-04 01:43:01,319: INFO/ForkPoolWorker-16] [24c678a4-8a09-4604-ba36-bf85435aa0a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:43:01.572593613Z [2024-07-04 01:43:01,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:43:01.720517201Z [2024-07-04 01:43:01,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:43:02.918184461Z [2024-07-04 01:43:02,917: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:43:02.921585689Z [2024-07-04 01:43:02,921: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:43:02.950319446Z [2024-07-04 01:43:02,950: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:43:02.955837998Z [2024-07-04 01:43:02,955: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:43:02.955859452Z [2024-07-04 01:43:02,955: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:43:02.956028426Z [2024-07-04 01:43:02,955: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:43:02.956086196Z [2024-07-04 01:43:02,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:43:02.956330798Z [2024-07-04 01:43:02,956: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:43:02.956369329Z [2024-07-04 01:43:02,956: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:43:02.989064739Z [2024-07-04 01:43:02,988: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:43:02.992665319Z [2024-07-04 01:43:02,992: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:43:03.046769490Z [2024-07-04 01:43:03,046: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:43:03.048048185Z [2024-07-04 01:43:03,047: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:43:03.048120361Z [2024-07-04 01:43:03,048: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:43:03.048286718Z [2024-07-04 01:43:03,048: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:43:03.048390075Z [2024-07-04 01:43:03,048: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:43:03.048619216Z [2024-07-04 01:43:03,048: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:43:03.048714095Z [2024-07-04 01:43:03,048: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:43:03.078741417Z [2024-07-04 01:43:03,078: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:43:03.147847412Z [2024-07-04 01:43:03,147: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:43:05.052580923Z [2024-07-04 01:43:05,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24c678a4-8a09-4604-ba36-bf85435aa0a1] succeeded in 3.7658739920000244s: None 2024-07-04T01:43:06.124148671Z [2024-07-04 01:43:06,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07c046be-8547-48b4-b689-9fbbc53a4474] succeeded in 4.881482386000016s: None 2024-07-04T01:44:00.255639100Z [2024-07-04 01:44:00,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2883cd9f-1af6-46d1-8c63-08421f0af6c6] received 2024-07-04T01:44:00.259815416Z [2024-07-04 01:44:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5e87a6a-825c-44e0-9cd7-905b4f742c58] received 2024-07-04T01:44:00.261878794Z [2024-07-04 01:44:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2edf14d-0f3a-4b34-a686-5ac905db69aa] received 2024-07-04T01:44:00.291261472Z [2024-07-04 01:44:00,290: INFO/ForkPoolWorker-1] [f2edf14d-0f3a-4b34-a686-5ac905db69aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:44:00.293442909Z [2024-07-04 01:44:00,293: INFO/ForkPoolWorker-15] [2883cd9f-1af6-46d1-8c63-08421f0af6c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:44:00.304064757Z [2024-07-04 01:44:00,303: INFO/ForkPoolWorker-16] [e5e87a6a-825c-44e0-9cd7-905b4f742c58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:44:00.660685479Z [2024-07-04 01:44:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:44:00.743915762Z [2024-07-04 01:44:00,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:44:00.896505912Z [2024-07-04 01:44:00,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:44:01.234382335Z [2024-07-04 01:44:01,234: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:44:02.042562067Z [2024-07-04 01:44:02,041: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2883cd9f-1af6-46d1-8c63-08421f0af6c6] succeeded in 1.7802142670000194s: None 2024-07-04T01:44:02.376041487Z [2024-07-04 01:44:02,375: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:44:02.379667081Z [2024-07-04 01:44:02,379: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:44:02.411010615Z [2024-07-04 01:44:02,410: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:44:02.412275466Z [2024-07-04 01:44:02,411: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:44:02.412290171Z [2024-07-04 01:44:02,412: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:44:02.412372265Z [2024-07-04 01:44:02,412: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:44:02.412530880Z [2024-07-04 01:44:02,412: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:44:02.413670571Z [2024-07-04 01:44:02,413: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:44:02.414017366Z [2024-07-04 01:44:02,413: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:44:02.417897954Z [2024-07-04 01:44:02,417: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:44:02.421063095Z [2024-07-04 01:44:02,420: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:44:02.451068649Z [2024-07-04 01:44:02,450: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:44:02.453858635Z [2024-07-04 01:44:02,453: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:44:02.454120848Z [2024-07-04 01:44:02,453: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:44:02.454407005Z [2024-07-04 01:44:02,454: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:44:02.454619007Z [2024-07-04 01:44:02,454: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:44:02.455786527Z [2024-07-04 01:44:02,454: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:44:02.455984410Z [2024-07-04 01:44:02,455: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:44:02.486043640Z [2024-07-04 01:44:02,485: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:44:02.542446496Z [2024-07-04 01:44:02,542: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:44:04.487592404Z [2024-07-04 01:44:04,487: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2edf14d-0f3a-4b34-a686-5ac905db69aa] succeeded in 4.2190345120000075s: None 2024-07-04T01:44:05.544842965Z [2024-07-04 01:44:05,544: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5e87a6a-825c-44e0-9cd7-905b4f742c58] succeeded in 5.280775713000139s: None 2024-07-04T01:45:01.164007982Z [2024-07-04 01:45:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb437495-439e-4577-be56-6aaf4a5f6e84] received 2024-07-04T01:45:01.180969003Z [2024-07-04 01:45:01,180: INFO/ForkPoolWorker-15] [bb437495-439e-4577-be56-6aaf4a5f6e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:01.183363748Z [2024-07-04 01:45:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c318f3e-313c-4e06-9576-c019d126defb] received 2024-07-04T01:45:01.187692075Z [2024-07-04 01:45:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a03b06c-0287-4a85-a791-2aeb87b7cafd] received 2024-07-04T01:45:01.208788783Z [2024-07-04 01:45:01,208: INFO/ForkPoolWorker-1] [1a03b06c-0287-4a85-a791-2aeb87b7cafd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:45:01.217282148Z [2024-07-04 01:45:01,216: INFO/ForkPoolWorker-16] [7c318f3e-313c-4e06-9576-c019d126defb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:45:01.517999093Z [2024-07-04 01:45:01,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:45:01.537276228Z [2024-07-04 01:45:01,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:45:01.573509376Z [2024-07-04 01:45:01,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:45:02.865355269Z [2024-07-04 01:45:02,864: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:45:02.869229208Z [2024-07-04 01:45:02,868: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:02.877130537Z [2024-07-04 01:45:02,876: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:45:02.880842740Z [2024-07-04 01:45:02,880: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:02.911812085Z [2024-07-04 01:45:02,911: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:45:02.914639457Z [2024-07-04 01:45:02,914: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:02.914800043Z [2024-07-04 01:45:02,914: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:02.915073790Z [2024-07-04 01:45:02,914: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:02.915237672Z [2024-07-04 01:45:02,915: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:45:02.915559241Z [2024-07-04 01:45:02,915: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:45:02.915719300Z [2024-07-04 01:45:02,915: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:02.932629317Z [2024-07-04 01:45:02,932: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:45:02.937353890Z [2024-07-04 01:45:02,936: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:02.963448671Z [2024-07-04 01:45:02,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:45:02.965135429Z [2024-07-04 01:45:02,964: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:02.965500606Z [2024-07-04 01:45:02,965: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:02.966373000Z [2024-07-04 01:45:02,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:45:02.967779398Z [2024-07-04 01:45:02,967: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:02.968237407Z [2024-07-04 01:45:02,968: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:45:02.968618210Z [2024-07-04 01:45:02,968: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:45:02.968797081Z [2024-07-04 01:45:02,968: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:02.974099243Z [2024-07-04 01:45:02,973: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:02.974143979Z [2024-07-04 01:45:02,974: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:02.974235549Z [2024-07-04 01:45:02,974: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:02.974300243Z [2024-07-04 01:45:02,974: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:45:02.974508924Z [2024-07-04 01:45:02,974: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:45:02.974556503Z [2024-07-04 01:45:02,974: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:03.028557610Z [2024-07-04 01:45:03,028: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:03.054771560Z [2024-07-04 01:45:03,054: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:03.056373063Z [2024-07-04 01:45:03,056: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:03.752392825Z [2024-07-04 01:45:03,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bb437495-439e-4577-be56-6aaf4a5f6e84] succeeded in 2.5851078569999117s: None 2024-07-04T01:45:03.959018995Z [2024-07-04 01:45:03,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ac4c9a2-0b2d-4c19-9950-d2c33b47adf5] received 2024-07-04T01:45:03.967931298Z [2024-07-04 01:45:03,967: INFO/ForkPoolWorker-15] [2ac4c9a2-0b2d-4c19-9950-d2c33b47adf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:04.268335423Z [2024-07-04 01:45:04,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:45:04.748981103Z [2024-07-04 01:45:04,740: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a03b06c-0287-4a85-a791-2aeb87b7cafd] succeeded in 3.5507038109999485s: None 2024-07-04T01:45:05.066095834Z [2024-07-04 01:45:05,065: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c318f3e-313c-4e06-9576-c019d126defb] succeeded in 3.8794305900000836s: None 2024-07-04T01:45:05.502698347Z [2024-07-04 01:45:05,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:45:05.506256068Z [2024-07-04 01:45:05,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:05.528341698Z [2024-07-04 01:45:05,528: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:45:05.530163643Z [2024-07-04 01:45:05,529: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:05.530262933Z [2024-07-04 01:45:05,530: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:05.530485799Z [2024-07-04 01:45:05,530: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:05.530828406Z [2024-07-04 01:45:05,530: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:45:05.531170758Z [2024-07-04 01:45:05,531: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:45:05.531397579Z [2024-07-04 01:45:05,531: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:05.613613253Z [2024-07-04 01:45:05,613: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:06.236670654Z [2024-07-04 01:45:06,236: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ac4c9a2-0b2d-4c19-9950-d2c33b47adf5] succeeded in 2.2756068370001685s: None 2024-07-04T01:45:06.369842382Z [2024-07-04 01:45:06,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43c7f0cf-0b68-4940-9b08-3635210bf583] received 2024-07-04T01:45:06.387754264Z [2024-07-04 01:45:06,386: INFO/ForkPoolWorker-15] [43c7f0cf-0b68-4940-9b08-3635210bf583] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:45:06.700545685Z [2024-07-04 01:45:06,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:45:07.775260107Z [2024-07-04 01:45:07,774: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:45:07.778579164Z [2024-07-04 01:45:07,778: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:07.822580686Z [2024-07-04 01:45:07,822: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:45:07.824124864Z [2024-07-04 01:45:07,823: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:07.824138263Z [2024-07-04 01:45:07,824: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:07.824360588Z [2024-07-04 01:45:07,824: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:07.824412358Z [2024-07-04 01:45:07,824: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:45:07.824671673Z [2024-07-04 01:45:07,824: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:45:07.824740199Z [2024-07-04 01:45:07,824: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:07.949836273Z [2024-07-04 01:45:07,949: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:10.410198534Z [2024-07-04 01:45:10,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43c7f0cf-0b68-4940-9b08-3635210bf583] succeeded in 4.037928093999881s: None 2024-07-04T01:45:11.234792362Z [2024-07-04 01:45:11,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ace94f26-779b-4c4d-a6bb-1bab7f490bea] received 2024-07-04T01:45:11.243480267Z [2024-07-04 01:45:11,243: INFO/ForkPoolWorker-15] [ace94f26-779b-4c4d-a6bb-1bab7f490bea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:45:11.568459706Z [2024-07-04 01:45:11,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:45:12.782984562Z [2024-07-04 01:45:12,779: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:45:12.783110839Z [2024-07-04 01:45:12,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:45:12.812968817Z [2024-07-04 01:45:12,812: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:45:12.813958530Z [2024-07-04 01:45:12,813: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:45:12.813990912Z [2024-07-04 01:45:12,813: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:45:12.814493432Z [2024-07-04 01:45:12,813: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:45:12.814508976Z [2024-07-04 01:45:12,814: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:45:12.814527417Z [2024-07-04 01:45:12,814: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:45:12.814534699Z [2024-07-04 01:45:12,814: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:45:12.921266949Z [2024-07-04 01:45:12,920: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:45:13.610718485Z [2024-07-04 01:45:13,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ace94f26-779b-4c4d-a6bb-1bab7f490bea] succeeded in 2.3730058990001908s: None 2024-07-04T01:46:01.115653475Z [2024-07-04 01:46:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c817898-78a6-4f12-9843-448be45f6da4] received 2024-07-04T01:46:01.133222507Z [2024-07-04 01:46:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13d91f45-a259-4f78-b683-8e5c397c7f02] received 2024-07-04T01:46:01.140815404Z [2024-07-04 01:46:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e08a5bfc-f153-4ae5-a1d8-fa04ef410e4b] received 2024-07-04T01:46:01.151776721Z [2024-07-04 01:46:01,151: INFO/ForkPoolWorker-15] [4c817898-78a6-4f12-9843-448be45f6da4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:46:01.159723271Z [2024-07-04 01:46:01,159: INFO/ForkPoolWorker-16] [13d91f45-a259-4f78-b683-8e5c397c7f02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:46:01.164900361Z [2024-07-04 01:46:01,164: INFO/ForkPoolWorker-1] [e08a5bfc-f153-4ae5-a1d8-fa04ef410e4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:46:01.506980624Z [2024-07-04 01:46:01,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:46:01.525178976Z [2024-07-04 01:46:01,520: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:46:01.549481032Z [2024-07-04 01:46:01,541: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:46:01.850492823Z [2024-07-04 01:46:01,849: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:46:02.584695043Z [2024-07-04 01:46:02,584: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4c817898-78a6-4f12-9843-448be45f6da4] succeeded in 1.4593194759997914s: None 2024-07-04T01:46:02.870565520Z [2024-07-04 01:46:02,870: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:46:02.873997983Z [2024-07-04 01:46:02,873: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:46:02.917053464Z [2024-07-04 01:46:02,916: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:46:02.918979951Z [2024-07-04 01:46:02,918: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:46:02.918997422Z [2024-07-04 01:46:02,918: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:46:02.919267904Z [2024-07-04 01:46:02,919: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:46:02.919508263Z [2024-07-04 01:46:02,919: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:46:02.919895633Z [2024-07-04 01:46:02,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:46:02.920564051Z [2024-07-04 01:46:02,919: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:46:03.026016830Z [2024-07-04 01:46:03,025: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:46:03.081461213Z [2024-07-04 01:46:03,081: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:46:03.085921415Z [2024-07-04 01:46:03,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:46:03.118412324Z [2024-07-04 01:46:03,118: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:46:03.119741293Z [2024-07-04 01:46:03,119: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:46:03.120015930Z [2024-07-04 01:46:03,119: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:46:03.120354476Z [2024-07-04 01:46:03,119: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:46:03.120421102Z [2024-07-04 01:46:03,120: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:46:03.120702096Z [2024-07-04 01:46:03,120: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:46:03.121101502Z [2024-07-04 01:46:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:46:03.257490863Z [2024-07-04 01:46:03,257: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:46:04.862837290Z [2024-07-04 01:46:04,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e08a5bfc-f153-4ae5-a1d8-fa04ef410e4b] succeeded in 3.7168098090000967s: None 2024-07-04T01:46:05.595315212Z [2024-07-04 01:46:05,594: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13d91f45-a259-4f78-b683-8e5c397c7f02] succeeded in 4.457943725000177s: None 2024-07-04T01:47:01.049147163Z [2024-07-04 01:47:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9de79b74-390b-4434-9dca-b51567a08e3d] received 2024-07-04T01:47:01.061091995Z [2024-07-04 01:47:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[057e19fb-e12d-4bc3-8982-e58c48445f30] received 2024-07-04T01:47:01.072649899Z [2024-07-04 01:47:01,072: INFO/ForkPoolWorker-15] [9de79b74-390b-4434-9dca-b51567a08e3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:47:01.093244729Z [2024-07-04 01:47:01,092: INFO/ForkPoolWorker-16] [057e19fb-e12d-4bc3-8982-e58c48445f30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:47:01.409505986Z [2024-07-04 01:47:01,404: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:47:01.413968285Z [2024-07-04 01:47:01,409: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:47:02.606749529Z [2024-07-04 01:47:02,606: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:47:02.610322760Z [2024-07-04 01:47:02,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:47:02.624165407Z [2024-07-04 01:47:02,623: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:47:02.627804187Z [2024-07-04 01:47:02,627: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:47:02.643696955Z [2024-07-04 01:47:02,643: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:47:02.646026020Z [2024-07-04 01:47:02,645: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:47:02.646116252Z [2024-07-04 01:47:02,645: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:47:02.646309744Z [2024-07-04 01:47:02,646: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:47:02.646423857Z [2024-07-04 01:47:02,646: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:47:02.647795560Z [2024-07-04 01:47:02,647: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:47:02.647882986Z [2024-07-04 01:47:02,647: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:47:02.665621902Z [2024-07-04 01:47:02,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:47:02.667324601Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:47:02.667479249Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:47:02.667660387Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:47:02.667766138Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:47:02.668043679Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:47:02.668118368Z [2024-07-04 01:47:02,667: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:47:02.744760490Z [2024-07-04 01:47:02,744: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:47:02.760812345Z [2024-07-04 01:47:02,760: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:47:04.250537276Z [2024-07-04 01:47:04,249: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[057e19fb-e12d-4bc3-8982-e58c48445f30] succeeded in 3.1820491650000804s: None 2024-07-04T01:47:04.909865036Z [2024-07-04 01:47:04,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9de79b74-390b-4434-9dca-b51567a08e3d] succeeded in 3.8512135690000378s: None 2024-07-04T01:48:00.402145880Z [2024-07-04 01:48:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9fdb16f-fa43-4368-8905-447aa00418be] received 2024-07-04T01:48:00.407997462Z [2024-07-04 01:48:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c151564-f1bf-4fb9-8966-19edf3a65b6c] received 2024-07-04T01:48:00.411991432Z [2024-07-04 01:48:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b250670a-2611-4fd7-9528-f4b8ce7a7bc0] received 2024-07-04T01:48:00.432103994Z [2024-07-04 01:48:00,431: INFO/ForkPoolWorker-16] [8c151564-f1bf-4fb9-8966-19edf3a65b6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:48:00.432586050Z [2024-07-04 01:48:00,432: INFO/ForkPoolWorker-15] [a9fdb16f-fa43-4368-8905-447aa00418be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:48:00.445711204Z [2024-07-04 01:48:00,445: INFO/ForkPoolWorker-1] [b250670a-2611-4fd7-9528-f4b8ce7a7bc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:48:00.971960809Z [2024-07-04 01:48:00,960: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:48:01.011524173Z [2024-07-04 01:48:01,007: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:48:01.033343761Z [2024-07-04 01:48:01,029: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:48:01.539594946Z [2024-07-04 01:48:01,539: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:48:02.309719546Z [2024-07-04 01:48:02,309: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c151564-f1bf-4fb9-8966-19edf3a65b6c] succeeded in 1.8902025179997963s: None 2024-07-04T01:48:02.595117923Z [2024-07-04 01:48:02,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:48:02.598517437Z [2024-07-04 01:48:02,598: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:48:02.627373228Z [2024-07-04 01:48:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:48:02.628609179Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:48:02.628654609Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:48:02.628804222Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:48:02.628836392Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:48:02.629029217Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:48:02.629083649Z [2024-07-04 01:48:02,628: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:48:02.718667480Z [2024-07-04 01:48:02,718: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:48:02.723076480Z [2024-07-04 01:48:02,722: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:48:02.733187758Z [2024-07-04 01:48:02,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:48:02.760739601Z [2024-07-04 01:48:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:48:02.761744472Z [2024-07-04 01:48:02,761: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:48:02.761819926Z [2024-07-04 01:48:02,761: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:48:02.761982172Z [2024-07-04 01:48:02,761: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:48:02.762069304Z [2024-07-04 01:48:02,761: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:48:02.762351876Z [2024-07-04 01:48:02,762: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:48:02.762368832Z [2024-07-04 01:48:02,762: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:48:02.852220646Z [2024-07-04 01:48:02,851: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:48:04.398702612Z [2024-07-04 01:48:04,398: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b250670a-2611-4fd7-9528-f4b8ce7a7bc0] succeeded in 3.979087183000047s: None 2024-07-04T01:48:04.590315867Z [2024-07-04 01:48:04,589: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a9fdb16f-fa43-4368-8905-447aa00418be] succeeded in 4.17886839300013s: None 2024-07-04T01:49:01.220524092Z [2024-07-04 01:49:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cea87a3b-edfb-4fd6-8986-d67b21ee6978] received 2024-07-04T01:49:01.225322866Z [2024-07-04 01:49:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60aac839-bf80-4b25-bc5f-9a2d46fead5a] received 2024-07-04T01:49:01.240481752Z [2024-07-04 01:49:01,240: INFO/ForkPoolWorker-15] [cea87a3b-edfb-4fd6-8986-d67b21ee6978] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:49:01.248019644Z [2024-07-04 01:49:01,247: INFO/ForkPoolWorker-16] [60aac839-bf80-4b25-bc5f-9a2d46fead5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:49:01.569232075Z [2024-07-04 01:49:01,564: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:49:01.631282746Z [2024-07-04 01:49:01,627: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:49:02.931571580Z [2024-07-04 01:49:02,931: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:49:02.935448396Z [2024-07-04 01:49:02,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:49:02.959807024Z [2024-07-04 01:49:02,959: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:49:02.964700141Z [2024-07-04 01:49:02,964: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:49:02.966229304Z [2024-07-04 01:49:02,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:49:02.969047404Z [2024-07-04 01:49:02,968: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:49:02.969111872Z [2024-07-04 01:49:02,969: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:49:02.969284862Z [2024-07-04 01:49:02,969: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:49:02.969344318Z [2024-07-04 01:49:02,969: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:49:02.969611979Z [2024-07-04 01:49:02,969: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:49:02.969661827Z [2024-07-04 01:49:02,969: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:49:02.994660119Z [2024-07-04 01:49:02,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:49:02.996057682Z [2024-07-04 01:49:02,995: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:49:02.996331678Z [2024-07-04 01:49:02,996: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:49:02.996944694Z [2024-07-04 01:49:02,996: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:49:02.997134484Z [2024-07-04 01:49:02,997: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:49:02.997470412Z [2024-07-04 01:49:02,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:49:02.998074067Z [2024-07-04 01:49:02,997: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:49:03.050779565Z [2024-07-04 01:49:03,050: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:49:03.086481179Z [2024-07-04 01:49:03,086: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:49:06.218446561Z [2024-07-04 01:49:06,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cea87a3b-edfb-4fd6-8986-d67b21ee6978] succeeded in 4.995967375999953s: None 2024-07-04T01:49:06.612022837Z [2024-07-04 01:49:06,611: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60aac839-bf80-4b25-bc5f-9a2d46fead5a] succeeded in 5.383743887000037s: None 2024-07-04T01:50:01.054135591Z [2024-07-04 01:50:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a220fce-3f14-44e4-9ced-e5d89ca9b20b] received 2024-07-04T01:50:01.058065469Z [2024-07-04 01:50:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf125bac-1d72-4792-a093-aa6919851c66] received 2024-07-04T01:50:01.067536019Z [2024-07-04 01:50:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f62840a7-fd51-42f3-b071-40f35d3551f6] received 2024-07-04T01:50:01.070925439Z [2024-07-04 01:50:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d02de76-7c31-4b23-9fd0-99e4a1d465b3] received 2024-07-04T01:50:01.080239894Z [2024-07-04 01:50:01,079: INFO/ForkPoolWorker-16] [cf125bac-1d72-4792-a093-aa6919851c66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:50:01.088856505Z [2024-07-04 01:50:01,088: INFO/ForkPoolWorker-2] [8d02de76-7c31-4b23-9fd0-99e4a1d465b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:50:01.095936223Z [2024-07-04 01:50:01,095: INFO/ForkPoolWorker-15] [0a220fce-3f14-44e4-9ced-e5d89ca9b20b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:50:01.100613117Z [2024-07-04 01:50:01,099: INFO/ForkPoolWorker-1] [f62840a7-fd51-42f3-b071-40f35d3551f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:01.442206485Z [2024-07-04 01:50:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:50:01.450910698Z [2024-07-04 01:50:01,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:50:01.612191732Z [2024-07-04 01:50:01,608: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:50:01.661888007Z [2024-07-04 01:50:01,657: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:50:02.232913561Z [2024-07-04 01:50:02,232: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:02.944822037Z [2024-07-04 01:50:02,944: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8d02de76-7c31-4b23-9fd0-99e4a1d465b3] succeeded in 1.8704025980000551s: None 2024-07-04T01:50:03.157589080Z [2024-07-04 01:50:03,157: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:50:03.161457883Z [2024-07-04 01:50:03,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:03.170538820Z [2024-07-04 01:50:03,170: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:50:03.177391920Z [2024-07-04 01:50:03,176: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:03.192018633Z [2024-07-04 01:50:03,191: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:50:03.194506847Z [2024-07-04 01:50:03,194: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:03.194783457Z [2024-07-04 01:50:03,194: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:03.195030209Z [2024-07-04 01:50:03,194: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:03.195205757Z [2024-07-04 01:50:03,194: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:50:03.195556518Z [2024-07-04 01:50:03,195: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:50:03.196082794Z [2024-07-04 01:50:03,195: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:03.219152538Z [2024-07-04 01:50:03,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:50:03.222932233Z [2024-07-04 01:50:03,222: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:50:03.226034622Z [2024-07-04 01:50:03,225: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:03.226249030Z [2024-07-04 01:50:03,226: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:03.226532631Z [2024-07-04 01:50:03,226: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:03.227358871Z [2024-07-04 01:50:03,226: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:03.228014113Z [2024-07-04 01:50:03,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:50:03.228775780Z [2024-07-04 01:50:03,228: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:50:03.228951912Z [2024-07-04 01:50:03,228: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:03.257404777Z [2024-07-04 01:50:03,257: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:50:03.258835416Z [2024-07-04 01:50:03,258: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:03.258852753Z [2024-07-04 01:50:03,258: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:03.259027807Z [2024-07-04 01:50:03,258: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:03.259048496Z [2024-07-04 01:50:03,258: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:50:03.259275743Z [2024-07-04 01:50:03,259: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:50:03.259290316Z [2024-07-04 01:50:03,259: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:03.282332695Z [2024-07-04 01:50:03,282: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:03.335239912Z [2024-07-04 01:50:03,334: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:03.352583369Z [2024-07-04 01:50:03,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:04.114344948Z [2024-07-04 01:50:04,113: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f62840a7-fd51-42f3-b071-40f35d3551f6] succeeded in 3.039464111999905s: None 2024-07-04T01:50:05.080239681Z [2024-07-04 01:50:05,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a5749f4-a1fe-4702-9749-b9dbd3b4198a] received 2024-07-04T01:50:05.100857836Z [2024-07-04 01:50:05,100: INFO/ForkPoolWorker-1] [6a5749f4-a1fe-4702-9749-b9dbd3b4198a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:05.217068453Z [2024-07-04 01:50:05,216: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0a220fce-3f14-44e4-9ced-e5d89ca9b20b] succeeded in 4.158562223999979s: None 2024-07-04T01:50:05.437664161Z [2024-07-04 01:50:05,434: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:50:05.509079688Z [2024-07-04 01:50:05,508: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf125bac-1d72-4792-a093-aa6919851c66] succeeded in 4.4470673250000345s: None 2024-07-04T01:50:06.610808575Z [2024-07-04 01:50:06,610: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:50:06.614139205Z [2024-07-04 01:50:06,613: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:06.643514278Z [2024-07-04 01:50:06,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:50:06.645144824Z [2024-07-04 01:50:06,644: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:06.645362888Z [2024-07-04 01:50:06,645: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:06.645634071Z [2024-07-04 01:50:06,645: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:06.645849759Z [2024-07-04 01:50:06,645: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:50:06.646363550Z [2024-07-04 01:50:06,646: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:50:06.646685881Z [2024-07-04 01:50:06,646: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:06.755619837Z [2024-07-04 01:50:06,754: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:07.438937972Z [2024-07-04 01:50:07,438: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a5749f4-a1fe-4702-9749-b9dbd3b4198a] succeeded in 2.353084507000176s: None 2024-07-04T01:50:07.504369643Z [2024-07-04 01:50:07,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b335a8c-f4ff-4c10-99b5-eb9a8108d843] received 2024-07-04T01:50:07.524769012Z [2024-07-04 01:50:07,524: INFO/ForkPoolWorker-15] [9b335a8c-f4ff-4c10-99b5-eb9a8108d843] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:50:07.832356329Z [2024-07-04 01:50:07,829: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:50:08.950402742Z [2024-07-04 01:50:08,950: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:50:08.953950048Z [2024-07-04 01:50:08,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:08.979185238Z [2024-07-04 01:50:08,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:50:08.984093064Z [2024-07-04 01:50:08,983: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:08.984112482Z [2024-07-04 01:50:08,983: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:08.984116435Z [2024-07-04 01:50:08,983: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:08.984134756Z [2024-07-04 01:50:08,984: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:50:08.984449943Z [2024-07-04 01:50:08,984: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:50:08.984541252Z [2024-07-04 01:50:08,984: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:09.083027420Z [2024-07-04 01:50:09,082: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:09.763874068Z [2024-07-04 01:50:09,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b335a8c-f4ff-4c10-99b5-eb9a8108d843] succeeded in 2.255506920000016s: None 2024-07-04T01:50:10.177364616Z [2024-07-04 01:50:10,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f343c8-ebfc-4340-ac23-7d97493bf73a] received 2024-07-04T01:50:10.187450091Z [2024-07-04 01:50:10,187: INFO/ForkPoolWorker-15] [c5f343c8-ebfc-4340-ac23-7d97493bf73a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:50:10.517159509Z [2024-07-04 01:50:10,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:50:11.688031564Z [2024-07-04 01:50:11,687: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:50:11.691485158Z [2024-07-04 01:50:11,691: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:50:11.717536916Z [2024-07-04 01:50:11,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:50:11.718809510Z [2024-07-04 01:50:11,718: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:50:11.718857309Z [2024-07-04 01:50:11,718: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:50:11.719013896Z [2024-07-04 01:50:11,718: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:50:11.719055281Z [2024-07-04 01:50:11,718: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:50:11.719333288Z [2024-07-04 01:50:11,719: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:50:11.719347028Z [2024-07-04 01:50:11,719: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:50:11.807571057Z [2024-07-04 01:50:11,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:50:12.513001969Z [2024-07-04 01:50:12,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5f343c8-ebfc-4340-ac23-7d97493bf73a] succeeded in 2.3329853029999867s: None 2024-07-04T01:51:01.082719108Z [2024-07-04 01:51:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aefeeea-8b17-412e-8ce8-d1c158c6cceb] received 2024-07-04T01:51:01.087801015Z [2024-07-04 01:51:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b1efa4e-d95e-4e62-ac90-91d363722fdc] received 2024-07-04T01:51:01.105808929Z [2024-07-04 01:51:01,105: INFO/ForkPoolWorker-16] [1b1efa4e-d95e-4e62-ac90-91d363722fdc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:51:01.107050154Z [2024-07-04 01:51:01,106: INFO/ForkPoolWorker-15] [8aefeeea-8b17-412e-8ce8-d1c158c6cceb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:51:01.469646772Z [2024-07-04 01:51:01,465: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:51:01.507817345Z [2024-07-04 01:51:01,496: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:51:02.727780631Z [2024-07-04 01:51:02,727: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:51:02.731461937Z [2024-07-04 01:51:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:51:02.769279518Z [2024-07-04 01:51:02,768: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:51:02.771481654Z [2024-07-04 01:51:02,771: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:51:02.771515659Z [2024-07-04 01:51:02,771: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:51:02.771731394Z [2024-07-04 01:51:02,771: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:51:02.772324143Z [2024-07-04 01:51:02,772: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:51:02.772780899Z [2024-07-04 01:51:02,772: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:51:02.772802670Z [2024-07-04 01:51:02,772: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:51:02.793022161Z [2024-07-04 01:51:02,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:51:02.796413007Z [2024-07-04 01:51:02,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:51:02.832327173Z [2024-07-04 01:51:02,832: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:51:02.835337597Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:51:02.835357791Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:51:02.835483755Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:51:02.835499062Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:51:02.835857708Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:51:02.835874725Z [2024-07-04 01:51:02,835: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:51:02.861485629Z [2024-07-04 01:51:02,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:51:02.912462333Z [2024-07-04 01:51:02,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:51:05.178179433Z [2024-07-04 01:51:05,177: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b1efa4e-d95e-4e62-ac90-91d363722fdc] succeeded in 4.085117209999908s: None 2024-07-04T01:51:05.541636601Z [2024-07-04 01:51:05,541: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8aefeeea-8b17-412e-8ce8-d1c158c6cceb] succeeded in 4.455847752999944s: None 2024-07-04T01:52:00.290466338Z [2024-07-04 01:52:00,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28066b6b-b398-42ff-9fb0-38d5a39c72e9] received 2024-07-04T01:52:00.292819987Z [2024-07-04 01:52:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecd3a54b-374f-4cff-adb1-b3672cde395b] received 2024-07-04T01:52:00.316880039Z [2024-07-04 01:52:00,316: INFO/ForkPoolWorker-16] [ecd3a54b-374f-4cff-adb1-b3672cde395b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:52:00.318956863Z [2024-07-04 01:52:00,318: INFO/ForkPoolWorker-15] [28066b6b-b398-42ff-9fb0-38d5a39c72e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:52:00.367350863Z [2024-07-04 01:52:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01ac2461-ac85-487b-9995-0ef07e6d716c] received 2024-07-04T01:52:00.385638008Z [2024-07-04 01:52:00,385: INFO/ForkPoolWorker-1] [01ac2461-ac85-487b-9995-0ef07e6d716c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:52:00.915992339Z [2024-07-04 01:52:00,911: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:52:01.042046129Z [2024-07-04 01:52:01,027: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:52:01.056975183Z [2024-07-04 01:52:01,048: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:52:01.677368800Z [2024-07-04 01:52:01,677: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:52:02.667362639Z [2024-07-04 01:52:02,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:52:02.671072176Z [2024-07-04 01:52:02,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:52:02.730706586Z [2024-07-04 01:52:02,727: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:52:02.733312597Z [2024-07-04 01:52:02,732: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ecd3a54b-374f-4cff-adb1-b3672cde395b] succeeded in 2.4381789220001338s: None 2024-07-04T01:52:02.735802283Z [2024-07-04 01:52:02,735: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:52:02.736321492Z [2024-07-04 01:52:02,735: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:52:02.738963238Z [2024-07-04 01:52:02,738: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:52:02.739101779Z [2024-07-04 01:52:02,738: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:52:02.739615267Z [2024-07-04 01:52:02,739: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:52:02.739770704Z [2024-07-04 01:52:02,739: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:52:02.857803649Z [2024-07-04 01:52:02,857: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:52:03.040052409Z [2024-07-04 01:52:03,039: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:52:03.043274032Z [2024-07-04 01:52:03,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:52:03.099672210Z [2024-07-04 01:52:03,099: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:52:03.101158579Z [2024-07-04 01:52:03,100: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:52:03.101173725Z [2024-07-04 01:52:03,101: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:52:03.101423391Z [2024-07-04 01:52:03,101: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:52:03.101514426Z [2024-07-04 01:52:03,101: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:52:03.102162592Z [2024-07-04 01:52:03,101: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:52:03.102187001Z [2024-07-04 01:52:03,102: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:52:03.204549276Z [2024-07-04 01:52:03,204: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:52:05.388737880Z [2024-07-04 01:52:05,388: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01ac2461-ac85-487b-9995-0ef07e6d716c] succeeded in 5.018403448000072s: None 2024-07-04T01:52:05.712921222Z [2024-07-04 01:52:05,712: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28066b6b-b398-42ff-9fb0-38d5a39c72e9] succeeded in 5.416849405999983s: None 2024-07-04T01:53:00.503576849Z [2024-07-04 01:53:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77cfd142-fdff-48d0-a442-2e7a1b01e130] received 2024-07-04T01:53:00.517970780Z [2024-07-04 01:53:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0a262cf-3393-445e-86df-56d43c40a90d] received 2024-07-04T01:53:00.538143262Z [2024-07-04 01:53:00,536: INFO/ForkPoolWorker-16] [a0a262cf-3393-445e-86df-56d43c40a90d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:53:00.541012016Z [2024-07-04 01:53:00,540: INFO/ForkPoolWorker-15] [77cfd142-fdff-48d0-a442-2e7a1b01e130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:53:00.878595958Z [2024-07-04 01:53:00,871: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:53:00.961465002Z [2024-07-04 01:53:00,955: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:53:02.166280673Z [2024-07-04 01:53:02,165: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:53:02.170203607Z [2024-07-04 01:53:02,169: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:53:02.194757360Z [2024-07-04 01:53:02,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:53:02.198294803Z [2024-07-04 01:53:02,197: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:53:02.202685746Z [2024-07-04 01:53:02,202: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:53:02.205390227Z [2024-07-04 01:53:02,205: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:53:02.205542208Z [2024-07-04 01:53:02,205: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:53:02.205944644Z [2024-07-04 01:53:02,205: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:53:02.206115659Z [2024-07-04 01:53:02,205: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:53:02.206563932Z [2024-07-04 01:53:02,206: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:53:02.207193504Z [2024-07-04 01:53:02,207: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:53:02.231058551Z [2024-07-04 01:53:02,230: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:53:02.233047847Z [2024-07-04 01:53:02,232: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:53:02.233231717Z [2024-07-04 01:53:02,233: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:53:02.233589844Z [2024-07-04 01:53:02,233: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:53:02.234052375Z [2024-07-04 01:53:02,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:53:02.235803248Z [2024-07-04 01:53:02,235: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:53:02.236015068Z [2024-07-04 01:53:02,235: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:53:02.286824243Z [2024-07-04 01:53:02,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:53:02.339041879Z [2024-07-04 01:53:02,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:53:04.212742561Z [2024-07-04 01:53:04,212: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0a262cf-3393-445e-86df-56d43c40a90d] succeeded in 3.691573994999999s: None 2024-07-04T01:53:04.220465134Z [2024-07-04 01:53:04,220: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77cfd142-fdff-48d0-a442-2e7a1b01e130] succeeded in 3.71091730299986s: None 2024-07-04T01:54:00.824838651Z [2024-07-04 01:54:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce1dcccb-0bce-4436-b4c6-a337c301b3ce] received 2024-07-04T01:54:00.835892528Z [2024-07-04 01:54:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f18fde0-6d38-428b-a7a6-963469407dd2] received 2024-07-04T01:54:00.839141483Z [2024-07-04 01:54:00,838: INFO/ForkPoolWorker-15] [ce1dcccb-0bce-4436-b4c6-a337c301b3ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:54:00.845082282Z [2024-07-04 01:54:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60fd9ced-7e77-4703-876b-93a88f96d9e3] received 2024-07-04T01:54:00.876311523Z [2024-07-04 01:54:00,875: INFO/ForkPoolWorker-16] [9f18fde0-6d38-428b-a7a6-963469407dd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:54:00.880196863Z [2024-07-04 01:54:00,879: INFO/ForkPoolWorker-1] [60fd9ced-7e77-4703-876b-93a88f96d9e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:54:01.174226779Z [2024-07-04 01:54:01,170: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:54:01.209392343Z [2024-07-04 01:54:01,206: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:54:01.234546783Z [2024-07-04 01:54:01,231: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:54:01.509399772Z [2024-07-04 01:54:01,509: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:54:02.282176591Z [2024-07-04 01:54:02,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce1dcccb-0bce-4436-b4c6-a337c301b3ce] succeeded in 1.4536458580000726s: None 2024-07-04T01:54:02.379781164Z [2024-07-04 01:54:02,379: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:54:02.382922971Z [2024-07-04 01:54:02,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:54:02.406367977Z [2024-07-04 01:54:02,406: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:54:02.408203247Z [2024-07-04 01:54:02,408: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:54:02.408220347Z [2024-07-04 01:54:02,408: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:54:02.408348731Z [2024-07-04 01:54:02,408: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:54:02.408358724Z [2024-07-04 01:54:02,408: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:54:02.409075482Z [2024-07-04 01:54:02,408: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:54:02.409089294Z [2024-07-04 01:54:02,409: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:54:02.439004351Z [2024-07-04 01:54:02,438: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:54:02.442604704Z [2024-07-04 01:54:02,442: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:54:02.463877819Z [2024-07-04 01:54:02,463: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:54:02.464996085Z [2024-07-04 01:54:02,464: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:54:02.465133664Z [2024-07-04 01:54:02,464: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:54:02.465155978Z [2024-07-04 01:54:02,464: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:54:02.465257729Z [2024-07-04 01:54:02,465: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:54:02.465645724Z [2024-07-04 01:54:02,465: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:54:02.465854174Z [2024-07-04 01:54:02,465: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:54:02.483725124Z [2024-07-04 01:54:02,483: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:54:02.542622724Z [2024-07-04 01:54:02,542: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:54:03.980447201Z [2024-07-04 01:54:03,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60fd9ced-7e77-4703-876b-93a88f96d9e3] succeeded in 3.1312627970000904s: None 2024-07-04T01:54:04.489928243Z [2024-07-04 01:54:04,489: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f18fde0-6d38-428b-a7a6-963469407dd2] succeeded in 3.6476457670000855s: None 2024-07-04T01:55:01.059928293Z [2024-07-04 01:55:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d721228-e52e-4693-9c51-09ed48b2e5bd] received 2024-07-04T01:55:01.062151541Z [2024-07-04 01:55:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d076940-cc26-4254-b612-45e7fb6d89b9] received 2024-07-04T01:55:01.071136456Z [2024-07-04 01:55:01,070: INFO/ForkPoolWorker-15] [8d721228-e52e-4693-9c51-09ed48b2e5bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:55:01.074157692Z [2024-07-04 01:55:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e70a0991-d3f1-4ecf-af28-39c4bccb3ae9] received 2024-07-04T01:55:01.075604928Z [2024-07-04 01:55:01,075: INFO/ForkPoolWorker-16] [7d076940-cc26-4254-b612-45e7fb6d89b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:01.087416040Z [2024-07-04 01:55:01,086: INFO/ForkPoolWorker-1] [e70a0991-d3f1-4ecf-af28-39c4bccb3ae9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:55:01.401637519Z [2024-07-04 01:55:01,397: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:55:01.429499611Z [2024-07-04 01:55:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:55:01.439195186Z [2024-07-04 01:55:01,435: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:55:02.670030446Z [2024-07-04 01:55:02,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:55:02.673697140Z [2024-07-04 01:55:02,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:02.719395662Z [2024-07-04 01:55:02,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:55:02.723271474Z [2024-07-04 01:55:02,723: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:02.723651911Z [2024-07-04 01:55:02,723: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:02.723829041Z [2024-07-04 01:55:02,723: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:02.724041915Z [2024-07-04 01:55:02,723: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:55:02.724417611Z [2024-07-04 01:55:02,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:55:02.724936087Z [2024-07-04 01:55:02,724: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:02.811732797Z [2024-07-04 01:55:02,811: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:02.847800709Z [2024-07-04 01:55:02,847: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:55:02.851138605Z [2024-07-04 01:55:02,850: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:02.892038063Z [2024-07-04 01:55:02,891: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:55:02.894863940Z [2024-07-04 01:55:02,894: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:02.895074908Z [2024-07-04 01:55:02,894: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:02.895294202Z [2024-07-04 01:55:02,895: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:02.895327801Z [2024-07-04 01:55:02,895: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:55:02.895688835Z [2024-07-04 01:55:02,895: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:55:02.895707744Z [2024-07-04 01:55:02,895: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:02.948637386Z [2024-07-04 01:55:02,948: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:55:02.952511059Z [2024-07-04 01:55:02,951: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:02.978524562Z [2024-07-04 01:55:02,978: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:02.979989333Z [2024-07-04 01:55:02,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:55:02.981762157Z [2024-07-04 01:55:02,981: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:02.981778959Z [2024-07-04 01:55:02,981: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:02.981942861Z [2024-07-04 01:55:02,981: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:02.981972521Z [2024-07-04 01:55:02,981: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:55:02.982223961Z [2024-07-04 01:55:02,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:55:02.982276634Z [2024-07-04 01:55:02,982: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:03.107698996Z [2024-07-04 01:55:03,106: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:03.752430480Z [2024-07-04 01:55:03,751: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d076940-cc26-4254-b612-45e7fb6d89b9] succeeded in 2.6881948959999136s: None 2024-07-04T01:55:03.869944056Z [2024-07-04 01:55:03,869: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acad2a09-41d2-43ab-9410-97d7b2b4fab9] received 2024-07-04T01:55:03.878273923Z [2024-07-04 01:55:03,877: INFO/ForkPoolWorker-16] [acad2a09-41d2-43ab-9410-97d7b2b4fab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:04.186524918Z [2024-07-04 01:55:04,183: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:55:04.630124006Z [2024-07-04 01:55:04,629: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d721228-e52e-4693-9c51-09ed48b2e5bd] succeeded in 3.5673468559998582s: None 2024-07-04T01:55:05.017276949Z [2024-07-04 01:55:05,016: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e70a0991-d3f1-4ecf-af28-39c4bccb3ae9] succeeded in 3.939687468000102s: None 2024-07-04T01:55:05.321022662Z [2024-07-04 01:55:05,320: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:55:05.324289993Z [2024-07-04 01:55:05,323: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:05.351021502Z [2024-07-04 01:55:05,350: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:55:05.352309527Z [2024-07-04 01:55:05,352: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:05.352449697Z [2024-07-04 01:55:05,352: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:05.352658238Z [2024-07-04 01:55:05,352: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:05.352779199Z [2024-07-04 01:55:05,352: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:55:05.353051727Z [2024-07-04 01:55:05,352: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:55:05.353207851Z [2024-07-04 01:55:05,353: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:05.470736742Z [2024-07-04 01:55:05,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:06.195860979Z [2024-07-04 01:55:06,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acad2a09-41d2-43ab-9410-97d7b2b4fab9] succeeded in 2.323946909999904s: None 2024-07-04T01:55:06.920313030Z [2024-07-04 01:55:06,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0ca3161-c33e-4cf9-b262-52392a9a4261] received 2024-07-04T01:55:06.932704831Z [2024-07-04 01:55:06,932: INFO/ForkPoolWorker-15] [e0ca3161-c33e-4cf9-b262-52392a9a4261] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T01:55:07.289254134Z [2024-07-04 01:55:07,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:55:08.364452106Z [2024-07-04 01:55:08,364: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:55:08.367957768Z [2024-07-04 01:55:08,367: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:08.396625358Z [2024-07-04 01:55:08,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:55:08.398513966Z [2024-07-04 01:55:08,398: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:08.398797295Z [2024-07-04 01:55:08,398: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:08.399235577Z [2024-07-04 01:55:08,398: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:08.400007524Z [2024-07-04 01:55:08,399: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:55:08.400628415Z [2024-07-04 01:55:08,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:55:08.402006222Z [2024-07-04 01:55:08,401: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:08.505347162Z [2024-07-04 01:55:08,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:09.055609751Z [2024-07-04 01:55:09,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1fd0395c-1395-43b5-bc3b-f76d97d70736] received 2024-07-04T01:55:09.070677617Z [2024-07-04 01:55:09,070: INFO/ForkPoolWorker-16] [1fd0395c-1395-43b5-bc3b-f76d97d70736] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T01:55:09.105829653Z [2024-07-04 01:55:09,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0ca3161-c33e-4cf9-b262-52392a9a4261] succeeded in 2.181922932999896s: None 2024-07-04T01:55:09.367418174Z [2024-07-04 01:55:09,364: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T01:55:10.506520747Z [2024-07-04 01:55:10,506: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:55:10.509834015Z [2024-07-04 01:55:10,509: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:55:10.547490930Z [2024-07-04 01:55:10,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:55:10.549848518Z [2024-07-04 01:55:10,549: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:55:10.549899563Z [2024-07-04 01:55:10,549: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:55:10.550166501Z [2024-07-04 01:55:10,549: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:55:10.550278017Z [2024-07-04 01:55:10,550: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:55:10.550539291Z [2024-07-04 01:55:10,550: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T01:55:10.550593743Z [2024-07-04 01:55:10,550: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:55:10.629989183Z [2024-07-04 01:55:10,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:55:11.271880443Z [2024-07-04 01:55:11,271: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1fd0395c-1395-43b5-bc3b-f76d97d70736] succeeded in 2.2114514840000083s: None 2024-07-04T01:56:01.120015312Z [2024-07-04 01:56:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ccd73b7-1835-4048-b3c1-efad77026326] received 2024-07-04T01:56:01.121720447Z [2024-07-04 01:56:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdca15a7-2c3c-4248-91c5-c731696f4899] received 2024-07-04T01:56:01.134787192Z [2024-07-04 01:56:01,134: INFO/ForkPoolWorker-15] [3ccd73b7-1835-4048-b3c1-efad77026326] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:56:01.148111783Z [2024-07-04 01:56:01,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[750bbc0f-6cab-4e8d-a2c8-3567a00f51a7] received 2024-07-04T01:56:01.149718891Z [2024-07-04 01:56:01,149: INFO/ForkPoolWorker-16] [bdca15a7-2c3c-4248-91c5-c731696f4899] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:56:01.164474461Z [2024-07-04 01:56:01,163: INFO/ForkPoolWorker-1] [750bbc0f-6cab-4e8d-a2c8-3567a00f51a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:56:01.426573597Z [2024-07-04 01:56:01,422: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:56:01.512025513Z [2024-07-04 01:56:01,508: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:56:01.515672339Z [2024-07-04 01:56:01,512: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:56:01.806691657Z [2024-07-04 01:56:01,806: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:56:02.450222399Z [2024-07-04 01:56:02,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bdca15a7-2c3c-4248-91c5-c731696f4899] succeeded in 1.3219180800001595s: None 2024-07-04T01:56:02.622264889Z [2024-07-04 01:56:02,621: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:56:02.625473511Z [2024-07-04 01:56:02,625: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:56:02.654992692Z [2024-07-04 01:56:02,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:56:02.657487861Z [2024-07-04 01:56:02,657: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:56:02.657571403Z [2024-07-04 01:56:02,657: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:56:02.657768302Z [2024-07-04 01:56:02,657: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:56:02.657842356Z [2024-07-04 01:56:02,657: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:56:02.658156725Z [2024-07-04 01:56:02,658: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:56:02.658245935Z [2024-07-04 01:56:02,658: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:56:02.726633609Z [2024-07-04 01:56:02,726: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:56:02.729903947Z [2024-07-04 01:56:02,729: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:56:02.740925505Z [2024-07-04 01:56:02,740: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:56:02.760979835Z [2024-07-04 01:56:02,760: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:56:02.761993434Z [2024-07-04 01:56:02,761: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:56:02.762029998Z [2024-07-04 01:56:02,761: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:56:02.762145445Z [2024-07-04 01:56:02,761: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:56:02.762808191Z [2024-07-04 01:56:02,762: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:56:02.763095967Z [2024-07-04 01:56:02,762: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:56:02.763244940Z [2024-07-04 01:56:02,763: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:56:02.859332144Z [2024-07-04 01:56:02,858: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:56:04.392045851Z [2024-07-04 01:56:04,391: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ccd73b7-1835-4048-b3c1-efad77026326] succeeded in 3.267658888999904s: None 2024-07-04T01:56:04.959208116Z [2024-07-04 01:56:04,958: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[750bbc0f-6cab-4e8d-a2c8-3567a00f51a7] succeeded in 3.805275513000197s: None 2024-07-04T01:57:00.484781692Z [2024-07-04 01:57:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91f581ad-ac11-412f-b867-54186dae6635] received 2024-07-04T01:57:00.487585240Z [2024-07-04 01:57:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[372a1189-29e5-4c36-9eea-868f8d3f8f1f] received 2024-07-04T01:57:00.506843838Z [2024-07-04 01:57:00,506: INFO/ForkPoolWorker-15] [91f581ad-ac11-412f-b867-54186dae6635] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:57:00.516268786Z [2024-07-04 01:57:00,515: INFO/ForkPoolWorker-16] [372a1189-29e5-4c36-9eea-868f8d3f8f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:57:00.826928161Z [2024-07-04 01:57:00,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:57:00.899106518Z [2024-07-04 01:57:00,891: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:57:02.215577957Z [2024-07-04 01:57:02,215: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:57:02.219532319Z [2024-07-04 01:57:02,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:57:02.247289041Z [2024-07-04 01:57:02,247: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:57:02.249383943Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:57:02.249398575Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:57:02.249532138Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:57:02.249566500Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:57:02.249821090Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:57:02.249851646Z [2024-07-04 01:57:02,249: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:57:02.298485307Z [2024-07-04 01:57:02,298: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:57:02.301836564Z [2024-07-04 01:57:02,301: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:57:02.333821483Z [2024-07-04 01:57:02,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:57:02.337126468Z [2024-07-04 01:57:02,336: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:57:02.338768603Z [2024-07-04 01:57:02,338: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:57:02.338791562Z [2024-07-04 01:57:02,338: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:57:02.339000921Z [2024-07-04 01:57:02,338: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:57:02.339030379Z [2024-07-04 01:57:02,338: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:57:02.339308373Z [2024-07-04 01:57:02,339: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:57:02.339361489Z [2024-07-04 01:57:02,339: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:57:02.461141400Z [2024-07-04 01:57:02,460: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:57:04.228331423Z [2024-07-04 01:57:04,227: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91f581ad-ac11-412f-b867-54186dae6635] succeeded in 3.737095861999933s: None 2024-07-04T01:57:04.608064878Z [2024-07-04 01:57:04,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[372a1189-29e5-4c36-9eea-868f8d3f8f1f] succeeded in 4.1176391690000855s: None 2024-07-04T01:58:00.755232721Z [2024-07-04 01:58:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bf37e79-8bd1-41cd-85fd-5c7fe1ba878e] received 2024-07-04T01:58:00.761410446Z [2024-07-04 01:58:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ffffdab-7385-4a18-93a5-9f35e7c80afa] received 2024-07-04T01:58:00.777479971Z [2024-07-04 01:58:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f34257f-1e4e-4b92-a52e-1e0c5ea90451] received 2024-07-04T01:58:00.778758249Z [2024-07-04 01:58:00,778: INFO/ForkPoolWorker-15] [4bf37e79-8bd1-41cd-85fd-5c7fe1ba878e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T01:58:00.787200089Z [2024-07-04 01:58:00,786: INFO/ForkPoolWorker-16] [5ffffdab-7385-4a18-93a5-9f35e7c80afa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:58:00.831902559Z [2024-07-04 01:58:00,831: INFO/ForkPoolWorker-1] [5f34257f-1e4e-4b92-a52e-1e0c5ea90451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:58:01.260868103Z [2024-07-04 01:58:01,256: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:58:01.342632985Z [2024-07-04 01:58:01,337: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T01:58:01.344046789Z [2024-07-04 01:58:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:58:01.653267848Z [2024-07-04 01:58:01,652: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:58:02.313216234Z [2024-07-04 01:58:02,312: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bf37e79-8bd1-41cd-85fd-5c7fe1ba878e] succeeded in 1.549361337999926s: None 2024-07-04T01:58:02.609894262Z [2024-07-04 01:58:02,609: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T01:58:02.613211440Z [2024-07-04 01:58:02,612: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:58:02.657031947Z [2024-07-04 01:58:02,656: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T01:58:02.658248956Z [2024-07-04 01:58:02,658: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:58:02.658407695Z [2024-07-04 01:58:02,658: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:58:02.658599853Z [2024-07-04 01:58:02,658: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:58:02.658735678Z [2024-07-04 01:58:02,658: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T01:58:02.659017144Z [2024-07-04 01:58:02,658: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:58:02.659101239Z [2024-07-04 01:58:02,659: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:58:02.745828318Z [2024-07-04 01:58:02,745: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:58:02.749367290Z [2024-07-04 01:58:02,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:58:02.752056583Z [2024-07-04 01:58:02,751: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:58:02.773598387Z [2024-07-04 01:58:02,773: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:58:02.774857700Z [2024-07-04 01:58:02,774: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:58:02.774916406Z [2024-07-04 01:58:02,774: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:58:02.775042459Z [2024-07-04 01:58:02,774: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:58:02.775051298Z [2024-07-04 01:58:02,774: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:58:02.775296194Z [2024-07-04 01:58:02,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:58:02.775320915Z [2024-07-04 01:58:02,775: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:58:02.894695643Z [2024-07-04 01:58:02,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:58:04.336428120Z [2024-07-04 01:58:04,335: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f34257f-1e4e-4b92-a52e-1e0c5ea90451] succeeded in 3.555292344999998s: None 2024-07-04T01:58:05.556784873Z [2024-07-04 01:58:05,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ffffdab-7385-4a18-93a5-9f35e7c80afa] succeeded in 4.790406978999727s: None 2024-07-04T01:59:00.965750428Z [2024-07-04 01:59:00,959: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62f99aaf-edfc-4c68-85c5-b76ee788019e] received 2024-07-04T01:59:00.980629598Z [2024-07-04 01:59:00,980: INFO/ForkPoolWorker-15] [62f99aaf-edfc-4c68-85c5-b76ee788019e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T01:59:00.985834276Z [2024-07-04 01:59:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a299956-fc95-49d9-a88c-68a2dcbb9342] received 2024-07-04T01:59:01.036826401Z [2024-07-04 01:59:01,036: INFO/ForkPoolWorker-16] [0a299956-fc95-49d9-a88c-68a2dcbb9342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T01:59:01.374148346Z [2024-07-04 01:59:01,370: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T01:59:01.431501465Z [2024-07-04 01:59:01,427: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T01:59:02.614124778Z [2024-07-04 01:59:02,613: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T01:59:02.617521465Z [2024-07-04 01:59:02,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:59:02.645589737Z [2024-07-04 01:59:02,645: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T01:59:02.650741636Z [2024-07-04 01:59:02,650: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T01:59:02.660070323Z [2024-07-04 01:59:02,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T01:59:02.661743008Z [2024-07-04 01:59:02,661: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:59:02.661762434Z [2024-07-04 01:59:02,661: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:59:02.662000029Z [2024-07-04 01:59:02,661: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:59:02.662160237Z [2024-07-04 01:59:02,662: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T01:59:02.663087412Z [2024-07-04 01:59:02,662: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T01:59:02.663216195Z [2024-07-04 01:59:02,663: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:59:02.678795565Z [2024-07-04 01:59:02,677: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T01:59:02.680873377Z [2024-07-04 01:59:02,680: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T01:59:02.680891289Z [2024-07-04 01:59:02,680: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T01:59:02.681005186Z [2024-07-04 01:59:02,680: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T01:59:02.681047334Z [2024-07-04 01:59:02,680: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T01:59:02.681285069Z [2024-07-04 01:59:02,681: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T01:59:02.682475942Z [2024-07-04 01:59:02,682: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T01:59:02.766464377Z [2024-07-04 01:59:02,766: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:59:02.788775163Z [2024-07-04 01:59:02,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T01:59:04.886628026Z [2024-07-04 01:59:04,885: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62f99aaf-edfc-4c68-85c5-b76ee788019e] succeeded in 3.9154077599996526s: None 2024-07-04T01:59:05.549562245Z [2024-07-04 01:59:05,548: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0a299956-fc95-49d9-a88c-68a2dcbb9342] succeeded in 4.552392850999695s: None 2024-07-04T02:00:01.324641617Z [2024-07-04 02:00:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceb2917f-3066-4f64-b373-8d217ddcd034] received 2024-07-04T02:00:01.331355807Z [2024-07-04 02:00:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aefb3bf6-130e-46df-a9bd-c88bfa01fff9] received 2024-07-04T02:00:01.332647717Z [2024-07-04 02:00:01,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1893745-91de-4928-ad45-9bd07b4d1571] received 2024-07-04T02:00:01.336195699Z [2024-07-04 02:00:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[179cdfa1-3a54-4232-bdc1-28850453909a] received 2024-07-04T02:00:01.351104579Z [2024-07-04 02:00:01,350: INFO/ForkPoolWorker-2] [179cdfa1-3a54-4232-bdc1-28850453909a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:00:01.358368358Z [2024-07-04 02:00:01,357: INFO/ForkPoolWorker-1] [c1893745-91de-4928-ad45-9bd07b4d1571] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:00:01.358485282Z [2024-07-04 02:00:01,358: INFO/ForkPoolWorker-15] [ceb2917f-3066-4f64-b373-8d217ddcd034] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:01.381616224Z [2024-07-04 02:00:01,380: INFO/ForkPoolWorker-16] [aefb3bf6-130e-46df-a9bd-c88bfa01fff9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:00:01.719961496Z [2024-07-04 02:00:01,715: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:00:01.805324997Z [2024-07-04 02:00:01,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:00:01.844643178Z [2024-07-04 02:00:01,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:00:01.897886920Z [2024-07-04 02:00:01,870: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:00:02.234541884Z [2024-07-04 02:00:02,234: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:03.141823180Z [2024-07-04 02:00:03,141: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1893745-91de-4928-ad45-9bd07b4d1571] succeeded in 1.8060991709999143s: None 2024-07-04T02:00:03.236063945Z [2024-07-04 02:00:03,235: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:00:03.239751051Z [2024-07-04 02:00:03,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:03.243270665Z [2024-07-04 02:00:03,242: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:00:03.246670116Z [2024-07-04 02:00:03,246: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:03.264710415Z [2024-07-04 02:00:03,264: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:00:03.265708530Z [2024-07-04 02:00:03,265: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:03.265724659Z [2024-07-04 02:00:03,265: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:03.265852401Z [2024-07-04 02:00:03,265: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:03.265874435Z [2024-07-04 02:00:03,265: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:00:03.266076304Z [2024-07-04 02:00:03,265: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:00:03.266120866Z [2024-07-04 02:00:03,266: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:03.300285727Z [2024-07-04 02:00:03,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:00:03.304419720Z [2024-07-04 02:00:03,303: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:03.304578060Z [2024-07-04 02:00:03,304: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:03.305499718Z [2024-07-04 02:00:03,305: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:03.305851320Z [2024-07-04 02:00:03,305: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:00:03.306354381Z [2024-07-04 02:00:03,306: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:00:03.307146830Z [2024-07-04 02:00:03,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:03.344289680Z [2024-07-04 02:00:03,344: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:03.404751449Z [2024-07-04 02:00:03,404: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:03.500251275Z [2024-07-04 02:00:03,499: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:00:03.503653082Z [2024-07-04 02:00:03,503: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:03.553924659Z [2024-07-04 02:00:03,553: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:00:03.557200796Z [2024-07-04 02:00:03,556: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:03.557279416Z [2024-07-04 02:00:03,557: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:03.557464054Z [2024-07-04 02:00:03,557: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:03.557541192Z [2024-07-04 02:00:03,557: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:00:03.557780033Z [2024-07-04 02:00:03,557: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:00:03.557817834Z [2024-07-04 02:00:03,557: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:03.671594964Z [2024-07-04 02:00:03,671: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:04.221766681Z [2024-07-04 02:00:04,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ceb2917f-3066-4f64-b373-8d217ddcd034] succeeded in 2.890759922000143s: None 2024-07-04T02:00:05.190966922Z [2024-07-04 02:00:05,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10b726c7-9d3b-43ca-b6c5-571f8aaa8c3b] received 2024-07-04T02:00:05.203379911Z [2024-07-04 02:00:05,203: INFO/ForkPoolWorker-15] [10b726c7-9d3b-43ca-b6c5-571f8aaa8c3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:05.531618275Z [2024-07-04 02:00:05,531: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[179cdfa1-3a54-4232-bdc1-28850453909a] succeeded in 4.19203359400035s: None 2024-07-04T02:00:05.536340614Z [2024-07-04 02:00:05,524: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:00:05.556862747Z [2024-07-04 02:00:05,556: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aefb3bf6-130e-46df-a9bd-c88bfa01fff9] succeeded in 4.221181677000004s: None 2024-07-04T02:00:06.696991253Z [2024-07-04 02:00:06,696: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:00:06.700420426Z [2024-07-04 02:00:06,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:06.726750931Z [2024-07-04 02:00:06,726: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:00:06.729193031Z [2024-07-04 02:00:06,728: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:06.729220275Z [2024-07-04 02:00:06,729: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:06.729361409Z [2024-07-04 02:00:06,729: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:06.729543397Z [2024-07-04 02:00:06,729: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:00:06.729953514Z [2024-07-04 02:00:06,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:00:06.729962356Z [2024-07-04 02:00:06,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:06.817331894Z [2024-07-04 02:00:06,816: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:07.568895615Z [2024-07-04 02:00:07,568: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[10b726c7-9d3b-43ca-b6c5-571f8aaa8c3b] succeeded in 2.372176585000034s: None 2024-07-04T02:00:07.600929510Z [2024-07-04 02:00:07,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[717405e1-2de2-4690-b77e-4707aff63e84] received 2024-07-04T02:00:07.610225200Z [2024-07-04 02:00:07,609: INFO/ForkPoolWorker-15] [717405e1-2de2-4690-b77e-4707aff63e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:00:07.894012306Z [2024-07-04 02:00:07,890: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:00:08.996975041Z [2024-07-04 02:00:08,996: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:00:09.000430709Z [2024-07-04 02:00:08,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:09.036532152Z [2024-07-04 02:00:09,036: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:00:09.039059324Z [2024-07-04 02:00:09,038: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:09.039364300Z [2024-07-04 02:00:09,039: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:09.039786862Z [2024-07-04 02:00:09,039: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:09.040018501Z [2024-07-04 02:00:09,039: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:00:09.040619759Z [2024-07-04 02:00:09,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:00:09.041610205Z [2024-07-04 02:00:09,040: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:09.168653633Z [2024-07-04 02:00:09,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:09.799029118Z [2024-07-04 02:00:09,797: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[717405e1-2de2-4690-b77e-4707aff63e84] succeeded in 2.194185189000109s: None 2024-07-04T02:00:10.278140879Z [2024-07-04 02:00:10,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22fc51e9-3e95-4474-a68b-75ae10a5f372] received 2024-07-04T02:00:10.289681492Z [2024-07-04 02:00:10,289: INFO/ForkPoolWorker-15] [22fc51e9-3e95-4474-a68b-75ae10a5f372] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:00:10.627065023Z [2024-07-04 02:00:10,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:00:11.850990954Z [2024-07-04 02:00:11,850: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:00:11.855859473Z [2024-07-04 02:00:11,853: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:00:11.934989762Z [2024-07-04 02:00:11,934: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:00:11.940003874Z [2024-07-04 02:00:11,935: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:00:11.940034953Z [2024-07-04 02:00:11,935: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:00:11.940042907Z [2024-07-04 02:00:11,935: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:00:11.940062053Z [2024-07-04 02:00:11,936: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:00:11.940067382Z [2024-07-04 02:00:11,936: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:00:11.940072963Z [2024-07-04 02:00:11,936: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:00:12.043501040Z [2024-07-04 02:00:12,043: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:00:12.691035160Z [2024-07-04 02:00:12,690: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22fc51e9-3e95-4474-a68b-75ae10a5f372] succeeded in 2.4107966660003513s: None 2024-07-04T02:01:00.417759895Z [2024-07-04 02:01:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d94543b-feb9-4f95-a2fe-66a1a948b9c8] received 2024-07-04T02:01:00.433252624Z [2024-07-04 02:01:00,432: INFO/ForkPoolWorker-15] [0d94543b-feb9-4f95-a2fe-66a1a948b9c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:01:00.436371892Z [2024-07-04 02:01:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fe9038a-e863-4048-9e06-facfa5dc04f6] received 2024-07-04T02:01:00.459970267Z [2024-07-04 02:01:00,459: INFO/ForkPoolWorker-16] [3fe9038a-e863-4048-9e06-facfa5dc04f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:01:00.902468978Z [2024-07-04 02:01:00,899: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:01:00.956725200Z [2024-07-04 02:01:00,953: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:01:02.101078314Z [2024-07-04 02:01:02,100: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:01:02.104637183Z [2024-07-04 02:01:02,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:01:02.110639693Z [2024-07-04 02:01:02,110: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:01:02.114003908Z [2024-07-04 02:01:02,113: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:01:02.141104602Z [2024-07-04 02:01:02,140: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:01:02.142437037Z [2024-07-04 02:01:02,142: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:01:02.142505022Z [2024-07-04 02:01:02,142: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:01:02.142694204Z [2024-07-04 02:01:02,142: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:01:02.142758735Z [2024-07-04 02:01:02,142: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:01:02.143102912Z [2024-07-04 02:01:02,142: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:01:02.143179423Z [2024-07-04 02:01:02,143: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:01:02.155608028Z [2024-07-04 02:01:02,155: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:01:02.159431809Z [2024-07-04 02:01:02,159: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:01:02.159462870Z [2024-07-04 02:01:02,159: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:01:02.163275495Z [2024-07-04 02:01:02,159: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:01:02.163551102Z [2024-07-04 02:01:02,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:01:02.164039358Z [2024-07-04 02:01:02,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:01:02.164050065Z [2024-07-04 02:01:02,163: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:01:02.223098016Z [2024-07-04 02:01:02,221: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:01:02.294115990Z [2024-07-04 02:01:02,293: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:01:03.871828279Z [2024-07-04 02:01:03,871: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3fe9038a-e863-4048-9e06-facfa5dc04f6] succeeded in 3.433542514000237s: None 2024-07-04T02:01:04.721312798Z [2024-07-04 02:01:04,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d94543b-feb9-4f95-a2fe-66a1a948b9c8] succeeded in 4.301269429000058s: None 2024-07-04T02:02:00.846033526Z [2024-07-04 02:02:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d074a1d2-ea40-4173-946f-c85f3badfb47] received 2024-07-04T02:02:00.849766679Z [2024-07-04 02:02:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c813dea-211a-481f-a215-dbb281a684b3] received 2024-07-04T02:02:00.864039072Z [2024-07-04 02:02:00,863: INFO/ForkPoolWorker-16] [3c813dea-211a-481f-a215-dbb281a684b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:02:00.865165592Z [2024-07-04 02:02:00,864: INFO/ForkPoolWorker-15] [d074a1d2-ea40-4173-946f-c85f3badfb47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:02:00.876671973Z [2024-07-04 02:02:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33e86396-0637-41d3-8371-4ff9fbc71e43] received 2024-07-04T02:02:00.903926049Z [2024-07-04 02:02:00,903: INFO/ForkPoolWorker-1] [33e86396-0637-41d3-8371-4ff9fbc71e43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:02:01.237311213Z [2024-07-04 02:02:01,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:02:01.273259338Z [2024-07-04 02:02:01,269: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:02:01.289880708Z [2024-07-04 02:02:01,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:02:01.578810627Z [2024-07-04 02:02:01,578: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:02:02.199551084Z [2024-07-04 02:02:02,199: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c813dea-211a-481f-a215-dbb281a684b3] succeeded in 1.3468658040001174s: None 2024-07-04T02:02:02.411137048Z [2024-07-04 02:02:02,410: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:02:02.414353325Z [2024-07-04 02:02:02,413: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:02:02.440894772Z [2024-07-04 02:02:02,440: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:02:02.442184862Z [2024-07-04 02:02:02,441: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:02:02.442349624Z [2024-07-04 02:02:02,442: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:02:02.444309709Z [2024-07-04 02:02:02,444: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:02:02.445124807Z [2024-07-04 02:02:02,444: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:02:02.446259298Z [2024-07-04 02:02:02,446: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:02:02.447037685Z [2024-07-04 02:02:02,446: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:02:02.510543162Z [2024-07-04 02:02:02,510: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:02:02.516815187Z [2024-07-04 02:02:02,516: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:02:02.520823501Z [2024-07-04 02:02:02,520: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:02:02.554626397Z [2024-07-04 02:02:02,554: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:02:02.557273915Z [2024-07-04 02:02:02,556: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:02:02.557331057Z [2024-07-04 02:02:02,557: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:02:02.557637946Z [2024-07-04 02:02:02,557: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:02:02.557743148Z [2024-07-04 02:02:02,557: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:02:02.558066272Z [2024-07-04 02:02:02,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:02:02.558158151Z [2024-07-04 02:02:02,558: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:02:02.645055143Z [2024-07-04 02:02:02,644: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:02:04.036146143Z [2024-07-04 02:02:04,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33e86396-0637-41d3-8371-4ff9fbc71e43] succeeded in 3.151656804999675s: None 2024-07-04T02:02:04.810185854Z [2024-07-04 02:02:04,809: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d074a1d2-ea40-4173-946f-c85f3badfb47] succeeded in 3.9598263459997725s: None 2024-07-04T02:03:01.143967720Z [2024-07-04 02:03:01,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68e0af21-7d13-43a3-9cab-8a8d394b71e0] received 2024-07-04T02:03:01.151706088Z [2024-07-04 02:03:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d85fbac-fcec-4ba1-95fd-5f21fc1727ad] received 2024-07-04T02:03:01.168123939Z [2024-07-04 02:03:01,167: INFO/ForkPoolWorker-15] [68e0af21-7d13-43a3-9cab-8a8d394b71e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:03:01.172440859Z [2024-07-04 02:03:01,172: INFO/ForkPoolWorker-16] [3d85fbac-fcec-4ba1-95fd-5f21fc1727ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:03:01.456339054Z [2024-07-04 02:03:01,452: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:03:01.466969293Z [2024-07-04 02:03:01,462: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:03:02.723961045Z [2024-07-04 02:03:02,723: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:03:02.724358903Z [2024-07-04 02:03:02,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:03:02.727312859Z [2024-07-04 02:03:02,726: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:03:02.727871292Z [2024-07-04 02:03:02,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:03:02.759368007Z [2024-07-04 02:03:02,759: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:03:02.763750648Z [2024-07-04 02:03:02,763: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:03:02.763778933Z [2024-07-04 02:03:02,763: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:03:02.763955304Z [2024-07-04 02:03:02,763: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:03:02.763995271Z [2024-07-04 02:03:02,763: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:03:02.766196358Z [2024-07-04 02:03:02,765: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:03:02.766290482Z [2024-07-04 02:03:02,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:03:02.766335588Z [2024-07-04 02:03:02,766: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:03:02.768437834Z [2024-07-04 02:03:02,768: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:03:02.768459238Z [2024-07-04 02:03:02,768: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:03:02.768974329Z [2024-07-04 02:03:02,768: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:03:02.769046567Z [2024-07-04 02:03:02,768: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:03:02.771005429Z [2024-07-04 02:03:02,769: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:03:02.771124185Z [2024-07-04 02:03:02,770: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:03:02.866316553Z [2024-07-04 02:03:02,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:03:02.871945256Z [2024-07-04 02:03:02,871: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:03:04.721695423Z [2024-07-04 02:03:04,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d85fbac-fcec-4ba1-95fd-5f21fc1727ad] succeeded in 3.563599979999708s: None 2024-07-04T02:03:05.633274075Z [2024-07-04 02:03:05,632: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68e0af21-7d13-43a3-9cab-8a8d394b71e0] succeeded in 4.482139966999966s: None 2024-07-04T02:04:00.532859680Z [2024-07-04 02:04:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5966ba3c-f257-4167-a72d-9332b32223d8] received 2024-07-04T02:04:00.535421755Z [2024-07-04 02:04:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7d5dfa8-5e59-4391-ab58-592539c7da56] received 2024-07-04T02:04:00.551250913Z [2024-07-04 02:04:00,550: INFO/ForkPoolWorker-15] [5966ba3c-f257-4167-a72d-9332b32223d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:04:00.555669652Z [2024-07-04 02:04:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bc7e4e0-3b36-494d-9198-4347f970b414] received 2024-07-04T02:04:00.560474384Z [2024-07-04 02:04:00,560: INFO/ForkPoolWorker-16] [f7d5dfa8-5e59-4391-ab58-592539c7da56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:04:00.578237280Z [2024-07-04 02:04:00,577: INFO/ForkPoolWorker-1] [8bc7e4e0-3b36-494d-9198-4347f970b414] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:04:01.001434771Z [2024-07-04 02:04:00,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:04:01.032131780Z [2024-07-04 02:04:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:04:01.061470203Z [2024-07-04 02:04:01,049: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:04:01.324283154Z [2024-07-04 02:04:01,324: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:04:01.927620767Z [2024-07-04 02:04:01,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5966ba3c-f257-4167-a72d-9332b32223d8] succeeded in 1.389916711999831s: None 2024-07-04T02:04:02.398659864Z [2024-07-04 02:04:02,398: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:04:02.403332055Z [2024-07-04 02:04:02,402: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:04:02.407348927Z [2024-07-04 02:04:02,407: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:04:02.410705970Z [2024-07-04 02:04:02,410: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:04:02.434205641Z [2024-07-04 02:04:02,433: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:04:02.436462773Z [2024-07-04 02:04:02,436: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:04:02.436719952Z [2024-07-04 02:04:02,436: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:04:02.436919568Z [2024-07-04 02:04:02,436: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:04:02.437061311Z [2024-07-04 02:04:02,436: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:04:02.438013131Z [2024-07-04 02:04:02,437: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:04:02.438156352Z [2024-07-04 02:04:02,437: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:04:02.440254620Z [2024-07-04 02:04:02,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:04:02.441761040Z [2024-07-04 02:04:02,441: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:04:02.441874685Z [2024-07-04 02:04:02,441: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:04:02.442119318Z [2024-07-04 02:04:02,441: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:04:02.442192421Z [2024-07-04 02:04:02,442: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:04:02.443469054Z [2024-07-04 02:04:02,443: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:04:02.443484791Z [2024-07-04 02:04:02,443: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:04:02.532531319Z [2024-07-04 02:04:02,532: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:04:02.533882594Z [2024-07-04 02:04:02,533: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:04:04.051591957Z [2024-07-04 02:04:04,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f7d5dfa8-5e59-4391-ab58-592539c7da56] succeeded in 3.5096797179999157s: None 2024-07-04T02:04:04.319268743Z [2024-07-04 02:04:04,318: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bc7e4e0-3b36-494d-9198-4347f970b414] succeeded in 3.756509335999908s: None 2024-07-04T02:05:00.958857430Z [2024-07-04 02:05:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ef3f60b-65ab-48a0-8655-7fd689709832] received 2024-07-04T02:05:00.963865653Z [2024-07-04 02:05:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e65aa19b-d622-4a59-83b9-3bb148ce1dda] received 2024-07-04T02:05:00.969597415Z [2024-07-04 02:05:00,969: INFO/ForkPoolWorker-15] [4ef3f60b-65ab-48a0-8655-7fd689709832] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:05:00.971434501Z [2024-07-04 02:05:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bea72b9-0be5-45ff-9464-16237f806d99] received 2024-07-04T02:05:00.973337187Z [2024-07-04 02:05:00,972: INFO/ForkPoolWorker-16] [e65aa19b-d622-4a59-83b9-3bb148ce1dda] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:05:00.987746297Z [2024-07-04 02:05:00,987: INFO/ForkPoolWorker-1] [0bea72b9-0be5-45ff-9464-16237f806d99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:01.283235895Z [2024-07-04 02:05:01,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:05:01.292703358Z [2024-07-04 02:05:01,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:05:01.359958359Z [2024-07-04 02:05:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:05:02.474762314Z [2024-07-04 02:05:02,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:05:02.478207536Z [2024-07-04 02:05:02,477: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:02.516965972Z [2024-07-04 02:05:02,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:05:02.519131687Z [2024-07-04 02:05:02,518: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:02.519148047Z [2024-07-04 02:05:02,519: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:02.519252373Z [2024-07-04 02:05:02,519: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:02.519330027Z [2024-07-04 02:05:02,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:05:02.520053870Z [2024-07-04 02:05:02,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:05:02.520081536Z [2024-07-04 02:05:02,520: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:02.541588333Z [2024-07-04 02:05:02,541: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:05:02.545016120Z [2024-07-04 02:05:02,544: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:02.600410575Z [2024-07-04 02:05:02,599: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:02.600954618Z [2024-07-04 02:05:02,600: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:05:02.611787575Z [2024-07-04 02:05:02,611: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:02.611888451Z [2024-07-04 02:05:02,611: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:02.611962997Z [2024-07-04 02:05:02,611: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:02.612063656Z [2024-07-04 02:05:02,611: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:05:02.612345556Z [2024-07-04 02:05:02,612: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:05:02.612376716Z [2024-07-04 02:05:02,612: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:02.673339326Z [2024-07-04 02:05:02,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:05:02.677279305Z [2024-07-04 02:05:02,676: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:02.697614963Z [2024-07-04 02:05:02,697: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:02.709180792Z [2024-07-04 02:05:02,708: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:05:02.710332029Z [2024-07-04 02:05:02,710: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:02.710515289Z [2024-07-04 02:05:02,710: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:02.710705352Z [2024-07-04 02:05:02,710: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:02.710774545Z [2024-07-04 02:05:02,710: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:05:02.711170631Z [2024-07-04 02:05:02,710: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:05:02.711255909Z [2024-07-04 02:05:02,711: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:02.783857706Z [2024-07-04 02:05:02,783: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:03.460208501Z [2024-07-04 02:05:03,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0bea72b9-0be5-45ff-9464-16237f806d99] succeeded in 2.4839065509995635s: None 2024-07-04T02:05:03.931466529Z [2024-07-04 02:05:03,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2275659d-1af3-4b56-82b3-de1f67ca859e] received 2024-07-04T02:05:03.945171098Z [2024-07-04 02:05:03,944: INFO/ForkPoolWorker-1] [2275659d-1af3-4b56-82b3-de1f67ca859e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:04.250710258Z [2024-07-04 02:05:04,247: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:05:04.357654171Z [2024-07-04 02:05:04,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ef3f60b-65ab-48a0-8655-7fd689709832] succeeded in 3.3960742939998454s: None 2024-07-04T02:05:04.601861516Z [2024-07-04 02:05:04,600: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e65aa19b-d622-4a59-83b9-3bb148ce1dda] succeeded in 3.6346005250002236s: None 2024-07-04T02:05:05.411944579Z [2024-07-04 02:05:05,411: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:05:05.415209271Z [2024-07-04 02:05:05,414: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:05.448670264Z [2024-07-04 02:05:05,448: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:05:05.454013844Z [2024-07-04 02:05:05,453: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:05.454320413Z [2024-07-04 02:05:05,453: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:05.454803322Z [2024-07-04 02:05:05,454: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:05.455026779Z [2024-07-04 02:05:05,454: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:05:05.455737350Z [2024-07-04 02:05:05,455: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:05:05.456502534Z [2024-07-04 02:05:05,455: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:05.559798685Z [2024-07-04 02:05:05,559: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:06.309657267Z [2024-07-04 02:05:06,309: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2275659d-1af3-4b56-82b3-de1f67ca859e] succeeded in 2.3751833640003497s: None 2024-07-04T02:05:06.414408207Z [2024-07-04 02:05:06,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fabbfa5-42b7-41fb-8916-11bdfe043d86] received 2024-07-04T02:05:06.426693938Z [2024-07-04 02:05:06,426: INFO/ForkPoolWorker-15] [9fabbfa5-42b7-41fb-8916-11bdfe043d86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:05:06.696559206Z [2024-07-04 02:05:06,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:05:07.796144489Z [2024-07-04 02:05:07,795: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:05:07.799561902Z [2024-07-04 02:05:07,799: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:07.824664295Z [2024-07-04 02:05:07,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:05:07.826748089Z [2024-07-04 02:05:07,826: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:07.826938057Z [2024-07-04 02:05:07,826: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:07.827194496Z [2024-07-04 02:05:07,826: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:07.827368149Z [2024-07-04 02:05:07,827: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:05:07.828136405Z [2024-07-04 02:05:07,827: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:05:07.828530559Z [2024-07-04 02:05:07,828: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:07.926000455Z [2024-07-04 02:05:07,925: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:08.532313785Z [2024-07-04 02:05:08,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fabbfa5-42b7-41fb-8916-11bdfe043d86] succeeded in 2.114850147999732s: None 2024-07-04T02:05:08.787597028Z [2024-07-04 02:05:08,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b8868ad-7de2-4d28-8a20-dfb322daf789] received 2024-07-04T02:05:08.801800889Z [2024-07-04 02:05:08,801: INFO/ForkPoolWorker-15] [3b8868ad-7de2-4d28-8a20-dfb322daf789] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:05:09.094614971Z [2024-07-04 02:05:09,091: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:05:10.446981746Z [2024-07-04 02:05:10,446: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:05:10.452711436Z [2024-07-04 02:05:10,452: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:05:10.501171719Z [2024-07-04 02:05:10,500: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:05:10.502595907Z [2024-07-04 02:05:10,502: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:05:10.502656751Z [2024-07-04 02:05:10,502: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:05:10.502919420Z [2024-07-04 02:05:10,502: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:05:10.503011876Z [2024-07-04 02:05:10,502: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:05:10.503420250Z [2024-07-04 02:05:10,503: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:05:10.503487709Z [2024-07-04 02:05:10,503: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:05:10.624395157Z [2024-07-04 02:05:10,623: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:05:11.299016593Z [2024-07-04 02:05:11,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b8868ad-7de2-4d28-8a20-dfb322daf789] succeeded in 2.5093989849997342s: None 2024-07-04T02:06:00.278339850Z [2024-07-04 02:06:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bca6b560-2d0f-4891-8041-e5137bb74679] received 2024-07-04T02:06:00.281806002Z [2024-07-04 02:06:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31dea2a8-55fd-4c34-ba99-7b015e7f3323] received 2024-07-04T02:06:00.291386904Z [2024-07-04 02:06:00,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ce6449c-f9b9-4279-84c2-7f4eb09f02c3] received 2024-07-04T02:06:00.313387479Z [2024-07-04 02:06:00,313: INFO/ForkPoolWorker-15] [bca6b560-2d0f-4891-8041-e5137bb74679] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:06:00.317101111Z [2024-07-04 02:06:00,316: INFO/ForkPoolWorker-16] [31dea2a8-55fd-4c34-ba99-7b015e7f3323] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:06:00.339982392Z [2024-07-04 02:06:00,339: INFO/ForkPoolWorker-1] [1ce6449c-f9b9-4279-84c2-7f4eb09f02c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:06:00.719465471Z [2024-07-04 02:06:00,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:06:00.826633153Z [2024-07-04 02:06:00,823: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:06:00.834087874Z [2024-07-04 02:06:00,829: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:06:01.104606331Z [2024-07-04 02:06:01,104: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:06:01.726361347Z [2024-07-04 02:06:01,725: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[31dea2a8-55fd-4c34-ba99-7b015e7f3323] succeeded in 1.4402254960000391s: None 2024-07-04T02:06:02.215393978Z [2024-07-04 02:06:02,214: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:06:02.218802585Z [2024-07-04 02:06:02,218: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:06:02.254775298Z [2024-07-04 02:06:02,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:06:02.257755168Z [2024-07-04 02:06:02,257: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:06:02.257813029Z [2024-07-04 02:06:02,257: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:06:02.258012471Z [2024-07-04 02:06:02,257: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:06:02.259030867Z [2024-07-04 02:06:02,258: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:06:02.260000924Z [2024-07-04 02:06:02,259: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:06:02.260046540Z [2024-07-04 02:06:02,259: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:06:02.360191764Z [2024-07-04 02:06:02,359: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:06:02.381360240Z [2024-07-04 02:06:02,380: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:06:02.385086367Z [2024-07-04 02:06:02,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:06:02.417143144Z [2024-07-04 02:06:02,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:06:02.418486442Z [2024-07-04 02:06:02,418: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:06:02.418571378Z [2024-07-04 02:06:02,418: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:06:02.418729142Z [2024-07-04 02:06:02,418: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:06:02.418800908Z [2024-07-04 02:06:02,418: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:06:02.419137170Z [2024-07-04 02:06:02,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:06:02.419267323Z [2024-07-04 02:06:02,419: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:06:02.520523702Z [2024-07-04 02:06:02,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:06:04.067870926Z [2024-07-04 02:06:04,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bca6b560-2d0f-4891-8041-e5137bb74679] succeeded in 3.7853689860003215s: None 2024-07-04T02:06:04.328504048Z [2024-07-04 02:06:04,328: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1ce6449c-f9b9-4279-84c2-7f4eb09f02c3] succeeded in 4.034144271000059s: None 2024-07-04T02:07:00.818402530Z [2024-07-04 02:07:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cefaf9a1-2bc7-4781-a955-6578428ac74e] received 2024-07-04T02:07:00.831453885Z [2024-07-04 02:07:00,831: INFO/ForkPoolWorker-15] [cefaf9a1-2bc7-4781-a955-6578428ac74e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:07:00.842386547Z [2024-07-04 02:07:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39864c62-7f1f-47a7-90cb-cbfa1cc37456] received 2024-07-04T02:07:00.860477035Z [2024-07-04 02:07:00,859: INFO/ForkPoolWorker-16] [39864c62-7f1f-47a7-90cb-cbfa1cc37456] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:07:01.287870055Z [2024-07-04 02:07:01,283: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:07:01.327764506Z [2024-07-04 02:07:01,321: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:07:02.473782776Z [2024-07-04 02:07:02,473: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:07:02.477071113Z [2024-07-04 02:07:02,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:07:02.516920748Z [2024-07-04 02:07:02,516: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:07:02.518712758Z [2024-07-04 02:07:02,518: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:07:02.518730796Z [2024-07-04 02:07:02,518: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:07:02.518956281Z [2024-07-04 02:07:02,518: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:07:02.518982228Z [2024-07-04 02:07:02,518: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:07:02.519292947Z [2024-07-04 02:07:02,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:07:02.519303003Z [2024-07-04 02:07:02,519: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:07:02.570374707Z [2024-07-04 02:07:02,569: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:07:02.582920642Z [2024-07-04 02:07:02,579: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:07:02.603036099Z [2024-07-04 02:07:02,602: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:07:02.671248425Z [2024-07-04 02:07:02,669: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:07:02.675993827Z [2024-07-04 02:07:02,675: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:07:02.676172492Z [2024-07-04 02:07:02,675: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:07:02.676465409Z [2024-07-04 02:07:02,676: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:07:02.676625416Z [2024-07-04 02:07:02,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:07:02.677187446Z [2024-07-04 02:07:02,676: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:07:02.677342267Z [2024-07-04 02:07:02,677: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:07:02.804669997Z [2024-07-04 02:07:02,804: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:07:04.997862304Z [2024-07-04 02:07:04,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cefaf9a1-2bc7-4781-a955-6578428ac74e] succeeded in 4.17334259800009s: None 2024-07-04T02:07:05.696619326Z [2024-07-04 02:07:05,696: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39864c62-7f1f-47a7-90cb-cbfa1cc37456] succeeded in 4.850363561999984s: None 2024-07-04T02:08:00.424899777Z [2024-07-04 02:08:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea5fdcf2-ebfc-43eb-9d03-376c9ad5b496] received 2024-07-04T02:08:00.435262875Z [2024-07-04 02:08:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39843675-9611-4791-9c1e-85663cf89f5b] received 2024-07-04T02:08:00.444583837Z [2024-07-04 02:08:00,444: INFO/ForkPoolWorker-15] [ea5fdcf2-ebfc-43eb-9d03-376c9ad5b496] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:08:00.463212266Z [2024-07-04 02:08:00,462: INFO/ForkPoolWorker-16] [39843675-9611-4791-9c1e-85663cf89f5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:08:00.535395848Z [2024-07-04 02:08:00,535: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20adb141-f9db-44dd-8daa-bdc75ef92d0d] received 2024-07-04T02:08:00.559455654Z [2024-07-04 02:08:00,559: INFO/ForkPoolWorker-1] [20adb141-f9db-44dd-8daa-bdc75ef92d0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:08:01.243199561Z [2024-07-04 02:08:01,238: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:08:01.260483167Z [2024-07-04 02:08:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:08:01.373631689Z [2024-07-04 02:08:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:08:02.240557223Z [2024-07-04 02:08:02,240: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:08:02.815401379Z [2024-07-04 02:08:02,815: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:08:02.819567257Z [2024-07-04 02:08:02,819: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:08:02.860805420Z [2024-07-04 02:08:02,860: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:08:02.867020574Z [2024-07-04 02:08:02,866: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:08:02.867154983Z [2024-07-04 02:08:02,866: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:08:02.868016918Z [2024-07-04 02:08:02,867: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:08:02.868104375Z [2024-07-04 02:08:02,867: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:08:02.868500418Z [2024-07-04 02:08:02,868: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:08:02.868618348Z [2024-07-04 02:08:02,868: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:08:02.872665934Z [2024-07-04 02:08:02,872: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39843675-9611-4791-9c1e-85663cf89f5b] succeeded in 2.431427479999911s: None 2024-07-04T02:08:03.005489817Z [2024-07-04 02:08:03,005: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:08:03.438710479Z [2024-07-04 02:08:03,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:08:03.443643543Z [2024-07-04 02:08:03,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:08:03.485369125Z [2024-07-04 02:08:03,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:08:03.487208225Z [2024-07-04 02:08:03,486: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:08:03.487462958Z [2024-07-04 02:08:03,487: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:08:03.487734250Z [2024-07-04 02:08:03,487: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:08:03.487848342Z [2024-07-04 02:08:03,487: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:08:03.488412360Z [2024-07-04 02:08:03,488: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:08:03.488431757Z [2024-07-04 02:08:03,488: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:08:03.633372797Z [2024-07-04 02:08:03,632: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:08:04.879380049Z [2024-07-04 02:08:04,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20adb141-f9db-44dd-8daa-bdc75ef92d0d] succeeded in 4.339897675999964s: None 2024-07-04T02:08:05.833760218Z [2024-07-04 02:08:05,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea5fdcf2-ebfc-43eb-9d03-376c9ad5b496] succeeded in 5.405333373999838s: None 2024-07-04T02:09:00.362567383Z [2024-07-04 02:09:00,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a336fe57-950c-47da-9842-16cace578173] received 2024-07-04T02:09:00.366202215Z [2024-07-04 02:09:00,365: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b57fd0f-e37b-4904-8d02-d6e4eccb50a4] received 2024-07-04T02:09:00.389520559Z [2024-07-04 02:09:00,388: INFO/ForkPoolWorker-15] [a336fe57-950c-47da-9842-16cace578173] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:09:00.405995397Z [2024-07-04 02:09:00,399: INFO/ForkPoolWorker-16] [2b57fd0f-e37b-4904-8d02-d6e4eccb50a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:09:00.814070844Z [2024-07-04 02:09:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:09:00.884010134Z [2024-07-04 02:09:00,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:09:02.343977762Z [2024-07-04 02:09:02,343: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:09:02.349953699Z [2024-07-04 02:09:02,348: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:09:02.401488831Z [2024-07-04 02:09:02,401: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:09:02.411725153Z [2024-07-04 02:09:02,411: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:09:02.411765596Z [2024-07-04 02:09:02,411: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:09:02.416303783Z [2024-07-04 02:09:02,411: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:09:02.416744887Z [2024-07-04 02:09:02,416: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:09:02.417111880Z [2024-07-04 02:09:02,416: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:09:02.418583359Z [2024-07-04 02:09:02,417: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:09:02.559123957Z [2024-07-04 02:09:02,558: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:09:02.562628226Z [2024-07-04 02:09:02,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:09:02.589343407Z [2024-07-04 02:09:02,589: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:09:02.615837554Z [2024-07-04 02:09:02,615: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:09:02.623794819Z [2024-07-04 02:09:02,623: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:09:02.623871672Z [2024-07-04 02:09:02,623: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:09:02.624014440Z [2024-07-04 02:09:02,623: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:09:02.624059760Z [2024-07-04 02:09:02,623: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:09:02.624386784Z [2024-07-04 02:09:02,624: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:09:02.624418768Z [2024-07-04 02:09:02,624: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:09:02.727826631Z [2024-07-04 02:09:02,727: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:09:04.407890537Z [2024-07-04 02:09:04,407: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2b57fd0f-e37b-4904-8d02-d6e4eccb50a4] succeeded in 4.037554977000127s: None 2024-07-04T02:09:04.811782556Z [2024-07-04 02:09:04,811: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a336fe57-950c-47da-9842-16cace578173] succeeded in 4.442588601000352s: None 2024-07-04T02:10:00.305491473Z [2024-07-04 02:10:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c6cfdfc-74c2-41c9-b335-ade8894d7731] received 2024-07-04T02:10:00.311736998Z [2024-07-04 02:10:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36572318-ec5e-4837-9817-31fe4c1429e0] received 2024-07-04T02:10:00.314320310Z [2024-07-04 02:10:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0da2924-743c-46bb-aff3-5d964d083c2c] received 2024-07-04T02:10:00.325621552Z [2024-07-04 02:10:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be91dab-4a28-4799-a416-64ac78f9e2c9] received 2024-07-04T02:10:00.336317284Z [2024-07-04 02:10:00,335: INFO/ForkPoolWorker-15] [6c6cfdfc-74c2-41c9-b335-ade8894d7731] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:00.338134021Z [2024-07-04 02:10:00,337: INFO/ForkPoolWorker-1] [c0da2924-743c-46bb-aff3-5d964d083c2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:10:00.344913483Z [2024-07-04 02:10:00,344: INFO/ForkPoolWorker-2] [5be91dab-4a28-4799-a416-64ac78f9e2c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:10:00.351292301Z [2024-07-04 02:10:00,348: INFO/ForkPoolWorker-16] [36572318-ec5e-4837-9817-31fe4c1429e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:10:00.772746783Z [2024-07-04 02:10:00,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:10:00.786553848Z [2024-07-04 02:10:00,782: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:10:01.115448396Z [2024-07-04 02:10:01,115: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:01.139108302Z [2024-07-04 02:10:01,134: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:10:01.260181495Z [2024-07-04 02:10:01,246: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:10:02.040384231Z [2024-07-04 02:10:02,039: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0da2924-743c-46bb-aff3-5d964d083c2c] succeeded in 1.7179989100000057s: None 2024-07-04T02:10:02.400458204Z [2024-07-04 02:10:02,400: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:10:02.403817531Z [2024-07-04 02:10:02,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:02.442864367Z [2024-07-04 02:10:02,442: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:10:02.445404745Z [2024-07-04 02:10:02,445: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:02.446979421Z [2024-07-04 02:10:02,446: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:02.447177307Z [2024-07-04 02:10:02,446: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:02.447348943Z [2024-07-04 02:10:02,447: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:10:02.447622836Z [2024-07-04 02:10:02,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:10:02.448424647Z [2024-07-04 02:10:02,448: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:02.558995134Z [2024-07-04 02:10:02,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:02.656594802Z [2024-07-04 02:10:02,656: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:10:02.660051881Z [2024-07-04 02:10:02,659: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:02.681903851Z [2024-07-04 02:10:02,681: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:10:02.683207905Z [2024-07-04 02:10:02,682: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:02.683217945Z [2024-07-04 02:10:02,683: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:02.683402985Z [2024-07-04 02:10:02,683: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:02.683506545Z [2024-07-04 02:10:02,683: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:10:02.683773173Z [2024-07-04 02:10:02,683: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:10:02.683891517Z [2024-07-04 02:10:02,683: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:02.762203144Z [2024-07-04 02:10:02,761: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:02.898400415Z [2024-07-04 02:10:02,898: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:10:02.915596082Z [2024-07-04 02:10:02,915: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:02.968769598Z [2024-07-04 02:10:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:10:02.970257899Z [2024-07-04 02:10:02,970: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:02.970273498Z [2024-07-04 02:10:02,970: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:02.970728424Z [2024-07-04 02:10:02,970: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:02.970967425Z [2024-07-04 02:10:02,970: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:10:02.972807649Z [2024-07-04 02:10:02,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:10:02.972935226Z [2024-07-04 02:10:02,972: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:03.088751453Z [2024-07-04 02:10:03,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:03.190133470Z [2024-07-04 02:10:03,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c6cfdfc-74c2-41c9-b335-ade8894d7731] succeeded in 2.8812794170003144s: None 2024-07-04T02:10:03.701118166Z [2024-07-04 02:10:03,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d60abc78-1b38-43e2-b800-a2b010d9d1c4] received 2024-07-04T02:10:03.711493032Z [2024-07-04 02:10:03,711: INFO/ForkPoolWorker-15] [d60abc78-1b38-43e2-b800-a2b010d9d1c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:04.029776132Z [2024-07-04 02:10:04,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:10:05.126318410Z [2024-07-04 02:10:05,125: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[36572318-ec5e-4837-9817-31fe4c1429e0] succeeded in 4.810105024999757s: None 2024-07-04T02:10:05.202395924Z [2024-07-04 02:10:05,202: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5be91dab-4a28-4799-a416-64ac78f9e2c9] succeeded in 4.872520814999916s: None 2024-07-04T02:10:05.257194627Z [2024-07-04 02:10:05,256: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:10:05.260715356Z [2024-07-04 02:10:05,260: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:05.285177873Z [2024-07-04 02:10:05,284: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:10:05.287805244Z [2024-07-04 02:10:05,287: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:05.287823569Z [2024-07-04 02:10:05,287: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:05.289142676Z [2024-07-04 02:10:05,287: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:05.289331508Z [2024-07-04 02:10:05,289: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:10:05.289651610Z [2024-07-04 02:10:05,289: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:10:05.289809819Z [2024-07-04 02:10:05,289: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:05.377697621Z [2024-07-04 02:10:05,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:06.086170987Z [2024-07-04 02:10:06,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d60abc78-1b38-43e2-b800-a2b010d9d1c4] succeeded in 2.383264860000054s: None 2024-07-04T02:10:06.434366692Z [2024-07-04 02:10:06,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74f9d25e-ed8c-4c90-a27c-e0676ba47128] received 2024-07-04T02:10:06.450042608Z [2024-07-04 02:10:06,449: INFO/ForkPoolWorker-15] [74f9d25e-ed8c-4c90-a27c-e0676ba47128] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:10:06.743348276Z [2024-07-04 02:10:06,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:10:07.916310440Z [2024-07-04 02:10:07,915: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:10:07.919950263Z [2024-07-04 02:10:07,919: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:07.956914865Z [2024-07-04 02:10:07,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:10:07.961943101Z [2024-07-04 02:10:07,961: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:07.962098588Z [2024-07-04 02:10:07,961: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:07.962360534Z [2024-07-04 02:10:07,962: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:07.962736001Z [2024-07-04 02:10:07,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:10:07.963867278Z [2024-07-04 02:10:07,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:10:07.963929350Z [2024-07-04 02:10:07,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:08.096101772Z [2024-07-04 02:10:08,095: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:08.692333166Z [2024-07-04 02:10:08,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74f9d25e-ed8c-4c90-a27c-e0676ba47128] succeeded in 2.253609247999975s: None 2024-07-04T02:10:08.897036694Z [2024-07-04 02:10:08,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77ad0ebd-d03b-46f5-9c92-ba66a0bd8826] received 2024-07-04T02:10:08.910033849Z [2024-07-04 02:10:08,909: INFO/ForkPoolWorker-15] [77ad0ebd-d03b-46f5-9c92-ba66a0bd8826] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:10:09.205419935Z [2024-07-04 02:10:09,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:10:10.402704280Z [2024-07-04 02:10:10,402: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:10:10.405999869Z [2024-07-04 02:10:10,405: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:10:10.457152259Z [2024-07-04 02:10:10,456: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:10:10.458261946Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:10:10.458289920Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:10:10.458385121Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:10:10.458411598Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:10:10.458730668Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:10:10.458744828Z [2024-07-04 02:10:10,458: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:10:10.557043554Z [2024-07-04 02:10:10,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:10:11.224530256Z [2024-07-04 02:10:11,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77ad0ebd-d03b-46f5-9c92-ba66a0bd8826] succeeded in 2.3247967689999314s: None 2024-07-04T02:11:00.231467202Z [2024-07-04 02:11:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56507081-e53b-484b-b400-490b6b2916fe] received 2024-07-04T02:11:00.239495376Z [2024-07-04 02:11:00,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c49e112e-3355-4124-be92-7329d55b5d6a] received 2024-07-04T02:11:00.263947063Z [2024-07-04 02:11:00,263: INFO/ForkPoolWorker-16] [c49e112e-3355-4124-be92-7329d55b5d6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:11:00.265982170Z [2024-07-04 02:11:00,265: INFO/ForkPoolWorker-15] [56507081-e53b-484b-b400-490b6b2916fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:11:00.616043432Z [2024-07-04 02:11:00,608: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:11:00.702650990Z [2024-07-04 02:11:00,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:11:01.851023338Z [2024-07-04 02:11:01,850: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:11:01.854840141Z [2024-07-04 02:11:01,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:11:01.928467287Z [2024-07-04 02:11:01,928: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:11:01.932810434Z [2024-07-04 02:11:01,932: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:11:01.932870340Z [2024-07-04 02:11:01,932: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:11:01.932931924Z [2024-07-04 02:11:01,932: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:11:01.932975174Z [2024-07-04 02:11:01,932: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:11:01.933188248Z [2024-07-04 02:11:01,933: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:11:01.933234620Z [2024-07-04 02:11:01,933: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:11:01.946277182Z [2024-07-04 02:11:01,945: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:11:01.953517533Z [2024-07-04 02:11:01,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:11:01.988561777Z [2024-07-04 02:11:01,988: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:11:01.990388127Z [2024-07-04 02:11:01,990: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:11:01.990567488Z [2024-07-04 02:11:01,990: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:11:01.990855041Z [2024-07-04 02:11:01,990: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:11:01.991095194Z [2024-07-04 02:11:01,990: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:11:01.991492063Z [2024-07-04 02:11:01,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:11:01.991637501Z [2024-07-04 02:11:01,991: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:11:02.014796932Z [2024-07-04 02:11:02,014: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:11:02.094592243Z [2024-07-04 02:11:02,094: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:11:03.639459988Z [2024-07-04 02:11:03,639: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c49e112e-3355-4124-be92-7329d55b5d6a] succeeded in 3.3954384569997274s: None 2024-07-04T02:11:03.966629520Z [2024-07-04 02:11:03,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56507081-e53b-484b-b400-490b6b2916fe] succeeded in 3.729510090000076s: None 2024-07-04T02:12:00.838531526Z [2024-07-04 02:12:00,838: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b9836be-64d8-4f35-a8f5-ee5a7549a8fd] received 2024-07-04T02:12:00.848938545Z [2024-07-04 02:12:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[978fde56-b91d-4dfa-8fec-376e3c87f4eb] received 2024-07-04T02:12:00.858318964Z [2024-07-04 02:12:00,858: INFO/ForkPoolWorker-15] [6b9836be-64d8-4f35-a8f5-ee5a7549a8fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:12:00.859361823Z [2024-07-04 02:12:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2cdfd55-73c1-4dfa-aa48-6ee3b009358c] received 2024-07-04T02:12:00.866653582Z [2024-07-04 02:12:00,866: INFO/ForkPoolWorker-16] [978fde56-b91d-4dfa-8fec-376e3c87f4eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:12:00.898744681Z [2024-07-04 02:12:00,898: INFO/ForkPoolWorker-1] [f2cdfd55-73c1-4dfa-aa48-6ee3b009358c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:12:01.194532443Z [2024-07-04 02:12:01,191: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:12:01.240077240Z [2024-07-04 02:12:01,237: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:12:01.316861163Z [2024-07-04 02:12:01,312: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:12:01.581292736Z [2024-07-04 02:12:01,581: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:12:02.154711103Z [2024-07-04 02:12:02,154: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f2cdfd55-73c1-4dfa-aa48-6ee3b009358c] succeeded in 1.2913106880000669s: None 2024-07-04T02:12:02.387265991Z [2024-07-04 02:12:02,382: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:12:02.392598879Z [2024-07-04 02:12:02,391: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:12:02.425459485Z [2024-07-04 02:12:02,425: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:12:02.427993171Z [2024-07-04 02:12:02,427: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:12:02.428382439Z [2024-07-04 02:12:02,428: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:12:02.428866333Z [2024-07-04 02:12:02,428: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:12:02.429149946Z [2024-07-04 02:12:02,428: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:12:02.429838124Z [2024-07-04 02:12:02,429: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:12:02.430171012Z [2024-07-04 02:12:02,429: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:12:02.456237415Z [2024-07-04 02:12:02,455: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:12:02.459522096Z [2024-07-04 02:12:02,459: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:12:02.492441056Z [2024-07-04 02:12:02,492: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:12:02.493525726Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:12:02.493550539Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:12:02.493724801Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:12:02.493737536Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:12:02.493998745Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:12:02.494040801Z [2024-07-04 02:12:02,493: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:12:02.545989665Z [2024-07-04 02:12:02,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:12:02.573698447Z [2024-07-04 02:12:02,572: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:12:04.956160782Z [2024-07-04 02:12:04,955: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b9836be-64d8-4f35-a8f5-ee5a7549a8fd] succeeded in 4.115459555000143s: None 2024-07-04T02:12:05.683907115Z [2024-07-04 02:12:05,683: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[978fde56-b91d-4dfa-8fec-376e3c87f4eb] succeeded in 4.831951619999927s: None 2024-07-04T02:13:00.814762614Z [2024-07-04 02:13:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96460625-dde1-4464-bcb2-bf22ac0903ba] received 2024-07-04T02:13:00.828759695Z [2024-07-04 02:13:00,828: INFO/ForkPoolWorker-15] [96460625-dde1-4464-bcb2-bf22ac0903ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:13:00.863760062Z [2024-07-04 02:13:00,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acc0b261-7b25-4ebb-a9ee-3d7caf328684] received 2024-07-04T02:13:00.896055345Z [2024-07-04 02:13:00,895: INFO/ForkPoolWorker-16] [acc0b261-7b25-4ebb-a9ee-3d7caf328684] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:13:01.207062834Z [2024-07-04 02:13:01,202: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:13:01.208263632Z [2024-07-04 02:13:01,203: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:13:02.596449478Z [2024-07-04 02:13:02,595: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:13:02.600307768Z [2024-07-04 02:13:02,599: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:13:02.641715978Z [2024-07-04 02:13:02,641: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:13:02.644212728Z [2024-07-04 02:13:02,643: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:13:02.644269276Z [2024-07-04 02:13:02,644: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:13:02.644355783Z [2024-07-04 02:13:02,644: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:13:02.644662445Z [2024-07-04 02:13:02,644: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:13:02.645468484Z [2024-07-04 02:13:02,645: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:13:02.645489492Z [2024-07-04 02:13:02,645: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:13:02.659989315Z [2024-07-04 02:13:02,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:13:02.665980539Z [2024-07-04 02:13:02,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:13:02.702491012Z [2024-07-04 02:13:02,702: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:13:02.707612421Z [2024-07-04 02:13:02,707: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:13:02.707632148Z [2024-07-04 02:13:02,707: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:13:02.707693946Z [2024-07-04 02:13:02,707: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:13:02.707795576Z [2024-07-04 02:13:02,707: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:13:02.708678593Z [2024-07-04 02:13:02,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:13:02.708750625Z [2024-07-04 02:13:02,708: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:13:02.756560323Z [2024-07-04 02:13:02,756: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:13:02.801268489Z [2024-07-04 02:13:02,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:13:04.656798521Z [2024-07-04 02:13:04,656: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96460625-dde1-4464-bcb2-bf22ac0903ba] succeeded in 3.835569458000009s: None 2024-07-04T02:13:05.595703158Z [2024-07-04 02:13:05,594: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acc0b261-7b25-4ebb-a9ee-3d7caf328684] succeeded in 4.72281155499968s: None 2024-07-04T02:14:00.656161207Z [2024-07-04 02:14:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2557dc1d-c3cf-4e40-aa81-a2632755a8a6] received 2024-07-04T02:14:00.666103775Z [2024-07-04 02:14:00,665: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96f27ae3-b0ab-4643-991d-c9f4dbac8163] received 2024-07-04T02:14:00.681126228Z [2024-07-04 02:14:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[375f53bc-9b72-4f4b-8665-a60d0c79f180] received 2024-07-04T02:14:00.684375316Z [2024-07-04 02:14:00,683: INFO/ForkPoolWorker-15] [2557dc1d-c3cf-4e40-aa81-a2632755a8a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:14:00.688315108Z [2024-07-04 02:14:00,687: INFO/ForkPoolWorker-16] [96f27ae3-b0ab-4643-991d-c9f4dbac8163] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:14:00.712821180Z [2024-07-04 02:14:00,712: INFO/ForkPoolWorker-1] [375f53bc-9b72-4f4b-8665-a60d0c79f180] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:14:01.091028800Z [2024-07-04 02:14:01,086: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:14:01.140501007Z [2024-07-04 02:14:01,136: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:14:01.251017068Z [2024-07-04 02:14:01,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:14:01.567448751Z [2024-07-04 02:14:01,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:14:02.114322279Z [2024-07-04 02:14:02,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2557dc1d-c3cf-4e40-aa81-a2632755a8a6] succeeded in 1.4544866930000353s: None 2024-07-04T02:14:02.460435829Z [2024-07-04 02:14:02,459: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:14:02.463825770Z [2024-07-04 02:14:02,463: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:14:02.499033683Z [2024-07-04 02:14:02,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:14:02.500180405Z [2024-07-04 02:14:02,499: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:14:02.500277604Z [2024-07-04 02:14:02,500: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:14:02.500449109Z [2024-07-04 02:14:02,500: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:14:02.500517487Z [2024-07-04 02:14:02,500: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:14:02.501329699Z [2024-07-04 02:14:02,501: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:14:02.501369061Z [2024-07-04 02:14:02,501: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:14:02.592226708Z [2024-07-04 02:14:02,591: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:14:02.596471110Z [2024-07-04 02:14:02,596: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:14:02.615887660Z [2024-07-04 02:14:02,615: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:14:02.629026231Z [2024-07-04 02:14:02,628: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:14:02.630864571Z [2024-07-04 02:14:02,630: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:14:02.631112077Z [2024-07-04 02:14:02,630: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:14:02.631397159Z [2024-07-04 02:14:02,631: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:14:02.633056165Z [2024-07-04 02:14:02,632: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:14:02.633478547Z [2024-07-04 02:14:02,633: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:14:02.634098391Z [2024-07-04 02:14:02,633: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:14:02.731954691Z [2024-07-04 02:14:02,731: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:14:04.384381720Z [2024-07-04 02:14:04,383: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96f27ae3-b0ab-4643-991d-c9f4dbac8163] succeeded in 3.7157752389998677s: None 2024-07-04T02:14:05.536469849Z [2024-07-04 02:14:05,536: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[375f53bc-9b72-4f4b-8665-a60d0c79f180] succeeded in 4.844812081999862s: None 2024-07-04T02:14:42.297328133Z [2024-07-04 02:14:42,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a4e9a6e-ee8b-41c3-a236-4c2abe1f6295] received 2024-07-04T02:14:42.324525006Z [2024-07-04 02:14:42,323: INFO/ForkPoolWorker-15] [7a4e9a6e-ee8b-41c3-a236-4c2abe1f6295] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:14:42.599898526Z [2024-07-04 02:14:42,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:14:42.826199860Z [2024-07-04 02:14:42,825: INFO/ForkPoolWorker-15] Getting SDNC list 2024-07-04T02:14:42.834443743Z [2024-07-04 02:14:42,833: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:14:42.888097220Z [2024-07-04 02:14:42,887: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:14:42.890543268Z [2024-07-04 02:14:42,890: INFO/ForkPoolWorker-15] Read SDNC fd9775a1-7b41-4ab1-9e85-38d017541baf (epa_03) 2024-07-04T02:14:42.891069604Z [2024-07-04 02:14:42,890: INFO/ForkPoolWorker-15] [{'_id': 'fd9775a1-7b41-4ab1-9e85-38d017541baf', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-07-04T02:14:42.891412902Z [2024-07-04 02:14:42,891: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-07-04T02:14:42.892048231Z [2024-07-04 02:14:42,891: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf 2024-07-04T02:14:43.018465688Z [2024-07-04 02:14:43,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:14:43.647049059Z [2024-07-04 02:14:43,646: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a4e9a6e-ee8b-41c3-a236-4c2abe1f6295] succeeded in 1.3454886049999004s: None 2024-07-04T02:15:00.727670601Z [2024-07-04 02:15:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[240a286f-6d8f-4ec1-9797-2c44c029709e] received 2024-07-04T02:15:00.735852198Z [2024-07-04 02:15:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57f745fe-f3b4-4f50-9df6-6aab9d670f66] received 2024-07-04T02:15:00.737298827Z [2024-07-04 02:15:00,737: INFO/ForkPoolWorker-15] [240a286f-6d8f-4ec1-9797-2c44c029709e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:00.752964636Z [2024-07-04 02:15:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e00969d6-fced-4179-bb75-ceb77ac050e7] received 2024-07-04T02:15:00.762262883Z [2024-07-04 02:15:00,761: INFO/ForkPoolWorker-16] [57f745fe-f3b4-4f50-9df6-6aab9d670f66] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:15:00.772425046Z [2024-07-04 02:15:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7398260b-c761-4fa5-9e2f-4b90ce1cf047] received 2024-07-04T02:15:00.774408013Z [2024-07-04 02:15:00,773: INFO/ForkPoolWorker-1] [e00969d6-fced-4179-bb75-ceb77ac050e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:15:00.798397941Z [2024-07-04 02:15:00,797: INFO/ForkPoolWorker-2] [7398260b-c761-4fa5-9e2f-4b90ce1cf047] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:15:01.246058788Z [2024-07-04 02:15:01,233: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:15:01.262959577Z [2024-07-04 02:15:01,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:15:01.533843240Z [2024-07-04 02:15:01,530: INFO/ForkPoolWorker-16] Getting SDNC list 2024-07-04T02:15:01.535725836Z [2024-07-04 02:15:01,524: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:15:01.541466912Z [2024-07-04 02:15:01,534: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:15:01.543484447Z [2024-07-04 02:15:01,543: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:01.610183816Z [2024-07-04 02:15:01,609: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:15:01.612338803Z [2024-07-04 02:15:01,612: INFO/ForkPoolWorker-16] Read SDNC fd9775a1-7b41-4ab1-9e85-38d017541baf (epa_03) 2024-07-04T02:15:01.612485083Z [2024-07-04 02:15:01,612: INFO/ForkPoolWorker-16] [{'_id': 'fd9775a1-7b41-4ab1-9e85-38d017541baf', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-07-04T02:15:01.612694016Z [2024-07-04 02:15:01,612: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-07-04T02:15:01.613008160Z [2024-07-04 02:15:01,612: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf 2024-07-04T02:15:01.806295251Z [2024-07-04 02:15:01,805: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:02.733589832Z [2024-07-04 02:15:02,733: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[57f745fe-f3b4-4f50-9df6-6aab9d670f66] succeeded in 1.9887677319998147s: None 2024-07-04T02:15:02.877155678Z [2024-07-04 02:15:02,876: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:15:02.880812428Z [2024-07-04 02:15:02,880: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:02.908600797Z [2024-07-04 02:15:02,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:15:02.912097418Z [2024-07-04 02:15:02,911: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:02.912314243Z [2024-07-04 02:15:02,912: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:02.912666764Z [2024-07-04 02:15:02,912: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:02.912709552Z [2024-07-04 02:15:02,912: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:15:02.912997895Z [2024-07-04 02:15:02,912: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:15:02.913018987Z [2024-07-04 02:15:02,912: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:03.022513276Z [2024-07-04 02:15:03,022: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:03.087387940Z [2024-07-04 02:15:03,086: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:15:03.091721288Z [2024-07-04 02:15:03,091: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:03.140160539Z [2024-07-04 02:15:03,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:15:03.144002320Z [2024-07-04 02:15:03,143: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:03.144023163Z [2024-07-04 02:15:03,143: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:03.144231042Z [2024-07-04 02:15:03,144: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:03.144281445Z [2024-07-04 02:15:03,144: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:15:03.144582360Z [2024-07-04 02:15:03,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:15:03.144629315Z [2024-07-04 02:15:03,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:03.221976370Z [2024-07-04 02:15:03,221: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:15:03.228199279Z [2024-07-04 02:15:03,227: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:03.238822504Z [2024-07-04 02:15:03,238: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:03.269069515Z [2024-07-04 02:15:03,268: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:15:03.270316592Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:03.270433894Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:03.270584893Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:03.270629801Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:15:03.271002561Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:15:03.271104901Z [2024-07-04 02:15:03,270: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:03.379976929Z [2024-07-04 02:15:03,379: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:03.875785416Z [2024-07-04 02:15:03,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3997e62b-53b5-4034-9624-06be90b8fcec] received 2024-07-04T02:15:03.891060873Z [2024-07-04 02:15:03,890: INFO/ForkPoolWorker-16] [3997e62b-53b5-4034-9624-06be90b8fcec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:03.967661722Z [2024-07-04 02:15:03,967: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[240a286f-6d8f-4ec1-9797-2c44c029709e] succeeded in 3.2385224320000816s: None 2024-07-04T02:15:04.222922110Z [2024-07-04 02:15:04,219: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:15:04.983407112Z [2024-07-04 02:15:04,982: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7398260b-c761-4fa5-9e2f-4b90ce1cf047] succeeded in 4.20048931600013s: None 2024-07-04T02:15:05.094553663Z [2024-07-04 02:15:05,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e00969d6-fced-4179-bb75-ceb77ac050e7] succeeded in 4.33647886899962s: None 2024-07-04T02:15:05.443062392Z [2024-07-04 02:15:05,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:15:05.446605292Z [2024-07-04 02:15:05,446: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:05.479172885Z [2024-07-04 02:15:05,477: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:15:05.482237662Z [2024-07-04 02:15:05,481: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:05.482338795Z [2024-07-04 02:15:05,482: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:05.482552653Z [2024-07-04 02:15:05,482: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:05.482629568Z [2024-07-04 02:15:05,482: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:15:05.483631930Z [2024-07-04 02:15:05,483: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:15:05.483664423Z [2024-07-04 02:15:05,483: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:05.581605873Z [2024-07-04 02:15:05,581: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:06.327922638Z [2024-07-04 02:15:06,327: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3997e62b-53b5-4034-9624-06be90b8fcec] succeeded in 2.446260402000007s: None 2024-07-04T02:15:06.490932790Z [2024-07-04 02:15:06,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f34946e3-9fe4-42f0-a014-f86f9a9666e7] received 2024-07-04T02:15:06.508361286Z [2024-07-04 02:15:06,507: INFO/ForkPoolWorker-15] [f34946e3-9fe4-42f0-a014-f86f9a9666e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:15:06.801876613Z [2024-07-04 02:15:06,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:15:08.050124173Z [2024-07-04 02:15:08,049: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:15:08.053580001Z [2024-07-04 02:15:08,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:08.104287952Z [2024-07-04 02:15:08,103: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:15:08.108781309Z [2024-07-04 02:15:08,108: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:08.108906091Z [2024-07-04 02:15:08,108: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:08.109703816Z [2024-07-04 02:15:08,108: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:08.109832336Z [2024-07-04 02:15:08,109: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:15:08.110609946Z [2024-07-04 02:15:08,110: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:15:08.111313438Z [2024-07-04 02:15:08,110: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:08.259243257Z [2024-07-04 02:15:08,258: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:08.882893650Z [2024-07-04 02:15:08,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42e65e17-8ceb-45cf-b778-8c6cc7d39bf2] received 2024-07-04T02:15:08.898366608Z [2024-07-04 02:15:08,898: INFO/ForkPoolWorker-16] [42e65e17-8ceb-45cf-b778-8c6cc7d39bf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:15:08.952178809Z [2024-07-04 02:15:08,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f34946e3-9fe4-42f0-a014-f86f9a9666e7] succeeded in 2.453009515999838s: None 2024-07-04T02:15:09.210579028Z [2024-07-04 02:15:09,207: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:15:10.533120552Z [2024-07-04 02:15:10,532: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:15:10.536679065Z [2024-07-04 02:15:10,536: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:15:10.591263588Z [2024-07-04 02:15:10,590: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:15:10.594315199Z [2024-07-04 02:15:10,593: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:15:10.594857300Z [2024-07-04 02:15:10,594: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:15:10.595301606Z [2024-07-04 02:15:10,594: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:15:10.595573548Z [2024-07-04 02:15:10,595: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:15:10.596255628Z [2024-07-04 02:15:10,595: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:15:10.596307761Z [2024-07-04 02:15:10,596: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:15:10.697127305Z [2024-07-04 02:15:10,696: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:15:11.359766292Z [2024-07-04 02:15:11,359: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[42e65e17-8ceb-45cf-b778-8c6cc7d39bf2] succeeded in 2.474993094000183s: None 2024-07-04T02:16:00.715639528Z [2024-07-04 02:16:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da589eec-ace1-4e9c-b21f-47e96b0dc4f7] received 2024-07-04T02:16:00.733687162Z [2024-07-04 02:16:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c426cc25-ee1d-4bdd-abf3-e18370ab40b3] received 2024-07-04T02:16:00.737396214Z [2024-07-04 02:16:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[609b9e63-525d-4b72-848a-81fe6c8d7381] received 2024-07-04T02:16:00.739454444Z [2024-07-04 02:16:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33ba9c02-be0d-4661-9390-15c4429b2885] received 2024-07-04T02:16:00.741815695Z [2024-07-04 02:16:00,741: INFO/ForkPoolWorker-15] [da589eec-ace1-4e9c-b21f-47e96b0dc4f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:16:00.753283952Z [2024-07-04 02:16:00,752: INFO/ForkPoolWorker-16] [c426cc25-ee1d-4bdd-abf3-e18370ab40b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:16:00.770370570Z [2024-07-04 02:16:00,769: INFO/ForkPoolWorker-1] [609b9e63-525d-4b72-848a-81fe6c8d7381] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:16:00.786263786Z [2024-07-04 02:16:00,785: INFO/ForkPoolWorker-2] [33ba9c02-be0d-4661-9390-15c4429b2885] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:16:01.066982845Z [2024-07-04 02:16:01,057: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:01.200195431Z [2024-07-04 02:16:01,189: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:16:01.317627344Z [2024-07-04 02:16:01,317: INFO/ForkPoolWorker-16] Getting SDNC list 2024-07-04T02:16:01.322278839Z [2024-07-04 02:16:01,321: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:01.369353392Z [2024-07-04 02:16:01,369: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:16:01.371749097Z [2024-07-04 02:16:01,371: INFO/ForkPoolWorker-16] [] 2024-07-04T02:16:01.371938577Z [2024-07-04 02:16:01,371: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-07-04T02:16:01.373400768Z [2024-07-04 02:16:01,373: WARNING/ForkPoolWorker-16] Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:01.373779412Z [2024-07-04 02:16:01,373: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:01.377404293Z [2024-07-04 02:16:01,377: INFO/ForkPoolWorker-16] Getting SDNC list 2024-07-04T02:16:01.380175829Z [2024-07-04 02:16:01,379: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:01.380458645Z [2024-07-04 02:16:01,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:16:01.428506948Z [2024-07-04 02:16:01,428: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:16:01.429874961Z [2024-07-04 02:16:01,429: INFO/ForkPoolWorker-16] [] 2024-07-04T02:16:01.430054209Z [2024-07-04 02:16:01,429: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-07-04T02:16:01.431196049Z [2024-07-04 02:16:01,430: ERROR/ForkPoolWorker-16] [c426cc25-ee1d-4bdd-abf3-e18370ab40b3] Failed to execute task Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:16:01.431212304Z Traceback (most recent call last): 2024-07-04T02:16:01.431219500Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:16:01.431223537Z args.func(args) 2024-07-04T02:16:01.431235985Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:16:01.431239729Z return func(*args, **kwargs) 2024-07-04T02:16:01.431242857Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:16:01.431246089Z return f(*args, **kwargs) 2024-07-04T02:16:01.431249646Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:16:01.431252997Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:16:01.431256067Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:16:01.431259117Z raise AirflowException( 2024-07-04T02:16:01.431262889Z airflow.exceptions.AirflowException: Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:16:01.457571504Z [2024-07-04 02:16:01,452: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c426cc25-ee1d-4bdd-abf3-e18370ab40b3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c426cc25-ee1d-4bdd-abf3-e18370ab40b3') 2024-07-04T02:16:01.457593208Z Traceback (most recent call last): 2024-07-04T02:16:01.457597416Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:16:01.457600553Z R = retval = fun(*args, **kwargs) 2024-07-04T02:16:01.457603838Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:16:01.457607004Z return self.run(*args, **kwargs) 2024-07-04T02:16:01.457610448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:16:01.457614269Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:16:01.457617418Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:16:01.457621433Z raise AirflowException(msg) 2024-07-04T02:16:01.457625255Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c426cc25-ee1d-4bdd-abf3-e18370ab40b3 2024-07-04T02:16:01.538446011Z [2024-07-04 02:16:01,534: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:16:01.706480955Z [2024-07-04 02:16:01,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:16:02.282033586Z [2024-07-04 02:16:02,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da589eec-ace1-4e9c-b21f-47e96b0dc4f7] succeeded in 1.5617475439998998s: None 2024-07-04T02:16:02.541683906Z [2024-07-04 02:16:02,541: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:16:02.545017310Z [2024-07-04 02:16:02,544: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:02.574450943Z [2024-07-04 02:16:02,574: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:16:02.575683997Z [2024-07-04 02:16:02,575: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:16:02.575749401Z [2024-07-04 02:16:02,575: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:16:02.576048660Z [2024-07-04 02:16:02,575: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:16:02.576112980Z [2024-07-04 02:16:02,576: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:16:02.576670444Z [2024-07-04 02:16:02,576: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:16:02.576731674Z [2024-07-04 02:16:02,576: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:16:02.663913709Z [2024-07-04 02:16:02,663: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:16:02.793200901Z [2024-07-04 02:16:02,792: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:16:02.796633972Z [2024-07-04 02:16:02,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:02.822782081Z [2024-07-04 02:16:02,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:16:02.824044086Z [2024-07-04 02:16:02,823: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:16:02.824062228Z [2024-07-04 02:16:02,823: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:16:02.824220135Z [2024-07-04 02:16:02,824: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:16:02.824263842Z [2024-07-04 02:16:02,824: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:16:02.824555700Z [2024-07-04 02:16:02,824: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:16:02.824571111Z [2024-07-04 02:16:02,824: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:16:02.917595486Z [2024-07-04 02:16:02,917: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:16:04.339121014Z [2024-07-04 02:16:04,338: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[33ba9c02-be0d-4661-9390-15c4429b2885] succeeded in 3.5938643149997915s: None 2024-07-04T02:16:04.936856094Z [2024-07-04 02:16:04,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[609b9e63-525d-4b72-848a-81fe6c8d7381] succeeded in 4.194902650000131s: None 2024-07-04T02:16:13.682398104Z [2024-07-04 02:16:13,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f51711d-c8ca-4b7e-9a0c-07676e04fc07] received 2024-07-04T02:16:13.695442185Z [2024-07-04 02:16:13,695: INFO/ForkPoolWorker-15] [7f51711d-c8ca-4b7e-9a0c-07676e04fc07] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-07-04T02:16:13.967873853Z [2024-07-04 02:16:13,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:14.117402110Z [2024-07-04 02:16:14,117: INFO/ForkPoolWorker-15] Getting SDNC list 2024-07-04T02:16:14.121259654Z [2024-07-04 02:16:14,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:14.148105047Z [2024-07-04 02:16:14,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:16:14.150414889Z [2024-07-04 02:16:14,149: INFO/ForkPoolWorker-15] [] 2024-07-04T02:16:14.150744994Z [2024-07-04 02:16:14,150: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-07-04T02:16:14.154459303Z [2024-07-04 02:16:14,154: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:14.154747042Z [2024-07-04 02:16:14,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-07-04T02:16:14.156488969Z [2024-07-04 02:16:14,156: INFO/ForkPoolWorker-15] Getting SDNC list 2024-07-04T02:16:14.159489374Z [2024-07-04 02:16:14,159: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:16:14.178644466Z [2024-07-04 02:16:14,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:16:14.180875142Z [2024-07-04 02:16:14,180: INFO/ForkPoolWorker-15] [] 2024-07-04T02:16:14.181047405Z [2024-07-04 02:16:14,180: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-07-04T02:16:14.183651724Z [2024-07-04 02:16:14,182: ERROR/ForkPoolWorker-15] [7f51711d-c8ca-4b7e-9a0c-07676e04fc07] Failed to execute task Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:16:14.183663301Z Traceback (most recent call last): 2024-07-04T02:16:14.183667579Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:16:14.183680090Z args.func(args) 2024-07-04T02:16:14.183683805Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:16:14.183687925Z return func(*args, **kwargs) 2024-07-04T02:16:14.183690977Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:16:14.183694067Z return f(*args, **kwargs) 2024-07-04T02:16:14.183697615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:16:14.183700737Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:16:14.183703764Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:16:14.183706799Z raise AirflowException( 2024-07-04T02:16:14.183710820Z airflow.exceptions.AirflowException: Dag 'sdnc_status_fd9775a1-7b41-4ab1-9e85-38d017541baf' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:16:14.212520349Z [2024-07-04 02:16:14,211: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f51711d-c8ca-4b7e-9a0c-07676e04fc07] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7f51711d-c8ca-4b7e-9a0c-07676e04fc07') 2024-07-04T02:16:14.212548503Z Traceback (most recent call last): 2024-07-04T02:16:14.212554693Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:16:14.212559675Z R = retval = fun(*args, **kwargs) 2024-07-04T02:16:14.212564861Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:16:14.212569775Z return self.run(*args, **kwargs) 2024-07-04T02:16:14.212575612Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:16:14.212581017Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:16:14.212585946Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:16:14.212591215Z raise AirflowException(msg) 2024-07-04T02:16:14.212597400Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7f51711d-c8ca-4b7e-9a0c-07676e04fc07 2024-07-04T02:17:00.343134934Z [2024-07-04 02:17:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a6914bd-dbef-4e1b-9555-98b46c7be3b6] received 2024-07-04T02:17:00.363038409Z [2024-07-04 02:17:00,358: INFO/ForkPoolWorker-15] [5a6914bd-dbef-4e1b-9555-98b46c7be3b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:17:00.368295473Z [2024-07-04 02:17:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[969807a2-2d2e-4cae-a9ff-5df5d2fa2caf] received 2024-07-04T02:17:00.395593528Z [2024-07-04 02:17:00,394: INFO/ForkPoolWorker-16] [969807a2-2d2e-4cae-a9ff-5df5d2fa2caf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:17:00.706981835Z [2024-07-04 02:17:00,702: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:17:00.783593495Z [2024-07-04 02:17:00,779: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:17:02.057970748Z [2024-07-04 02:17:02,057: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:17:02.061874007Z [2024-07-04 02:17:02,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:17:02.083896413Z [2024-07-04 02:17:02,083: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:17:02.087577857Z [2024-07-04 02:17:02,087: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:17:02.099048810Z [2024-07-04 02:17:02,098: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:17:02.101100885Z [2024-07-04 02:17:02,100: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:17:02.101132944Z [2024-07-04 02:17:02,101: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:17:02.101246442Z [2024-07-04 02:17:02,101: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:17:02.101278206Z [2024-07-04 02:17:02,101: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:17:02.101557393Z [2024-07-04 02:17:02,101: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:17:02.101588475Z [2024-07-04 02:17:02,101: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:17:02.142296222Z [2024-07-04 02:17:02,142: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:17:02.143414877Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:17:02.143487514Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:17:02.143610369Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:17:02.143656200Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:17:02.143908069Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:17:02.143936782Z [2024-07-04 02:17:02,143: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:17:02.200066467Z [2024-07-04 02:17:02,199: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:17:02.224040578Z [2024-07-04 02:17:02,223: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:17:03.901923755Z [2024-07-04 02:17:03,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a6914bd-dbef-4e1b-9555-98b46c7be3b6] succeeded in 3.5561072730001797s: None 2024-07-04T02:17:04.082243905Z [2024-07-04 02:17:04,081: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[969807a2-2d2e-4cae-a9ff-5df5d2fa2caf] succeeded in 3.708842325000205s: None 2024-07-04T02:18:00.388920551Z [2024-07-04 02:18:00,388: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7249162-b2bb-4aa0-95c4-87904c029592] received 2024-07-04T02:18:00.399960753Z [2024-07-04 02:18:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[485c6aea-db5a-4150-baa3-83ddf7e6b19b] received 2024-07-04T02:18:00.405544336Z [2024-07-04 02:18:00,405: INFO/ForkPoolWorker-15] [c7249162-b2bb-4aa0-95c4-87904c029592] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:18:00.416585300Z [2024-07-04 02:18:00,416: INFO/ForkPoolWorker-16] [485c6aea-db5a-4150-baa3-83ddf7e6b19b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:18:00.438028506Z [2024-07-04 02:18:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b89a2d0c-0ba9-4b0b-8c18-42dd7f5d45f5] received 2024-07-04T02:18:00.474148927Z [2024-07-04 02:18:00,473: INFO/ForkPoolWorker-1] [b89a2d0c-0ba9-4b0b-8c18-42dd7f5d45f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:18:00.828963985Z [2024-07-04 02:18:00,824: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:18:00.905138934Z [2024-07-04 02:18:00,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:18:00.998169745Z [2024-07-04 02:18:00,995: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:18:01.793746006Z [2024-07-04 02:18:01,793: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:18:02.663330821Z [2024-07-04 02:18:02,662: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:18:02.666675723Z [2024-07-04 02:18:02,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:18:02.770867494Z [2024-07-04 02:18:02,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:18:02.778235788Z [2024-07-04 02:18:02,777: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:18:02.778256165Z [2024-07-04 02:18:02,778: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:18:02.778454020Z [2024-07-04 02:18:02,778: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:18:02.778513344Z [2024-07-04 02:18:02,778: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:18:02.779031129Z [2024-07-04 02:18:02,778: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:18:02.779819162Z [2024-07-04 02:18:02,778: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:18:02.878238020Z [2024-07-04 02:18:02,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b89a2d0c-0ba9-4b0b-8c18-42dd7f5d45f5] succeeded in 2.4372676670000146s: None 2024-07-04T02:18:02.897607367Z [2024-07-04 02:18:02,896: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:18:02.902809302Z [2024-07-04 02:18:02,902: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:18:02.913322447Z [2024-07-04 02:18:02,913: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:18:02.941075245Z [2024-07-04 02:18:02,940: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:18:02.943697194Z [2024-07-04 02:18:02,943: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:18:02.943741364Z [2024-07-04 02:18:02,943: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:18:02.944674153Z [2024-07-04 02:18:02,943: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:18:02.944857537Z [2024-07-04 02:18:02,944: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:18:02.945175863Z [2024-07-04 02:18:02,944: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:18:02.945193588Z [2024-07-04 02:18:02,945: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:18:03.073762345Z [2024-07-04 02:18:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:18:04.724761033Z [2024-07-04 02:18:04,722: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7249162-b2bb-4aa0-95c4-87904c029592] succeeded in 4.332186200000251s: None 2024-07-04T02:18:05.296957839Z [2024-07-04 02:18:05,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[485c6aea-db5a-4150-baa3-83ddf7e6b19b] succeeded in 4.893097848999787s: None 2024-07-04T02:19:00.489803912Z [2024-07-04 02:19:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34a4efcb-986c-46f1-a7b1-43bcd005b5ee] received 2024-07-04T02:19:00.494517249Z [2024-07-04 02:19:00,494: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abb775bb-2a35-4cf9-b4f5-c93700bbe8f7] received 2024-07-04T02:19:00.516037684Z [2024-07-04 02:19:00,515: INFO/ForkPoolWorker-16] [abb775bb-2a35-4cf9-b4f5-c93700bbe8f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:19:00.526567244Z [2024-07-04 02:19:00,522: INFO/ForkPoolWorker-15] [34a4efcb-986c-46f1-a7b1-43bcd005b5ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:19:00.920161717Z [2024-07-04 02:19:00,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:19:00.975289364Z [2024-07-04 02:19:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:19:02.377548957Z [2024-07-04 02:19:02,377: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:19:02.381603506Z [2024-07-04 02:19:02,381: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:19:02.397576218Z [2024-07-04 02:19:02,397: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:19:02.402745043Z [2024-07-04 02:19:02,402: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:19:02.417486088Z [2024-07-04 02:19:02,417: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:19:02.419196288Z [2024-07-04 02:19:02,418: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:19:02.419298298Z [2024-07-04 02:19:02,419: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:19:02.419477257Z [2024-07-04 02:19:02,419: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:19:02.419568514Z [2024-07-04 02:19:02,419: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:19:02.419863182Z [2024-07-04 02:19:02,419: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:19:02.419959150Z [2024-07-04 02:19:02,419: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:19:02.434228578Z [2024-07-04 02:19:02,434: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:19:02.436945797Z [2024-07-04 02:19:02,436: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:19:02.437173515Z [2024-07-04 02:19:02,436: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:19:02.437333672Z [2024-07-04 02:19:02,437: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:19:02.438500755Z [2024-07-04 02:19:02,438: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:19:02.439174075Z [2024-07-04 02:19:02,438: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:19:02.439953972Z [2024-07-04 02:19:02,439: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:19:02.515354213Z [2024-07-04 02:19:02,515: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:19:02.516902573Z [2024-07-04 02:19:02,516: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:19:04.152527222Z [2024-07-04 02:19:04,151: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34a4efcb-986c-46f1-a7b1-43bcd005b5ee] succeeded in 3.6536334100001113s: None 2024-07-04T02:19:04.786952078Z [2024-07-04 02:19:04,783: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[abb775bb-2a35-4cf9-b4f5-c93700bbe8f7] succeeded in 4.28559694400019s: None 2024-07-04T02:20:00.464487320Z [2024-07-04 02:20:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b2de557-9988-469a-88c8-bc86304b61d1] received 2024-07-04T02:20:00.469840505Z [2024-07-04 02:20:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fab13301-0321-44db-a1dd-75269531935e] received 2024-07-04T02:20:00.485627893Z [2024-07-04 02:20:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9200c266-a9c3-438e-aad8-46495bc8f560] received 2024-07-04T02:20:00.485998854Z [2024-07-04 02:20:00,485: INFO/ForkPoolWorker-15] [8b2de557-9988-469a-88c8-bc86304b61d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:20:00.487802441Z [2024-07-04 02:20:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c1b9c43-5785-4a9d-9087-9a419e156c79] received 2024-07-04T02:20:00.509629549Z [2024-07-04 02:20:00,509: INFO/ForkPoolWorker-2] [4c1b9c43-5785-4a9d-9087-9a419e156c79] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:20:00.519265684Z [2024-07-04 02:20:00,518: INFO/ForkPoolWorker-1] [9200c266-a9c3-438e-aad8-46495bc8f560] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:00.529375083Z [2024-07-04 02:20:00,528: INFO/ForkPoolWorker-16] [fab13301-0321-44db-a1dd-75269531935e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:20:01.014078260Z [2024-07-04 02:20:01,009: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:20:01.023392856Z [2024-07-04 02:20:01,009: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:20:01.319887151Z [2024-07-04 02:20:01,315: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:20:01.322543501Z [2024-07-04 02:20:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:20:01.634642247Z [2024-07-04 02:20:01,634: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:02.393709740Z [2024-07-04 02:20:02,393: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4c1b9c43-5785-4a9d-9087-9a419e156c79] succeeded in 1.897939524999856s: None 2024-07-04T02:20:02.583125868Z [2024-07-04 02:20:02,582: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:20:02.588431458Z [2024-07-04 02:20:02,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:02.591840109Z [2024-07-04 02:20:02,591: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:20:02.595408050Z [2024-07-04 02:20:02,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:02.624388497Z [2024-07-04 02:20:02,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:20:02.626185610Z [2024-07-04 02:20:02,625: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:02.626272032Z [2024-07-04 02:20:02,626: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:02.626533811Z [2024-07-04 02:20:02,626: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:02.626667767Z [2024-07-04 02:20:02,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:20:02.628084162Z [2024-07-04 02:20:02,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:20:02.628779766Z [2024-07-04 02:20:02,628: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:02.631737974Z [2024-07-04 02:20:02,631: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:20:02.632762871Z [2024-07-04 02:20:02,632: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:02.632962989Z [2024-07-04 02:20:02,632: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:02.633133554Z [2024-07-04 02:20:02,632: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:02.633263019Z [2024-07-04 02:20:02,633: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:20:02.633549967Z [2024-07-04 02:20:02,633: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:20:02.633653941Z [2024-07-04 02:20:02,633: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:02.730678316Z [2024-07-04 02:20:02,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:02.743366450Z [2024-07-04 02:20:02,743: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:02.748634771Z [2024-07-04 02:20:02,748: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:20:02.755280397Z [2024-07-04 02:20:02,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:02.785597037Z [2024-07-04 02:20:02,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:20:02.792074385Z [2024-07-04 02:20:02,791: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:02.792167006Z [2024-07-04 02:20:02,792: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:02.792341493Z [2024-07-04 02:20:02,792: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:02.792420416Z [2024-07-04 02:20:02,792: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:20:02.792712410Z [2024-07-04 02:20:02,792: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:20:02.792853437Z [2024-07-04 02:20:02,792: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:02.917130316Z [2024-07-04 02:20:02,916: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:03.463509878Z [2024-07-04 02:20:03,463: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9200c266-a9c3-438e-aad8-46495bc8f560] succeeded in 2.9727997830000277s: None 2024-07-04T02:20:03.471406835Z [2024-07-04 02:20:03,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e372f24-2575-4606-96be-2fc4dbf14dfc] received 2024-07-04T02:20:03.477990299Z [2024-07-04 02:20:03,477: INFO/ForkPoolWorker-1] [5e372f24-2575-4606-96be-2fc4dbf14dfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:03.755664630Z [2024-07-04 02:20:03,752: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:20:04.475179095Z [2024-07-04 02:20:04,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fab13301-0321-44db-a1dd-75269531935e] succeeded in 4.000991514999896s: None 2024-07-04T02:20:04.861722884Z [2024-07-04 02:20:04,861: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b2de557-9988-469a-88c8-bc86304b61d1] succeeded in 4.392322261000118s: None 2024-07-04T02:20:05.030753311Z [2024-07-04 02:20:05,030: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:20:05.034377986Z [2024-07-04 02:20:05,033: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:05.068542983Z [2024-07-04 02:20:05,068: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:20:05.070024228Z [2024-07-04 02:20:05,069: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:05.070392853Z [2024-07-04 02:20:05,070: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:05.070545679Z [2024-07-04 02:20:05,070: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:05.071809464Z [2024-07-04 02:20:05,071: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:20:05.073991448Z [2024-07-04 02:20:05,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:20:05.074018483Z [2024-07-04 02:20:05,072: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:05.183969270Z [2024-07-04 02:20:05,183: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:05.851587359Z [2024-07-04 02:20:05,851: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e372f24-2575-4606-96be-2fc4dbf14dfc] succeeded in 2.378536791999977s: None 2024-07-04T02:20:05.954358043Z [2024-07-04 02:20:05,953: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df966d60-268b-4342-afa8-4071c36518e4] received 2024-07-04T02:20:05.967848626Z [2024-07-04 02:20:05,967: INFO/ForkPoolWorker-15] [df966d60-268b-4342-afa8-4071c36518e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:20:06.267496132Z [2024-07-04 02:20:06,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:20:07.392705303Z [2024-07-04 02:20:07,392: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:20:07.395887493Z [2024-07-04 02:20:07,395: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:07.437292252Z [2024-07-04 02:20:07,436: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:20:07.440086188Z [2024-07-04 02:20:07,439: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:07.440635490Z [2024-07-04 02:20:07,440: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:07.441176141Z [2024-07-04 02:20:07,440: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:07.441489435Z [2024-07-04 02:20:07,441: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:20:07.442211163Z [2024-07-04 02:20:07,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:20:07.442555912Z [2024-07-04 02:20:07,442: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:07.578132508Z [2024-07-04 02:20:07,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:08.244484590Z [2024-07-04 02:20:08,243: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[df966d60-268b-4342-afa8-4071c36518e4] succeeded in 2.2854755050002495s: None 2024-07-04T02:20:08.456097916Z [2024-07-04 02:20:08,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64a409a1-2b2f-41b2-8425-4b54e76c8b23] received 2024-07-04T02:20:08.467167713Z [2024-07-04 02:20:08,466: INFO/ForkPoolWorker-15] [64a409a1-2b2f-41b2-8425-4b54e76c8b23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:20:08.741785192Z [2024-07-04 02:20:08,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:20:09.920485112Z [2024-07-04 02:20:09,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:20:09.923695390Z [2024-07-04 02:20:09,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:20:09.966389746Z [2024-07-04 02:20:09,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:20:09.968741628Z [2024-07-04 02:20:09,968: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:20:09.968985318Z [2024-07-04 02:20:09,968: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:20:09.969991577Z [2024-07-04 02:20:09,969: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:20:09.971115552Z [2024-07-04 02:20:09,970: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:20:09.971713278Z [2024-07-04 02:20:09,971: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:20:09.972002742Z [2024-07-04 02:20:09,971: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:20:10.074173154Z [2024-07-04 02:20:10,073: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:20:10.876046899Z [2024-07-04 02:20:10,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64a409a1-2b2f-41b2-8425-4b54e76c8b23] succeeded in 2.417949370000315s: None 2024-07-04T02:21:01.072608881Z [2024-07-04 02:21:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49e835ce-293f-4324-81a3-f65ec65423be] received 2024-07-04T02:21:01.083236002Z [2024-07-04 02:21:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b5bf152-92db-4df0-9886-7c55d989487b] received 2024-07-04T02:21:01.098060291Z [2024-07-04 02:21:01,097: INFO/ForkPoolWorker-15] [49e835ce-293f-4324-81a3-f65ec65423be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:21:01.103449790Z [2024-07-04 02:21:01,102: INFO/ForkPoolWorker-16] [1b5bf152-92db-4df0-9886-7c55d989487b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:21:01.384758775Z [2024-07-04 02:21:01,379: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:21:01.441349540Z [2024-07-04 02:21:01,436: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:21:02.666145976Z [2024-07-04 02:21:02,665: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:21:02.669591598Z [2024-07-04 02:21:02,669: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:21:02.707888781Z [2024-07-04 02:21:02,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:21:02.709370869Z [2024-07-04 02:21:02,709: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:21:02.709424435Z [2024-07-04 02:21:02,709: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:21:02.709661344Z [2024-07-04 02:21:02,709: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:21:02.709810411Z [2024-07-04 02:21:02,709: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:21:02.711124355Z [2024-07-04 02:21:02,710: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:21:02.711193585Z [2024-07-04 02:21:02,711: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:21:02.765859053Z [2024-07-04 02:21:02,765: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:21:02.769321870Z [2024-07-04 02:21:02,768: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:21:02.794167221Z [2024-07-04 02:21:02,793: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:21:02.816183320Z [2024-07-04 02:21:02,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:21:02.819695512Z [2024-07-04 02:21:02,819: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:21:02.819951887Z [2024-07-04 02:21:02,819: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:21:02.820318610Z [2024-07-04 02:21:02,820: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:21:02.820518803Z [2024-07-04 02:21:02,820: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:21:02.820974013Z [2024-07-04 02:21:02,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:21:02.821289882Z [2024-07-04 02:21:02,821: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:21:02.944978698Z [2024-07-04 02:21:02,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:21:05.068620436Z [2024-07-04 02:21:05,068: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1b5bf152-92db-4df0-9886-7c55d989487b] succeeded in 3.9802728370000295s: None 2024-07-04T02:21:06.578579654Z [2024-07-04 02:21:06,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49e835ce-293f-4324-81a3-f65ec65423be] succeeded in 5.502316295000128s: None 2024-07-04T02:22:00.525881911Z [2024-07-04 02:22:00,525: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1de0cb13-857c-49ca-b407-b9bb8e08e576] received 2024-07-04T02:22:00.531718884Z [2024-07-04 02:22:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45a4461d-4639-4858-a296-e458a020da14] received 2024-07-04T02:22:00.550459351Z [2024-07-04 02:22:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aabbcb65-814c-4d6a-a62d-d666313cd9e3] received 2024-07-04T02:22:00.560350956Z [2024-07-04 02:22:00,559: INFO/ForkPoolWorker-15] [1de0cb13-857c-49ca-b407-b9bb8e08e576] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:22:00.567856499Z [2024-07-04 02:22:00,567: INFO/ForkPoolWorker-16] [45a4461d-4639-4858-a296-e458a020da14] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:22:00.595671836Z [2024-07-04 02:22:00,594: INFO/ForkPoolWorker-1] [aabbcb65-814c-4d6a-a62d-d666313cd9e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:22:00.990584301Z [2024-07-04 02:22:00,982: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:22:01.031112670Z [2024-07-04 02:22:01,019: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:22:01.308933077Z [2024-07-04 02:22:01,304: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:22:01.636689660Z [2024-07-04 02:22:01,636: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:22:02.213677188Z [2024-07-04 02:22:02,213: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[45a4461d-4639-4858-a296-e458a020da14] succeeded in 1.667272529999991s: None 2024-07-04T02:22:02.306845225Z [2024-07-04 02:22:02,306: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:22:02.310110338Z [2024-07-04 02:22:02,309: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:22:02.344434680Z [2024-07-04 02:22:02,344: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:22:02.347440352Z [2024-07-04 02:22:02,347: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:22:02.347562922Z [2024-07-04 02:22:02,347: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:22:02.347722330Z [2024-07-04 02:22:02,347: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:22:02.347834874Z [2024-07-04 02:22:02,347: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:22:02.348076112Z [2024-07-04 02:22:02,347: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:22:02.348195822Z [2024-07-04 02:22:02,348: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:22:02.428817918Z [2024-07-04 02:22:02,428: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:22:02.645281274Z [2024-07-04 02:22:02,644: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:22:02.648527568Z [2024-07-04 02:22:02,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:22:02.671799590Z [2024-07-04 02:22:02,671: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:22:02.673019279Z [2024-07-04 02:22:02,672: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:22:02.673069563Z [2024-07-04 02:22:02,672: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:22:02.673237394Z [2024-07-04 02:22:02,673: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:22:02.673293529Z [2024-07-04 02:22:02,673: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:22:02.673562924Z [2024-07-04 02:22:02,673: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:22:02.673615551Z [2024-07-04 02:22:02,673: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:22:02.773387677Z [2024-07-04 02:22:02,773: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:22:04.034463687Z [2024-07-04 02:22:04,033: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aabbcb65-814c-4d6a-a62d-d666313cd9e3] succeeded in 3.4742295340001874s: None 2024-07-04T02:22:06.443674120Z [2024-07-04 02:22:06,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1de0cb13-857c-49ca-b407-b9bb8e08e576] succeeded in 5.908711616999881s: None 2024-07-04T02:23:01.229919888Z [2024-07-04 02:23:01,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[729265d8-d04f-49c1-8cc9-e3c1e2a5f214] received 2024-07-04T02:23:01.234240252Z [2024-07-04 02:23:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4e46d05-dba9-4f19-89be-7066d2789d44] received 2024-07-04T02:23:01.259822093Z [2024-07-04 02:23:01,259: INFO/ForkPoolWorker-15] [729265d8-d04f-49c1-8cc9-e3c1e2a5f214] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:23:01.269756686Z [2024-07-04 02:23:01,268: INFO/ForkPoolWorker-16] [d4e46d05-dba9-4f19-89be-7066d2789d44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:23:01.660326569Z [2024-07-04 02:23:01,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:23:01.670767374Z [2024-07-04 02:23:01,665: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:23:03.077027585Z [2024-07-04 02:23:03,076: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:23:03.080867473Z [2024-07-04 02:23:03,080: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:23:03.125122967Z [2024-07-04 02:23:03,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:23:03.128375469Z [2024-07-04 02:23:03,128: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:23:03.129208092Z [2024-07-04 02:23:03,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:23:03.132625862Z [2024-07-04 02:23:03,132: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:23:03.132771667Z [2024-07-04 02:23:03,132: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:23:03.133038317Z [2024-07-04 02:23:03,132: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:23:03.133121790Z [2024-07-04 02:23:03,133: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:23:03.133408075Z [2024-07-04 02:23:03,133: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:23:03.133610570Z [2024-07-04 02:23:03,133: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:23:03.165732517Z [2024-07-04 02:23:03,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:23:03.171849461Z [2024-07-04 02:23:03,171: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:23:03.172223525Z [2024-07-04 02:23:03,172: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:23:03.172630067Z [2024-07-04 02:23:03,172: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:23:03.172826242Z [2024-07-04 02:23:03,172: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:23:03.173809660Z [2024-07-04 02:23:03,173: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:23:03.174024768Z [2024-07-04 02:23:03,173: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:23:03.232331395Z [2024-07-04 02:23:03,232: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:23:03.308177959Z [2024-07-04 02:23:03,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:23:05.430200096Z [2024-07-04 02:23:05,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4e46d05-dba9-4f19-89be-7066d2789d44] succeeded in 4.188669192999896s: None 2024-07-04T02:23:06.130783534Z [2024-07-04 02:23:06,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[729265d8-d04f-49c1-8cc9-e3c1e2a5f214] succeeded in 4.888350067999909s: None 2024-07-04T02:24:00.212344191Z [2024-07-04 02:24:00,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9ff6d65-aebc-4746-81a7-3f59e5484f15] received 2024-07-04T02:24:00.223579369Z [2024-07-04 02:24:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edbba634-5806-477e-898b-8852d3251c0c] received 2024-07-04T02:24:00.231214186Z [2024-07-04 02:24:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5598d2ee-19a6-4bd5-a8dc-43bf405f88ab] received 2024-07-04T02:24:00.245293277Z [2024-07-04 02:24:00,244: INFO/ForkPoolWorker-1] [5598d2ee-19a6-4bd5-a8dc-43bf405f88ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:24:00.251453760Z [2024-07-04 02:24:00,250: INFO/ForkPoolWorker-16] [edbba634-5806-477e-898b-8852d3251c0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:24:00.253155343Z [2024-07-04 02:24:00,252: INFO/ForkPoolWorker-15] [c9ff6d65-aebc-4746-81a7-3f59e5484f15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:24:00.756524434Z [2024-07-04 02:24:00,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:24:00.971162932Z [2024-07-04 02:24:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:24:01.023644440Z [2024-07-04 02:24:01,019: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:24:01.387542869Z [2024-07-04 02:24:01,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:24:02.075138305Z [2024-07-04 02:24:02,074: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5598d2ee-19a6-4bd5-a8dc-43bf405f88ab] succeeded in 1.84120181399976s: None 2024-07-04T02:24:02.377687615Z [2024-07-04 02:24:02,377: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:24:02.381659228Z [2024-07-04 02:24:02,381: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:24:02.409318687Z [2024-07-04 02:24:02,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:24:02.411812403Z [2024-07-04 02:24:02,411: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:24:02.411956434Z [2024-07-04 02:24:02,411: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:24:02.413051924Z [2024-07-04 02:24:02,412: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:24:02.413861176Z [2024-07-04 02:24:02,413: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:24:02.414154358Z [2024-07-04 02:24:02,414: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:24:02.414203538Z [2024-07-04 02:24:02,414: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:24:02.466733583Z [2024-07-04 02:24:02,466: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:24:02.471561584Z [2024-07-04 02:24:02,470: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:24:02.511281611Z [2024-07-04 02:24:02,511: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:24:02.512054312Z [2024-07-04 02:24:02,511: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:24:02.513341658Z [2024-07-04 02:24:02,513: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:24:02.513489516Z [2024-07-04 02:24:02,513: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:24:02.513707746Z [2024-07-04 02:24:02,513: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:24:02.513811932Z [2024-07-04 02:24:02,513: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:24:02.514188035Z [2024-07-04 02:24:02,514: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:24:02.514367789Z [2024-07-04 02:24:02,514: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:24:02.591791461Z [2024-07-04 02:24:02,591: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:24:04.233106362Z [2024-07-04 02:24:04,232: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[edbba634-5806-477e-898b-8852d3251c0c] succeeded in 4.005460686999868s: None 2024-07-04T02:24:04.694564581Z [2024-07-04 02:24:04,693: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9ff6d65-aebc-4746-81a7-3f59e5484f15] succeeded in 4.475198060000366s: None 2024-07-04T02:25:00.753998111Z [2024-07-04 02:25:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579e5621-0a34-4845-98bd-f2ed06ddce0f] received 2024-07-04T02:25:00.770837294Z [2024-07-04 02:25:00,770: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7a33a0f-c5e7-4e48-9012-129ce5a34097] received 2024-07-04T02:25:00.775077014Z [2024-07-04 02:25:00,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc2e6d90-264d-4308-bfd8-31df6880275d] received 2024-07-04T02:25:00.779414209Z [2024-07-04 02:25:00,779: INFO/ForkPoolWorker-15] [579e5621-0a34-4845-98bd-f2ed06ddce0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:25:00.813314897Z [2024-07-04 02:25:00,812: INFO/ForkPoolWorker-1] [dc2e6d90-264d-4308-bfd8-31df6880275d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:00.814309354Z [2024-07-04 02:25:00,813: INFO/ForkPoolWorker-16] [a7a33a0f-c5e7-4e48-9012-129ce5a34097] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:25:01.147884462Z [2024-07-04 02:25:01,143: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:25:01.197106430Z [2024-07-04 02:25:01,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:25:01.367459120Z [2024-07-04 02:25:01,363: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:25:02.615714950Z [2024-07-04 02:25:02,615: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:25:02.619044115Z [2024-07-04 02:25:02,618: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:02.657935745Z [2024-07-04 02:25:02,657: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:25:02.659587660Z [2024-07-04 02:25:02,659: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:02.659603843Z [2024-07-04 02:25:02,659: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:02.659788557Z [2024-07-04 02:25:02,659: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:02.659897869Z [2024-07-04 02:25:02,659: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:25:02.660194838Z [2024-07-04 02:25:02,660: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:25:02.660323551Z [2024-07-04 02:25:02,660: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:02.693286642Z [2024-07-04 02:25:02,692: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:25:02.696713468Z [2024-07-04 02:25:02,696: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:02.723997079Z [2024-07-04 02:25:02,723: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:25:02.725145718Z [2024-07-04 02:25:02,724: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:02.725371866Z [2024-07-04 02:25:02,725: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:02.725576044Z [2024-07-04 02:25:02,725: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:02.725672675Z [2024-07-04 02:25:02,725: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:25:02.726006057Z [2024-07-04 02:25:02,725: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:25:02.726174004Z [2024-07-04 02:25:02,726: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:02.727401573Z [2024-07-04 02:25:02,723: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:25:02.732490334Z [2024-07-04 02:25:02,731: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:02.757430786Z [2024-07-04 02:25:02,757: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:02.779500462Z [2024-07-04 02:25:02,778: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:25:02.782168287Z [2024-07-04 02:25:02,781: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:02.783210842Z [2024-07-04 02:25:02,782: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:02.783898944Z [2024-07-04 02:25:02,783: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:02.786105654Z [2024-07-04 02:25:02,785: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:25:02.786702894Z [2024-07-04 02:25:02,786: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:25:02.789965748Z [2024-07-04 02:25:02,786: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:02.815866964Z [2024-07-04 02:25:02,815: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:02.939877844Z [2024-07-04 02:25:02,939: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:03.403222129Z [2024-07-04 02:25:03,402: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc2e6d90-264d-4308-bfd8-31df6880275d] succeeded in 2.6243769600000633s: None 2024-07-04T02:25:04.021085120Z [2024-07-04 02:25:04,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b54db4c-df23-42ba-bee4-ea63186d3bf5] received 2024-07-04T02:25:04.035320881Z [2024-07-04 02:25:04,034: INFO/ForkPoolWorker-1] [4b54db4c-df23-42ba-bee4-ea63186d3bf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:04.338320748Z [2024-07-04 02:25:04,335: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:25:04.575585990Z [2024-07-04 02:25:04,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[579e5621-0a34-4845-98bd-f2ed06ddce0f] succeeded in 3.8170585050002046s: None 2024-07-04T02:25:04.908487642Z [2024-07-04 02:25:04,908: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a7a33a0f-c5e7-4e48-9012-129ce5a34097] succeeded in 4.133647704000396s: None 2024-07-04T02:25:05.506963462Z [2024-07-04 02:25:05,506: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:25:05.510359901Z [2024-07-04 02:25:05,509: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:05.546073498Z [2024-07-04 02:25:05,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:25:05.548764564Z [2024-07-04 02:25:05,548: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:05.548799810Z [2024-07-04 02:25:05,548: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:05.549023934Z [2024-07-04 02:25:05,548: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:05.549044438Z [2024-07-04 02:25:05,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:25:05.549456803Z [2024-07-04 02:25:05,549: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:25:05.549481790Z [2024-07-04 02:25:05,549: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:05.649601385Z [2024-07-04 02:25:05,649: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:06.419294639Z [2024-07-04 02:25:06,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b54db4c-df23-42ba-bee4-ea63186d3bf5] succeeded in 2.394256067999777s: None 2024-07-04T02:25:06.482584131Z [2024-07-04 02:25:06,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1165959-ec2e-44c7-90af-a8215daa3895] received 2024-07-04T02:25:06.495451176Z [2024-07-04 02:25:06,495: INFO/ForkPoolWorker-15] [a1165959-ec2e-44c7-90af-a8215daa3895] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:25:06.771899537Z [2024-07-04 02:25:06,768: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:25:08.012471234Z [2024-07-04 02:25:08,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:25:08.015907373Z [2024-07-04 02:25:08,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:08.036528721Z [2024-07-04 02:25:08,036: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:25:08.044929755Z [2024-07-04 02:25:08,043: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:08.045062255Z [2024-07-04 02:25:08,044: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:08.045229375Z [2024-07-04 02:25:08,045: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:08.045331302Z [2024-07-04 02:25:08,045: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:25:08.046569038Z [2024-07-04 02:25:08,046: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:25:08.046634912Z [2024-07-04 02:25:08,046: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:08.146498762Z [2024-07-04 02:25:08,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:08.794686570Z [2024-07-04 02:25:08,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1165959-ec2e-44c7-90af-a8215daa3895] succeeded in 2.309639834999871s: None 2024-07-04T02:25:09.274278467Z [2024-07-04 02:25:09,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9603574-2a9d-4b11-bc39-85a7415e82e4] received 2024-07-04T02:25:09.282482989Z [2024-07-04 02:25:09,282: INFO/ForkPoolWorker-15] [d9603574-2a9d-4b11-bc39-85a7415e82e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:25:09.632818545Z [2024-07-04 02:25:09,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:25:11.019659603Z [2024-07-04 02:25:11,019: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:25:11.023547222Z [2024-07-04 02:25:11,023: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:25:11.050959875Z [2024-07-04 02:25:11,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:25:11.053297155Z [2024-07-04 02:25:11,052: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:25:11.053340738Z [2024-07-04 02:25:11,053: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:25:11.055494128Z [2024-07-04 02:25:11,055: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:25:11.055600481Z [2024-07-04 02:25:11,055: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:25:11.056161617Z [2024-07-04 02:25:11,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:25:11.057298090Z [2024-07-04 02:25:11,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:25:11.168902946Z [2024-07-04 02:25:11,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:25:11.866760426Z [2024-07-04 02:25:11,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9603574-2a9d-4b11-bc39-85a7415e82e4] succeeded in 2.590254982999795s: None 2024-07-04T02:26:01.291141742Z [2024-07-04 02:26:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd8aed8b-f82a-4eab-86bc-6a856621d72a] received 2024-07-04T02:26:01.308274171Z [2024-07-04 02:26:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e9ccde5-4a49-4862-9b48-59f606b2e2ca] received 2024-07-04T02:26:01.310854720Z [2024-07-04 02:26:01,310: INFO/ForkPoolWorker-15] [dd8aed8b-f82a-4eab-86bc-6a856621d72a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:26:01.313843466Z [2024-07-04 02:26:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2083b25c-b6f5-48e0-8bc4-83c62e5d0166] received 2024-07-04T02:26:01.334021761Z [2024-07-04 02:26:01,333: INFO/ForkPoolWorker-1] [2083b25c-b6f5-48e0-8bc4-83c62e5d0166] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:26:01.340325476Z [2024-07-04 02:26:01,339: INFO/ForkPoolWorker-16] [5e9ccde5-4a49-4862-9b48-59f606b2e2ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:26:01.732731883Z [2024-07-04 02:26:01,726: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:26:01.841336989Z [2024-07-04 02:26:01,832: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:26:01.932269340Z [2024-07-04 02:26:01,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:26:02.373379100Z [2024-07-04 02:26:02,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:26:03.389931251Z [2024-07-04 02:26:03,389: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e9ccde5-4a49-4862-9b48-59f606b2e2ca] succeeded in 2.0726892180000505s: None 2024-07-04T02:26:03.554639368Z [2024-07-04 02:26:03,554: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:26:03.557800347Z [2024-07-04 02:26:03,557: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:26:03.612903447Z [2024-07-04 02:26:03,612: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:26:03.619939193Z [2024-07-04 02:26:03,619: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:26:03.620105099Z [2024-07-04 02:26:03,619: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:26:03.620340375Z [2024-07-04 02:26:03,620: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:26:03.620438480Z [2024-07-04 02:26:03,620: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:26:03.620816680Z [2024-07-04 02:26:03,620: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:26:03.620981484Z [2024-07-04 02:26:03,620: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:26:03.716133652Z [2024-07-04 02:26:03,715: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:26:04.013482886Z [2024-07-04 02:26:04,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:26:04.029628832Z [2024-07-04 02:26:04,026: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:26:04.088179588Z [2024-07-04 02:26:04,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:26:04.090953296Z [2024-07-04 02:26:04,090: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:26:04.091042205Z [2024-07-04 02:26:04,090: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:26:04.091209479Z [2024-07-04 02:26:04,091: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:26:04.091284652Z [2024-07-04 02:26:04,091: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:26:04.091553927Z [2024-07-04 02:26:04,091: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:26:04.091999885Z [2024-07-04 02:26:04,091: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:26:04.244440111Z [2024-07-04 02:26:04,244: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:26:05.419025388Z [2024-07-04 02:26:05,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2083b25c-b6f5-48e0-8bc4-83c62e5d0166] succeeded in 4.100080534999961s: None 2024-07-04T02:26:06.329891479Z [2024-07-04 02:26:06,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd8aed8b-f82a-4eab-86bc-6a856621d72a] succeeded in 5.033934785000383s: None 2024-07-04T02:27:00.913072200Z [2024-07-04 02:27:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[925cf778-28ee-4bf6-a9ad-d13d1c2f7406] received 2024-07-04T02:27:00.936105678Z [2024-07-04 02:27:00,935: INFO/ForkPoolWorker-15] [925cf778-28ee-4bf6-a9ad-d13d1c2f7406] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:27:00.939653948Z [2024-07-04 02:27:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65a0869b-9b04-46aa-b987-77bcb65357f5] received 2024-07-04T02:27:00.968124307Z [2024-07-04 02:27:00,967: INFO/ForkPoolWorker-16] [65a0869b-9b04-46aa-b987-77bcb65357f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:27:01.397192464Z [2024-07-04 02:27:01,392: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:27:01.443940227Z [2024-07-04 02:27:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:27:02.635310938Z [2024-07-04 02:27:02,634: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:27:02.638942053Z [2024-07-04 02:27:02,638: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:27:02.688012175Z [2024-07-04 02:27:02,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:27:02.689900842Z [2024-07-04 02:27:02,689: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:27:02.690151490Z [2024-07-04 02:27:02,689: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:27:02.690375779Z [2024-07-04 02:27:02,690: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:27:02.690531673Z [2024-07-04 02:27:02,690: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:27:02.690862641Z [2024-07-04 02:27:02,690: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:27:02.691021603Z [2024-07-04 02:27:02,690: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:27:02.710571754Z [2024-07-04 02:27:02,710: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:27:02.714920493Z [2024-07-04 02:27:02,714: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:27:02.749737599Z [2024-07-04 02:27:02,749: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:27:02.751956609Z [2024-07-04 02:27:02,751: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:27:02.752200223Z [2024-07-04 02:27:02,752: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:27:02.752805538Z [2024-07-04 02:27:02,752: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:27:02.752975038Z [2024-07-04 02:27:02,752: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:27:02.753315189Z [2024-07-04 02:27:02,753: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:27:02.753517206Z [2024-07-04 02:27:02,753: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:27:02.808921557Z [2024-07-04 02:27:02,808: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:27:02.861275708Z [2024-07-04 02:27:02,860: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:27:04.593078064Z [2024-07-04 02:27:04,592: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65a0869b-9b04-46aa-b987-77bcb65357f5] succeeded in 3.650699928999984s: None 2024-07-04T02:27:05.252145291Z [2024-07-04 02:27:05,251: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[925cf778-28ee-4bf6-a9ad-d13d1c2f7406] succeeded in 4.336347105000186s: None 2024-07-04T02:28:00.972635172Z [2024-07-04 02:28:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3e9809a-fc81-4f4f-98ad-e282e9305f3e] received 2024-07-04T02:28:00.992979196Z [2024-07-04 02:28:00,992: INFO/ForkPoolWorker-15] [f3e9809a-fc81-4f4f-98ad-e282e9305f3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:28:01.011758459Z [2024-07-04 02:28:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00698282-55ea-4a34-87b3-8ae77d5d2bfa] received 2024-07-04T02:28:01.027219422Z [2024-07-04 02:28:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45eb5a3c-28c0-44c8-99a7-64990f04be7c] received 2024-07-04T02:28:01.046510790Z [2024-07-04 02:28:01,046: INFO/ForkPoolWorker-16] [00698282-55ea-4a34-87b3-8ae77d5d2bfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:28:01.049441134Z [2024-07-04 02:28:01,048: INFO/ForkPoolWorker-1] [45eb5a3c-28c0-44c8-99a7-64990f04be7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:28:01.395262111Z [2024-07-04 02:28:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:28:01.422073736Z [2024-07-04 02:28:01,415: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:28:01.431903646Z [2024-07-04 02:28:01,428: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:28:01.670707288Z [2024-07-04 02:28:01,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:28:02.417423406Z [2024-07-04 02:28:02,416: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f3e9809a-fc81-4f4f-98ad-e282e9305f3e] succeeded in 1.4428453360005733s: None 2024-07-04T02:28:02.825996281Z [2024-07-04 02:28:02,824: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:28:02.827535935Z [2024-07-04 02:28:02,827: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:28:02.829943259Z [2024-07-04 02:28:02,829: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:28:02.831117851Z [2024-07-04 02:28:02,830: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:28:02.861417253Z [2024-07-04 02:28:02,861: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:28:02.864726444Z [2024-07-04 02:28:02,864: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:28:02.864796252Z [2024-07-04 02:28:02,864: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:28:02.864969356Z [2024-07-04 02:28:02,864: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:28:02.864997617Z [2024-07-04 02:28:02,864: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:28:02.865319841Z [2024-07-04 02:28:02,865: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:28:02.865385330Z [2024-07-04 02:28:02,865: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:28:02.868585442Z [2024-07-04 02:28:02,868: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:28:02.873538602Z [2024-07-04 02:28:02,873: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:28:02.873887634Z [2024-07-04 02:28:02,873: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:28:02.874130719Z [2024-07-04 02:28:02,873: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:28:02.874695199Z [2024-07-04 02:28:02,874: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:28:02.875558026Z [2024-07-04 02:28:02,875: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:28:02.875773531Z [2024-07-04 02:28:02,875: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:28:02.969108206Z [2024-07-04 02:28:02,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:28:02.972318019Z [2024-07-04 02:28:02,971: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:28:05.331876691Z [2024-07-04 02:28:05,331: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00698282-55ea-4a34-87b3-8ae77d5d2bfa] succeeded in 4.307427443999586s: None 2024-07-04T02:28:06.061080775Z [2024-07-04 02:28:06,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[45eb5a3c-28c0-44c8-99a7-64990f04be7c] succeeded in 5.028594685999451s: None 2024-07-04T02:29:00.775886631Z [2024-07-04 02:29:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b57785fb-d23d-4420-9d1d-78fc544d6c75] received 2024-07-04T02:29:00.794520520Z [2024-07-04 02:29:00,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9b81911-d9c7-4706-80f2-0e511567b3f6] received 2024-07-04T02:29:00.809639883Z [2024-07-04 02:29:00,809: INFO/ForkPoolWorker-15] [b57785fb-d23d-4420-9d1d-78fc544d6c75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:29:00.837457774Z [2024-07-04 02:29:00,836: INFO/ForkPoolWorker-16] [a9b81911-d9c7-4706-80f2-0e511567b3f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:29:01.153324089Z [2024-07-04 02:29:01,149: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:29:01.324289673Z [2024-07-04 02:29:01,320: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:29:02.585866046Z [2024-07-04 02:29:02,585: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:29:02.592274872Z [2024-07-04 02:29:02,591: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:29:02.625801975Z [2024-07-04 02:29:02,625: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:29:02.627012087Z [2024-07-04 02:29:02,626: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:29:02.627099072Z [2024-07-04 02:29:02,626: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:29:02.627229016Z [2024-07-04 02:29:02,627: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:29:02.627286780Z [2024-07-04 02:29:02,627: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:29:02.627518015Z [2024-07-04 02:29:02,627: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:29:02.627632101Z [2024-07-04 02:29:02,627: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:29:02.696004017Z [2024-07-04 02:29:02,695: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:29:02.700506684Z [2024-07-04 02:29:02,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:29:02.735469140Z [2024-07-04 02:29:02,735: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:29:02.739945294Z [2024-07-04 02:29:02,739: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:29:02.743560564Z [2024-07-04 02:29:02,743: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:29:02.743981848Z [2024-07-04 02:29:02,743: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:29:02.744158251Z [2024-07-04 02:29:02,743: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:29:02.744603702Z [2024-07-04 02:29:02,744: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:29:02.747303210Z [2024-07-04 02:29:02,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:29:02.747993536Z [2024-07-04 02:29:02,747: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:29:02.865802062Z [2024-07-04 02:29:02,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:29:04.651743355Z [2024-07-04 02:29:04,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b57785fb-d23d-4420-9d1d-78fc544d6c75] succeeded in 3.862357339000482s: None 2024-07-04T02:29:05.041136128Z [2024-07-04 02:29:05,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a9b81911-d9c7-4706-80f2-0e511567b3f6] succeeded in 4.2392218919994775s: None 2024-07-04T02:30:00.539492075Z [2024-07-04 02:30:00,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83ee9670-c558-4e28-8877-adb218f1a5c0] received 2024-07-04T02:30:00.545189744Z [2024-07-04 02:30:00,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fb15cba-1f0e-4122-b20a-3eeeb3a9fbb0] received 2024-07-04T02:30:00.548059523Z [2024-07-04 02:30:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0644125-a60b-4297-8507-96024ba0ce8b] received 2024-07-04T02:30:00.562838072Z [2024-07-04 02:30:00,562: INFO/ForkPoolWorker-15] [83ee9670-c558-4e28-8877-adb218f1a5c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:00.566439868Z [2024-07-04 02:30:00,565: INFO/ForkPoolWorker-1] [b0644125-a60b-4297-8507-96024ba0ce8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:30:00.567555726Z [2024-07-04 02:30:00,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f612bf1a-3c39-4bfa-aefa-0b92e35e5663] received 2024-07-04T02:30:00.568016173Z [2024-07-04 02:30:00,567: INFO/ForkPoolWorker-16] [5fb15cba-1f0e-4122-b20a-3eeeb3a9fbb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:30:00.592421437Z [2024-07-04 02:30:00,592: INFO/ForkPoolWorker-2] [f612bf1a-3c39-4bfa-aefa-0b92e35e5663] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:30:01.007210364Z [2024-07-04 02:30:01,003: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:30:01.164473201Z [2024-07-04 02:30:01,154: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:30:01.257142910Z [2024-07-04 02:30:01,251: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:30:01.282547489Z [2024-07-04 02:30:01,273: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:30:01.666694318Z [2024-07-04 02:30:01,666: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:02.517761022Z [2024-07-04 02:30:02,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5fb15cba-1f0e-4122-b20a-3eeeb3a9fbb0] succeeded in 1.96835461900082s: None 2024-07-04T02:30:02.557057910Z [2024-07-04 02:30:02,556: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:30:02.560729365Z [2024-07-04 02:30:02,560: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:02.593905576Z [2024-07-04 02:30:02,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:30:02.595710424Z [2024-07-04 02:30:02,595: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:02.595909162Z [2024-07-04 02:30:02,595: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:02.596114544Z [2024-07-04 02:30:02,595: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:02.596224766Z [2024-07-04 02:30:02,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:30:02.596513335Z [2024-07-04 02:30:02,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:30:02.596625148Z [2024-07-04 02:30:02,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:02.687940966Z [2024-07-04 02:30:02,687: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:02.720026024Z [2024-07-04 02:30:02,719: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:30:02.723399403Z [2024-07-04 02:30:02,722: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:02.731616111Z [2024-07-04 02:30:02,731: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:30:02.735074726Z [2024-07-04 02:30:02,734: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:02.755801834Z [2024-07-04 02:30:02,755: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:30:02.756714135Z [2024-07-04 02:30:02,756: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:02.756755462Z [2024-07-04 02:30:02,756: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:02.756908076Z [2024-07-04 02:30:02,756: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:02.756938655Z [2024-07-04 02:30:02,756: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:30:02.757252857Z [2024-07-04 02:30:02,757: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:30:02.757269900Z [2024-07-04 02:30:02,757: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:02.770184665Z [2024-07-04 02:30:02,769: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:30:02.772667527Z [2024-07-04 02:30:02,772: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:02.772895225Z [2024-07-04 02:30:02,772: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:02.773735806Z [2024-07-04 02:30:02,773: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:02.773958890Z [2024-07-04 02:30:02,773: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:30:02.774320012Z [2024-07-04 02:30:02,774: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:30:02.774445975Z [2024-07-04 02:30:02,774: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:02.835739506Z [2024-07-04 02:30:02,835: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:02.853539410Z [2024-07-04 02:30:02,853: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:03.467547970Z [2024-07-04 02:30:03,466: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83ee9670-c558-4e28-8877-adb218f1a5c0] succeeded in 2.924655064000035s: None 2024-07-04T02:30:04.281104572Z [2024-07-04 02:30:04,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b8de9f2-82da-4234-a62e-e286742f2d8d] received 2024-07-04T02:30:04.295749294Z [2024-07-04 02:30:04,295: INFO/ForkPoolWorker-15] [5b8de9f2-82da-4234-a62e-e286742f2d8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:04.508844334Z [2024-07-04 02:30:04,508: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f612bf1a-3c39-4bfa-aefa-0b92e35e5663] succeeded in 3.9354429869999876s: None 2024-07-04T02:30:04.617011400Z [2024-07-04 02:30:04,613: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:30:04.834371693Z [2024-07-04 02:30:04,833: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0644125-a60b-4297-8507-96024ba0ce8b] succeeded in 4.283288560999608s: None 2024-07-04T02:30:05.828262182Z [2024-07-04 02:30:05,827: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:30:05.831589522Z [2024-07-04 02:30:05,831: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:05.869540409Z [2024-07-04 02:30:05,869: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:30:05.871617842Z [2024-07-04 02:30:05,871: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:05.871785360Z [2024-07-04 02:30:05,871: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:05.872067434Z [2024-07-04 02:30:05,871: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:05.872208933Z [2024-07-04 02:30:05,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:30:05.872603090Z [2024-07-04 02:30:05,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:30:05.872846837Z [2024-07-04 02:30:05,872: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:05.948773517Z [2024-07-04 02:30:05,948: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:06.667300790Z [2024-07-04 02:30:06,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b8de9f2-82da-4234-a62e-e286742f2d8d] succeeded in 2.3827066889998605s: None 2024-07-04T02:30:06.772360657Z [2024-07-04 02:30:06,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[911f5d74-5719-4226-bb5d-cdcc3e8f49d9] received 2024-07-04T02:30:06.788675893Z [2024-07-04 02:30:06,788: INFO/ForkPoolWorker-15] [911f5d74-5719-4226-bb5d-cdcc3e8f49d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:30:07.131284040Z [2024-07-04 02:30:07,127: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:30:08.318396311Z [2024-07-04 02:30:08,317: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:30:08.322088892Z [2024-07-04 02:30:08,321: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:08.351417373Z [2024-07-04 02:30:08,351: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:30:08.353827062Z [2024-07-04 02:30:08,353: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:08.354404441Z [2024-07-04 02:30:08,354: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:08.354694772Z [2024-07-04 02:30:08,354: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:08.354803374Z [2024-07-04 02:30:08,354: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:30:08.355186612Z [2024-07-04 02:30:08,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:30:08.355343717Z [2024-07-04 02:30:08,355: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:08.506900493Z [2024-07-04 02:30:08,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:09.208883716Z [2024-07-04 02:30:09,208: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[911f5d74-5719-4226-bb5d-cdcc3e8f49d9] succeeded in 2.4314065990001836s: None 2024-07-04T02:30:09.600062684Z [2024-07-04 02:30:09,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c34f1e6f-9e6c-41b1-84bd-6220123a7085] received 2024-07-04T02:30:09.616973275Z [2024-07-04 02:30:09,616: INFO/ForkPoolWorker-15] [c34f1e6f-9e6c-41b1-84bd-6220123a7085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:30:09.968601909Z [2024-07-04 02:30:09,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:30:11.262713661Z [2024-07-04 02:30:11,259: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:30:11.266394476Z [2024-07-04 02:30:11,265: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:30:11.300461058Z [2024-07-04 02:30:11,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:30:11.302395623Z [2024-07-04 02:30:11,302: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:30:11.302602777Z [2024-07-04 02:30:11,302: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:30:11.302972723Z [2024-07-04 02:30:11,302: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:30:11.303176555Z [2024-07-04 02:30:11,302: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:30:11.303579696Z [2024-07-04 02:30:11,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:30:11.304379939Z [2024-07-04 02:30:11,303: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:30:11.387610739Z [2024-07-04 02:30:11,387: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:30:12.091023968Z [2024-07-04 02:30:12,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c34f1e6f-9e6c-41b1-84bd-6220123a7085] succeeded in 2.4889566820002074s: None 2024-07-04T02:31:00.531779652Z [2024-07-04 02:31:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfacd16d-f002-4265-85b7-b88492acb86b] received 2024-07-04T02:31:00.545514396Z [2024-07-04 02:31:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efd3c103-7160-4475-98dc-0bb0fc19b95a] received 2024-07-04T02:31:00.567970578Z [2024-07-04 02:31:00,567: INFO/ForkPoolWorker-15] [dfacd16d-f002-4265-85b7-b88492acb86b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:31:00.569906459Z [2024-07-04 02:31:00,569: INFO/ForkPoolWorker-16] [efd3c103-7160-4475-98dc-0bb0fc19b95a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:31:01.007888566Z [2024-07-04 02:31:01,002: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:31:01.032704507Z [2024-07-04 02:31:01,026: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:31:02.369223259Z [2024-07-04 02:31:02,368: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:31:02.372843569Z [2024-07-04 02:31:02,372: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:31:02.407430728Z [2024-07-04 02:31:02,407: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:31:02.419774469Z [2024-07-04 02:31:02,419: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:31:02.419891280Z [2024-07-04 02:31:02,419: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:31:02.420093017Z [2024-07-04 02:31:02,419: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:31:02.420152720Z [2024-07-04 02:31:02,420: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:31:02.420566453Z [2024-07-04 02:31:02,420: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:31:02.420619528Z [2024-07-04 02:31:02,420: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:31:02.473925874Z [2024-07-04 02:31:02,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:31:02.477660174Z [2024-07-04 02:31:02,477: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:31:02.517241906Z [2024-07-04 02:31:02,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:31:02.519479596Z [2024-07-04 02:31:02,519: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:31:02.519499192Z [2024-07-04 02:31:02,519: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:31:02.519726960Z [2024-07-04 02:31:02,519: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:31:02.519814980Z [2024-07-04 02:31:02,519: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:31:02.524316766Z [2024-07-04 02:31:02,524: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:31:02.524608236Z [2024-07-04 02:31:02,524: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:31:02.541696978Z [2024-07-04 02:31:02,541: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:31:02.636067372Z [2024-07-04 02:31:02,635: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:31:04.269600514Z [2024-07-04 02:31:04,269: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efd3c103-7160-4475-98dc-0bb0fc19b95a] succeeded in 3.7209068880001723s: None 2024-07-04T02:31:04.722696875Z [2024-07-04 02:31:04,721: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfacd16d-f002-4265-85b7-b88492acb86b] succeeded in 4.184857987999749s: None 2024-07-04T02:32:00.378722734Z [2024-07-04 02:32:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc82a298-bca9-4a87-9e42-82777df2dea7] received 2024-07-04T02:32:00.397731421Z [2024-07-04 02:32:00,397: INFO/ForkPoolWorker-15] [fc82a298-bca9-4a87-9e42-82777df2dea7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:32:00.418512733Z [2024-07-04 02:32:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c7c935f-693e-4117-a2a5-f20f15066bd7] received 2024-07-04T02:32:00.444025713Z [2024-07-04 02:32:00,443: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[277c0d00-b603-4f8b-be1a-d869b7038bed] received 2024-07-04T02:32:00.456804233Z [2024-07-04 02:32:00,451: INFO/ForkPoolWorker-16] [2c7c935f-693e-4117-a2a5-f20f15066bd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:32:00.461098961Z [2024-07-04 02:32:00,460: INFO/ForkPoolWorker-1] [277c0d00-b603-4f8b-be1a-d869b7038bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:32:00.738362729Z [2024-07-04 02:32:00,733: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:32:00.902397163Z [2024-07-04 02:32:00,898: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:32:01.172673793Z [2024-07-04 02:32:01,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:32:01.271445323Z [2024-07-04 02:32:01,265: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:32:01.836172169Z [2024-07-04 02:32:01,835: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c7c935f-693e-4117-a2a5-f20f15066bd7] succeeded in 1.4148503420001362s: None 2024-07-04T02:32:02.254806754Z [2024-07-04 02:32:02,254: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:32:02.258541520Z [2024-07-04 02:32:02,257: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:32:02.301023652Z [2024-07-04 02:32:02,300: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:32:02.302827923Z [2024-07-04 02:32:02,302: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:32:02.302850104Z [2024-07-04 02:32:02,302: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:32:02.303449558Z [2024-07-04 02:32:02,302: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:32:02.303544512Z [2024-07-04 02:32:02,303: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:32:02.303874062Z [2024-07-04 02:32:02,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:32:02.303904909Z [2024-07-04 02:32:02,303: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:32:02.412415087Z [2024-07-04 02:32:02,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:32:02.751155960Z [2024-07-04 02:32:02,750: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:32:02.754256829Z [2024-07-04 02:32:02,753: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:32:02.791712827Z [2024-07-04 02:32:02,791: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:32:02.793531176Z [2024-07-04 02:32:02,793: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:32:02.793547574Z [2024-07-04 02:32:02,793: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:32:02.793768361Z [2024-07-04 02:32:02,793: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:32:02.793823708Z [2024-07-04 02:32:02,793: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:32:02.794209562Z [2024-07-04 02:32:02,794: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:32:02.794331598Z [2024-07-04 02:32:02,794: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:32:02.902643145Z [2024-07-04 02:32:02,902: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:32:04.442179243Z [2024-07-04 02:32:04,441: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc82a298-bca9-4a87-9e42-82777df2dea7] succeeded in 4.058402423999723s: None 2024-07-04T02:32:04.644569882Z [2024-07-04 02:32:04,644: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[277c0d00-b603-4f8b-be1a-d869b7038bed] succeeded in 4.19591530300022s: None 2024-07-04T02:33:01.266590924Z [2024-07-04 02:33:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78089f1d-5cf5-4b7d-8e01-cffbf81790e5] received 2024-07-04T02:33:01.275712573Z [2024-07-04 02:33:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54498b65-3ea6-4e58-8248-4dbcf9bbf571] received 2024-07-04T02:33:01.285411094Z [2024-07-04 02:33:01,284: INFO/ForkPoolWorker-15] [78089f1d-5cf5-4b7d-8e01-cffbf81790e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:33:01.292816706Z [2024-07-04 02:33:01,292: INFO/ForkPoolWorker-16] [54498b65-3ea6-4e58-8248-4dbcf9bbf571] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:33:01.575773584Z [2024-07-04 02:33:01,572: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:33:01.595195556Z [2024-07-04 02:33:01,591: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:33:02.784238763Z [2024-07-04 02:33:02,783: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:33:02.787780071Z [2024-07-04 02:33:02,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:33:02.825426183Z [2024-07-04 02:33:02,825: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:33:02.826959191Z [2024-07-04 02:33:02,826: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:33:02.827076720Z [2024-07-04 02:33:02,826: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:33:02.827282997Z [2024-07-04 02:33:02,827: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:33:02.827417857Z [2024-07-04 02:33:02,827: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:33:02.828216866Z [2024-07-04 02:33:02,828: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:33:02.828243542Z [2024-07-04 02:33:02,828: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:33:02.843501576Z [2024-07-04 02:33:02,843: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:33:02.846927186Z [2024-07-04 02:33:02,846: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:33:02.869337481Z [2024-07-04 02:33:02,869: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:33:02.871350949Z [2024-07-04 02:33:02,871: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:33:02.871504601Z [2024-07-04 02:33:02,871: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:33:02.871693779Z [2024-07-04 02:33:02,871: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:33:02.871895528Z [2024-07-04 02:33:02,871: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:33:02.872778949Z [2024-07-04 02:33:02,872: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:33:02.872947285Z [2024-07-04 02:33:02,872: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:33:02.902423759Z [2024-07-04 02:33:02,902: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:33:02.961844588Z [2024-07-04 02:33:02,961: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:33:04.611779164Z [2024-07-04 02:33:04,611: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[54498b65-3ea6-4e58-8248-4dbcf9bbf571] succeeded in 3.3328849239997s: None 2024-07-04T02:33:04.919535753Z [2024-07-04 02:33:04,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78089f1d-5cf5-4b7d-8e01-cffbf81790e5] succeeded in 3.6483215179996478s: None 2024-07-04T02:34:00.494379093Z [2024-07-04 02:34:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d6e5a23-ad16-42a8-a46c-99d43778b239] received 2024-07-04T02:34:00.510167408Z [2024-07-04 02:34:00,509: INFO/ForkPoolWorker-15] [1d6e5a23-ad16-42a8-a46c-99d43778b239] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:34:00.514973464Z [2024-07-04 02:34:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c92e1c9a-33bb-4455-8fde-fe7e48a50a54] received 2024-07-04T02:34:00.534930247Z [2024-07-04 02:34:00,534: INFO/ForkPoolWorker-16] [c92e1c9a-33bb-4455-8fde-fe7e48a50a54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:34:00.539912661Z [2024-07-04 02:34:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2b35a42-864d-4894-99c6-795fa6c06fd7] received 2024-07-04T02:34:00.584438540Z [2024-07-04 02:34:00,583: INFO/ForkPoolWorker-1] [e2b35a42-864d-4894-99c6-795fa6c06fd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:34:01.041312860Z [2024-07-04 02:34:01,036: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:34:01.194923826Z [2024-07-04 02:34:01,190: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:34:01.248261707Z [2024-07-04 02:34:01,243: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:34:01.600934060Z [2024-07-04 02:34:01,600: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:34:02.474339123Z [2024-07-04 02:34:02,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d6e5a23-ad16-42a8-a46c-99d43778b239] succeeded in 1.9727126239995414s: None 2024-07-04T02:34:03.055278270Z [2024-07-04 02:34:03,054: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:34:03.059448471Z [2024-07-04 02:34:03,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:34:03.120234616Z [2024-07-04 02:34:03,119: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:34:03.128163320Z [2024-07-04 02:34:03,127: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:34:03.128291417Z [2024-07-04 02:34:03,128: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:34:03.128520694Z [2024-07-04 02:34:03,128: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:34:03.128657001Z [2024-07-04 02:34:03,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:34:03.129076653Z [2024-07-04 02:34:03,128: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:34:03.129259836Z [2024-07-04 02:34:03,129: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:34:03.260086505Z [2024-07-04 02:34:03,259: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:34:03.263414879Z [2024-07-04 02:34:03,263: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:34:03.266673179Z [2024-07-04 02:34:03,266: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:34:03.317915673Z [2024-07-04 02:34:03,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:34:03.319277137Z [2024-07-04 02:34:03,319: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:34:03.319966737Z [2024-07-04 02:34:03,319: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:34:03.320184177Z [2024-07-04 02:34:03,319: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:34:03.320318770Z [2024-07-04 02:34:03,320: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:34:03.320632128Z [2024-07-04 02:34:03,320: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:34:03.320739599Z [2024-07-04 02:34:03,320: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:34:03.441758879Z [2024-07-04 02:34:03,441: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:34:05.225932991Z [2024-07-04 02:34:05,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c92e1c9a-33bb-4455-8fde-fe7e48a50a54] succeeded in 4.705936689000737s: None 2024-07-04T02:34:05.843413718Z [2024-07-04 02:34:05,842: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2b35a42-864d-4894-99c6-795fa6c06fd7] succeeded in 5.291181446999872s: None 2024-07-04T02:35:00.498919584Z [2024-07-04 02:35:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc6654bd-bd75-4231-bb69-30e3393a9a86] received 2024-07-04T02:35:00.527506214Z [2024-07-04 02:35:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30884790-59e6-44d5-9a09-ea2e50a4151e] received 2024-07-04T02:35:00.535216692Z [2024-07-04 02:35:00,534: INFO/ForkPoolWorker-15] [cc6654bd-bd75-4231-bb69-30e3393a9a86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:35:00.549306559Z [2024-07-04 02:35:00,548: INFO/ForkPoolWorker-16] [30884790-59e6-44d5-9a09-ea2e50a4151e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:35:00.558377450Z [2024-07-04 02:35:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[001894cb-3b3b-4924-b087-609e3649afd0] received 2024-07-04T02:35:00.599911423Z [2024-07-04 02:35:00,599: INFO/ForkPoolWorker-1] [001894cb-3b3b-4924-b087-609e3649afd0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:01.136068072Z [2024-07-04 02:35:01,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:35:01.252048388Z [2024-07-04 02:35:01,232: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:35:01.560665563Z [2024-07-04 02:35:01,552: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:35:02.752933201Z [2024-07-04 02:35:02,752: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:35:02.756416251Z [2024-07-04 02:35:02,755: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:02.800876565Z [2024-07-04 02:35:02,800: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:35:02.805081370Z [2024-07-04 02:35:02,804: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:02.806641523Z [2024-07-04 02:35:02,805: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:02.806847745Z [2024-07-04 02:35:02,806: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:02.808170795Z [2024-07-04 02:35:02,807: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:35:02.809026969Z [2024-07-04 02:35:02,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:35:02.809082552Z [2024-07-04 02:35:02,808: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:02.878182788Z [2024-07-04 02:35:02,877: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:35:02.881971175Z [2024-07-04 02:35:02,881: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:02.893589592Z [2024-07-04 02:35:02,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:02.911897114Z [2024-07-04 02:35:02,911: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:35:02.913466390Z [2024-07-04 02:35:02,913: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:02.913488815Z [2024-07-04 02:35:02,913: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:02.913721376Z [2024-07-04 02:35:02,913: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:02.913890921Z [2024-07-04 02:35:02,913: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:35:02.914177824Z [2024-07-04 02:35:02,914: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:35:02.914314591Z [2024-07-04 02:35:02,914: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:02.994185886Z [2024-07-04 02:35:02,993: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:03.295476809Z [2024-07-04 02:35:03,295: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:35:03.298983788Z [2024-07-04 02:35:03,298: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:03.333726735Z [2024-07-04 02:35:03,333: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:35:03.335059990Z [2024-07-04 02:35:03,334: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:03.335481170Z [2024-07-04 02:35:03,335: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:03.335705232Z [2024-07-04 02:35:03,335: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:03.335828686Z [2024-07-04 02:35:03,335: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:35:03.336188919Z [2024-07-04 02:35:03,336: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:35:03.336308893Z [2024-07-04 02:35:03,336: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:03.432117080Z [2024-07-04 02:35:03,431: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:03.706034367Z [2024-07-04 02:35:03,705: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[001894cb-3b3b-4924-b087-609e3649afd0] succeeded in 3.1384704700003567s: None 2024-07-04T02:35:04.566941117Z [2024-07-04 02:35:04,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc6654bd-bd75-4231-bb69-30e3393a9a86] succeeded in 4.059918097999798s: None 2024-07-04T02:35:04.656813361Z [2024-07-04 02:35:04,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[772140c2-84b2-4d0f-aec6-ddbd43bf0bb5] received 2024-07-04T02:35:04.668499447Z [2024-07-04 02:35:04,668: INFO/ForkPoolWorker-15] [772140c2-84b2-4d0f-aec6-ddbd43bf0bb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:05.007487227Z [2024-07-04 02:35:05,004: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:35:05.490126028Z [2024-07-04 02:35:05,489: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30884790-59e6-44d5-9a09-ea2e50a4151e] succeeded in 4.953611314000227s: None 2024-07-04T02:35:06.117783771Z [2024-07-04 02:35:06,117: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:35:06.120907951Z [2024-07-04 02:35:06,120: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:06.168927689Z [2024-07-04 02:35:06,168: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:35:06.170168331Z [2024-07-04 02:35:06,169: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:06.170183394Z [2024-07-04 02:35:06,170: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:06.170348432Z [2024-07-04 02:35:06,170: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:06.170355884Z [2024-07-04 02:35:06,170: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:35:06.170628759Z [2024-07-04 02:35:06,170: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:35:06.170640472Z [2024-07-04 02:35:06,170: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:06.251717343Z [2024-07-04 02:35:06,251: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:06.854806232Z [2024-07-04 02:35:06,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[772140c2-84b2-4d0f-aec6-ddbd43bf0bb5] succeeded in 2.1955832140001803s: None 2024-07-04T02:35:07.451791558Z [2024-07-04 02:35:07,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64fbd902-a00f-43c4-91b3-06bd8f224d6b] received 2024-07-04T02:35:07.469117350Z [2024-07-04 02:35:07,468: INFO/ForkPoolWorker-15] [64fbd902-a00f-43c4-91b3-06bd8f224d6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:35:07.803950278Z [2024-07-04 02:35:07,800: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:35:08.928771010Z [2024-07-04 02:35:08,928: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:35:08.932413685Z [2024-07-04 02:35:08,931: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:08.962188342Z [2024-07-04 02:35:08,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:35:08.963841398Z [2024-07-04 02:35:08,963: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:08.963978088Z [2024-07-04 02:35:08,963: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:08.964173796Z [2024-07-04 02:35:08,963: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:08.964344089Z [2024-07-04 02:35:08,964: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:35:08.964917914Z [2024-07-04 02:35:08,964: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:35:08.965049176Z [2024-07-04 02:35:08,964: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:09.067779244Z [2024-07-04 02:35:09,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:09.739797298Z [2024-07-04 02:35:09,739: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64fbd902-a00f-43c4-91b3-06bd8f224d6b] succeeded in 2.279696350999984s: None 2024-07-04T02:35:09.877838401Z [2024-07-04 02:35:09,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2915c80-87ce-45b4-ae7c-7338f422aed7] received 2024-07-04T02:35:09.895120989Z [2024-07-04 02:35:09,894: INFO/ForkPoolWorker-15] [f2915c80-87ce-45b4-ae7c-7338f422aed7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:35:10.195029404Z [2024-07-04 02:35:10,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:35:11.336341957Z [2024-07-04 02:35:11,335: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:35:11.339781153Z [2024-07-04 02:35:11,339: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:35:11.381627885Z [2024-07-04 02:35:11,381: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:35:11.388780084Z [2024-07-04 02:35:11,387: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:35:11.388811572Z [2024-07-04 02:35:11,388: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:35:11.388822201Z [2024-07-04 02:35:11,388: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:35:11.388829151Z [2024-07-04 02:35:11,388: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:35:11.388921650Z [2024-07-04 02:35:11,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:35:11.388962333Z [2024-07-04 02:35:11,388: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:35:11.505536718Z [2024-07-04 02:35:11,505: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:35:12.135250915Z [2024-07-04 02:35:12,134: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2915c80-87ce-45b4-ae7c-7338f422aed7] succeeded in 2.256404467999346s: None 2024-07-04T02:36:00.704518338Z [2024-07-04 02:36:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ed739e8-9240-4c7d-8cbe-689eef91fe56] received 2024-07-04T02:36:00.718191152Z [2024-07-04 02:36:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[230ed8bb-bf7f-4af1-835c-704466f2e77f] received 2024-07-04T02:36:00.731569705Z [2024-07-04 02:36:00,731: INFO/ForkPoolWorker-15] [1ed739e8-9240-4c7d-8cbe-689eef91fe56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:36:00.740458540Z [2024-07-04 02:36:00,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2eef276-de4f-4537-be36-c9666d60b3c2] received 2024-07-04T02:36:00.756806899Z [2024-07-04 02:36:00,756: INFO/ForkPoolWorker-16] [230ed8bb-bf7f-4af1-835c-704466f2e77f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:36:00.796346921Z [2024-07-04 02:36:00,795: INFO/ForkPoolWorker-1] [d2eef276-de4f-4537-be36-c9666d60b3c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:36:01.045485310Z [2024-07-04 02:36:01,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:36:01.195135804Z [2024-07-04 02:36:01,190: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:36:01.475084989Z [2024-07-04 02:36:01,469: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:36:01.779162477Z [2024-07-04 02:36:01,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:36:02.502771538Z [2024-07-04 02:36:02,501: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:36:02.506347785Z [2024-07-04 02:36:02,505: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:36:02.509403428Z [2024-07-04 02:36:02,508: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:36:02.509488405Z [2024-07-04 02:36:02,509: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:36:02.529255674Z [2024-07-04 02:36:02,528: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[230ed8bb-bf7f-4af1-835c-704466f2e77f] succeeded in 1.8084945230002631s: None 2024-07-04T02:36:02.549157438Z [2024-07-04 02:36:02,548: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:36:02.549950973Z [2024-07-04 02:36:02,549: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:36:02.551194997Z [2024-07-04 02:36:02,550: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:36:02.551206005Z [2024-07-04 02:36:02,551: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:36:02.551293569Z [2024-07-04 02:36:02,551: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:36:02.551322056Z [2024-07-04 02:36:02,551: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:36:02.551544883Z [2024-07-04 02:36:02,551: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:36:02.551555343Z [2024-07-04 02:36:02,551: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:36:02.555930363Z [2024-07-04 02:36:02,555: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:36:02.556420762Z [2024-07-04 02:36:02,556: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:36:02.556702084Z [2024-07-04 02:36:02,556: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:36:02.556812124Z [2024-07-04 02:36:02,556: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:36:02.557146149Z [2024-07-04 02:36:02,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:36:02.557274888Z [2024-07-04 02:36:02,557: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:36:02.627790187Z [2024-07-04 02:36:02,627: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:36:02.669389899Z [2024-07-04 02:36:02,669: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:36:04.531123171Z [2024-07-04 02:36:04,530: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1ed739e8-9240-4c7d-8cbe-689eef91fe56] succeeded in 3.823294754000017s: None 2024-07-04T02:36:04.657897202Z [2024-07-04 02:36:04,657: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2eef276-de4f-4537-be36-c9666d60b3c2] succeeded in 3.9077604980002434s: None 2024-07-04T02:37:00.566919573Z [2024-07-04 02:37:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57921fd2-966a-4329-8027-791df01f241b] received 2024-07-04T02:37:00.592339623Z [2024-07-04 02:37:00,591: INFO/ForkPoolWorker-15] [57921fd2-966a-4329-8027-791df01f241b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:37:00.596634826Z [2024-07-04 02:37:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[246bf131-23ed-4d46-b4d9-d4b3dd2bf306] received 2024-07-04T02:37:00.621041759Z [2024-07-04 02:37:00,620: INFO/ForkPoolWorker-16] [246bf131-23ed-4d46-b4d9-d4b3dd2bf306] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:37:00.977958924Z [2024-07-04 02:37:00,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:37:01.129910905Z [2024-07-04 02:37:01,125: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:37:02.205692808Z [2024-07-04 02:37:02,205: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:37:02.209053442Z [2024-07-04 02:37:02,208: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:37:02.247071435Z [2024-07-04 02:37:02,246: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:37:02.250435611Z [2024-07-04 02:37:02,250: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:37:02.250709397Z [2024-07-04 02:37:02,250: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:37:02.250920219Z [2024-07-04 02:37:02,250: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:37:02.251052081Z [2024-07-04 02:37:02,250: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:37:02.251395673Z [2024-07-04 02:37:02,251: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:37:02.251460920Z [2024-07-04 02:37:02,251: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:37:02.343861762Z [2024-07-04 02:37:02,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:37:02.381690754Z [2024-07-04 02:37:02,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:37:02.385234126Z [2024-07-04 02:37:02,384: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:37:02.411055739Z [2024-07-04 02:37:02,410: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:37:02.412479760Z [2024-07-04 02:37:02,412: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:37:02.412558967Z [2024-07-04 02:37:02,412: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:37:02.412891953Z [2024-07-04 02:37:02,412: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:37:02.413063085Z [2024-07-04 02:37:02,412: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:37:02.413359469Z [2024-07-04 02:37:02,413: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:37:02.413841079Z [2024-07-04 02:37:02,413: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:37:02.489592461Z [2024-07-04 02:37:02,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:37:04.611377857Z [2024-07-04 02:37:04,610: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[246bf131-23ed-4d46-b4d9-d4b3dd2bf306] succeeded in 4.007353961999797s: None 2024-07-04T02:37:05.017976204Z [2024-07-04 02:37:05,017: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57921fd2-966a-4329-8027-791df01f241b] succeeded in 4.447227611000017s: None 2024-07-04T02:38:00.536304803Z [2024-07-04 02:38:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[566c5e2e-c94c-4e2c-a896-d54efda9f8c4] received 2024-07-04T02:38:00.553474187Z [2024-07-04 02:38:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3867a07-da27-4f89-9673-9fcaf27eed56] received 2024-07-04T02:38:00.567210050Z [2024-07-04 02:38:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60b9f0c8-511c-4798-960b-ba24f4719313] received 2024-07-04T02:38:00.570311091Z [2024-07-04 02:38:00,569: INFO/ForkPoolWorker-15] [566c5e2e-c94c-4e2c-a896-d54efda9f8c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:38:00.589129553Z [2024-07-04 02:38:00,586: INFO/ForkPoolWorker-16] [f3867a07-da27-4f89-9673-9fcaf27eed56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:38:00.596325036Z [2024-07-04 02:38:00,595: INFO/ForkPoolWorker-1] [60b9f0c8-511c-4798-960b-ba24f4719313] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:38:01.011066022Z [2024-07-04 02:38:01,004: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:38:01.031524493Z [2024-07-04 02:38:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:38:01.134614610Z [2024-07-04 02:38:01,125: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:38:01.532487891Z [2024-07-04 02:38:01,532: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:38:02.285406164Z [2024-07-04 02:38:02,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[566c5e2e-c94c-4e2c-a896-d54efda9f8c4] succeeded in 1.7407974259995171s: None 2024-07-04T02:38:02.565926178Z [2024-07-04 02:38:02,565: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:38:02.570864644Z [2024-07-04 02:38:02,570: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:38:02.570928784Z [2024-07-04 02:38:02,570: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:38:02.574967986Z [2024-07-04 02:38:02,574: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:38:02.604124608Z [2024-07-04 02:38:02,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:38:02.607013497Z [2024-07-04 02:38:02,606: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:38:02.607035400Z [2024-07-04 02:38:02,606: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:38:02.607198716Z [2024-07-04 02:38:02,607: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:38:02.608726471Z [2024-07-04 02:38:02,608: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:38:02.609337462Z [2024-07-04 02:38:02,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:38:02.609383688Z [2024-07-04 02:38:02,609: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:38:02.621881315Z [2024-07-04 02:38:02,621: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:38:02.625859372Z [2024-07-04 02:38:02,625: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:38:02.626425233Z [2024-07-04 02:38:02,626: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:38:02.627004329Z [2024-07-04 02:38:02,626: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:38:02.627026806Z [2024-07-04 02:38:02,626: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:38:02.627755579Z [2024-07-04 02:38:02,627: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:38:02.627769104Z [2024-07-04 02:38:02,627: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:38:02.704741500Z [2024-07-04 02:38:02,704: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:38:02.726979696Z [2024-07-04 02:38:02,726: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:38:04.903794293Z [2024-07-04 02:38:04,903: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60b9f0c8-511c-4798-960b-ba24f4719313] succeeded in 4.327068381999197s: None 2024-07-04T02:38:05.611745938Z [2024-07-04 02:38:05,611: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3867a07-da27-4f89-9673-9fcaf27eed56] succeeded in 5.053489226000238s: None 2024-07-04T02:39:00.713174268Z [2024-07-04 02:39:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbfb7cbd-fe8f-4c9d-a7f4-88ec6d9b94d4] received 2024-07-04T02:39:00.720512143Z [2024-07-04 02:39:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5586376e-27a9-42c3-ad16-10e8dd560401] received 2024-07-04T02:39:00.725832507Z [2024-07-04 02:39:00,725: INFO/ForkPoolWorker-15] [fbfb7cbd-fe8f-4c9d-a7f4-88ec6d9b94d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:39:00.743757869Z [2024-07-04 02:39:00,743: INFO/ForkPoolWorker-16] [5586376e-27a9-42c3-ad16-10e8dd560401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:39:01.041358860Z [2024-07-04 02:39:01,037: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:39:01.086678450Z [2024-07-04 02:39:01,083: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:39:02.325916643Z [2024-07-04 02:39:02,325: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:39:02.329252883Z [2024-07-04 02:39:02,328: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:39:02.342483798Z [2024-07-04 02:39:02,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:39:02.345934796Z [2024-07-04 02:39:02,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:39:02.360966243Z [2024-07-04 02:39:02,360: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:39:02.363683835Z [2024-07-04 02:39:02,363: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:39:02.364342764Z [2024-07-04 02:39:02,363: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:39:02.364583209Z [2024-07-04 02:39:02,364: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:39:02.364714953Z [2024-07-04 02:39:02,364: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:39:02.365082993Z [2024-07-04 02:39:02,364: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:39:02.365226089Z [2024-07-04 02:39:02,365: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:39:02.376833619Z [2024-07-04 02:39:02,375: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:39:02.379660330Z [2024-07-04 02:39:02,379: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:39:02.379802707Z [2024-07-04 02:39:02,379: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:39:02.380011675Z [2024-07-04 02:39:02,379: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:39:02.380093406Z [2024-07-04 02:39:02,380: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:39:02.380359796Z [2024-07-04 02:39:02,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:39:02.380807499Z [2024-07-04 02:39:02,380: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:39:02.455468713Z [2024-07-04 02:39:02,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:39:02.458689012Z [2024-07-04 02:39:02,458: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:39:03.930706241Z [2024-07-04 02:39:03,930: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbfb7cbd-fe8f-4c9d-a7f4-88ec6d9b94d4] succeeded in 3.215752471000087s: None 2024-07-04T02:39:04.620427477Z [2024-07-04 02:39:04,619: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5586376e-27a9-42c3-ad16-10e8dd560401] succeeded in 3.891938468999797s: None 2024-07-04T02:40:01.367242293Z [2024-07-04 02:40:01,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[359ace65-3eb3-499a-8cd8-d0dc33774e06] received 2024-07-04T02:40:01.369704001Z [2024-07-04 02:40:01,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94e7d7d4-7a7e-4f90-85c9-f565070969c4] received 2024-07-04T02:40:01.391894943Z [2024-07-04 02:40:01,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[006db01d-8f9d-47c6-a70e-d36ea3b5a420] received 2024-07-04T02:40:01.395255323Z [2024-07-04 02:40:01,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b4cd74c-4b44-4d64-80e8-3f103e5b63a1] received 2024-07-04T02:40:01.407569552Z [2024-07-04 02:40:01,407: INFO/ForkPoolWorker-16] [94e7d7d4-7a7e-4f90-85c9-f565070969c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:40:01.408957724Z [2024-07-04 02:40:01,408: INFO/ForkPoolWorker-15] [359ace65-3eb3-499a-8cd8-d0dc33774e06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:01.418460546Z [2024-07-04 02:40:01,418: INFO/ForkPoolWorker-2] [2b4cd74c-4b44-4d64-80e8-3f103e5b63a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:40:01.428310506Z [2024-07-04 02:40:01,427: INFO/ForkPoolWorker-1] [006db01d-8f9d-47c6-a70e-d36ea3b5a420] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:40:01.748951459Z [2024-07-04 02:40:01,744: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:40:01.842752237Z [2024-07-04 02:40:01,837: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:40:01.892404587Z [2024-07-04 02:40:01,876: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:40:01.989200143Z [2024-07-04 02:40:01,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:40:02.199316031Z [2024-07-04 02:40:02,198: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:03.057031308Z [2024-07-04 02:40:03,056: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94e7d7d4-7a7e-4f90-85c9-f565070969c4] succeeded in 1.683635256999878s: None 2024-07-04T02:40:03.086427310Z [2024-07-04 02:40:03,086: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:40:03.090257555Z [2024-07-04 02:40:03,089: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:03.133066102Z [2024-07-04 02:40:03,132: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:40:03.135754016Z [2024-07-04 02:40:03,135: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:03.135773785Z [2024-07-04 02:40:03,135: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:03.135969516Z [2024-07-04 02:40:03,135: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:03.136001101Z [2024-07-04 02:40:03,135: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:40:03.136333005Z [2024-07-04 02:40:03,136: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:40:03.136368147Z [2024-07-04 02:40:03,136: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:03.256914391Z [2024-07-04 02:40:03,256: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:03.687146087Z [2024-07-04 02:40:03,686: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:40:03.691208895Z [2024-07-04 02:40:03,690: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:03.744227156Z [2024-07-04 02:40:03,743: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:40:03.747931343Z [2024-07-04 02:40:03,747: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:03.747945217Z [2024-07-04 02:40:03,747: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:03.748084879Z [2024-07-04 02:40:03,747: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:03.748096590Z [2024-07-04 02:40:03,748: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:40:03.748344723Z [2024-07-04 02:40:03,748: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:40:03.748355852Z [2024-07-04 02:40:03,748: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:03.770079790Z [2024-07-04 02:40:03,769: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:40:03.773660231Z [2024-07-04 02:40:03,773: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:03.819039803Z [2024-07-04 02:40:03,818: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:40:03.822651454Z [2024-07-04 02:40:03,822: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:03.822680150Z [2024-07-04 02:40:03,822: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:03.822806359Z [2024-07-04 02:40:03,822: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:03.822846662Z [2024-07-04 02:40:03,822: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:40:03.823155970Z [2024-07-04 02:40:03,823: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:40:03.823198018Z [2024-07-04 02:40:03,823: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:03.871757630Z [2024-07-04 02:40:03,871: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:03.939602304Z [2024-07-04 02:40:03,939: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:04.608337372Z [2024-07-04 02:40:04,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[359ace65-3eb3-499a-8cd8-d0dc33774e06] succeeded in 3.2333861440001783s: None 2024-07-04T02:40:05.032261843Z [2024-07-04 02:40:05,031: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2b4cd74c-4b44-4d64-80e8-3f103e5b63a1] succeeded in 3.6332426769995436s: None 2024-07-04T02:40:05.504381831Z [2024-07-04 02:40:05,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5094754e-9a44-4f37-a7c2-243f2cda5076] received 2024-07-04T02:40:05.514536145Z [2024-07-04 02:40:05,514: INFO/ForkPoolWorker-15] [5094754e-9a44-4f37-a7c2-243f2cda5076] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:05.817775193Z [2024-07-04 02:40:05,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:40:05.903781771Z [2024-07-04 02:40:05,903: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[006db01d-8f9d-47c6-a70e-d36ea3b5a420] succeeded in 4.506085777999942s: None 2024-07-04T02:40:06.978139637Z [2024-07-04 02:40:06,977: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:40:06.981663357Z [2024-07-04 02:40:06,981: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:07.025795295Z [2024-07-04 02:40:07,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:40:07.026926126Z [2024-07-04 02:40:07,026: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:07.026939012Z [2024-07-04 02:40:07,026: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:07.027084082Z [2024-07-04 02:40:07,026: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:07.027095305Z [2024-07-04 02:40:07,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:40:07.027324618Z [2024-07-04 02:40:07,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:40:07.027336580Z [2024-07-04 02:40:07,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:07.109863753Z [2024-07-04 02:40:07,109: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:07.903560184Z [2024-07-04 02:40:07,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5094754e-9a44-4f37-a7c2-243f2cda5076] succeeded in 2.3970092210001894s: None 2024-07-04T02:40:08.254954216Z [2024-07-04 02:40:08,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2a9770e-08ca-4856-af9d-9a500a5c6afb] received 2024-07-04T02:40:08.267357791Z [2024-07-04 02:40:08,266: INFO/ForkPoolWorker-15] [a2a9770e-08ca-4856-af9d-9a500a5c6afb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:40:08.600805237Z [2024-07-04 02:40:08,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:40:09.952434512Z [2024-07-04 02:40:09,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:40:09.955803558Z [2024-07-04 02:40:09,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:09.984666568Z [2024-07-04 02:40:09,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:40:09.985817364Z [2024-07-04 02:40:09,985: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:09.985877498Z [2024-07-04 02:40:09,985: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:09.985940014Z [2024-07-04 02:40:09,985: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:09.985989861Z [2024-07-04 02:40:09,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:40:09.986219036Z [2024-07-04 02:40:09,986: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:40:09.986340319Z [2024-07-04 02:40:09,986: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:10.160611741Z [2024-07-04 02:40:10,160: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:10.840309283Z [2024-07-04 02:40:10,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2a9770e-08ca-4856-af9d-9a500a5c6afb] succeeded in 2.582522206000249s: None 2024-07-04T02:40:11.891336777Z [2024-07-04 02:40:11,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[634c4200-a89b-4b58-a6e3-3fcb60b3a15f] received 2024-07-04T02:40:11.897780820Z [2024-07-04 02:40:11,896: INFO/ForkPoolWorker-15] [634c4200-a89b-4b58-a6e3-3fcb60b3a15f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:40:12.254219600Z [2024-07-04 02:40:12,250: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:40:13.539753560Z [2024-07-04 02:40:13,539: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:40:13.542995707Z [2024-07-04 02:40:13,542: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:40:13.582452590Z [2024-07-04 02:40:13,582: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:40:13.585660115Z [2024-07-04 02:40:13,585: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:40:13.585809016Z [2024-07-04 02:40:13,585: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:40:13.586002306Z [2024-07-04 02:40:13,585: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:40:13.586120947Z [2024-07-04 02:40:13,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:40:13.586788222Z [2024-07-04 02:40:13,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:40:13.586817365Z [2024-07-04 02:40:13,586: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:40:13.695523253Z [2024-07-04 02:40:13,695: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:40:14.326664031Z [2024-07-04 02:40:14,326: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[634c4200-a89b-4b58-a6e3-3fcb60b3a15f] succeeded in 2.4451992659996904s: None 2024-07-04T02:41:00.468008639Z [2024-07-04 02:41:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56aa14ea-7021-4131-80c7-537bc7412de4] received 2024-07-04T02:41:00.470311705Z [2024-07-04 02:41:00,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c7da80e-9194-4c7a-a669-4e217e473465] received 2024-07-04T02:41:00.498492768Z [2024-07-04 02:41:00,497: INFO/ForkPoolWorker-16] [3c7da80e-9194-4c7a-a669-4e217e473465] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:41:00.506120413Z [2024-07-04 02:41:00,505: INFO/ForkPoolWorker-15] [56aa14ea-7021-4131-80c7-537bc7412de4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:41:00.882475716Z [2024-07-04 02:41:00,878: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:41:00.961131506Z [2024-07-04 02:41:00,956: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:41:02.063226356Z [2024-07-04 02:41:02,062: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:41:02.066552690Z [2024-07-04 02:41:02,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:41:02.091439952Z [2024-07-04 02:41:02,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:41:02.092558805Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:41:02.092576693Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:41:02.092701638Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:41:02.092711381Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:41:02.092953073Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:41:02.092961802Z [2024-07-04 02:41:02,092: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:41:02.173869338Z [2024-07-04 02:41:02,173: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:41:02.283942802Z [2024-07-04 02:41:02,283: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:41:02.287161516Z [2024-07-04 02:41:02,286: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:41:02.338139862Z [2024-07-04 02:41:02,337: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:41:02.340309590Z [2024-07-04 02:41:02,339: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:41:02.340424860Z [2024-07-04 02:41:02,340: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:41:02.340682375Z [2024-07-04 02:41:02,340: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:41:02.340889891Z [2024-07-04 02:41:02,340: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:41:02.341327020Z [2024-07-04 02:41:02,341: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:41:02.341445995Z [2024-07-04 02:41:02,341: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:41:02.447398640Z [2024-07-04 02:41:02,447: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:41:04.130570224Z [2024-07-04 02:41:04,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56aa14ea-7021-4131-80c7-537bc7412de4] succeeded in 3.656348339000033s: None 2024-07-04T02:41:04.235748047Z [2024-07-04 02:41:04,235: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3c7da80e-9194-4c7a-a669-4e217e473465] succeeded in 3.7606150340006934s: None 2024-07-04T02:42:00.288068426Z [2024-07-04 02:42:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8044bb48-cf76-4127-81a9-0a665deddea5] received 2024-07-04T02:42:00.303600944Z [2024-07-04 02:42:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faa2d8c3-ad39-46f4-825b-daa24ad037c5] received 2024-07-04T02:42:00.315747662Z [2024-07-04 02:42:00,315: INFO/ForkPoolWorker-15] [8044bb48-cf76-4127-81a9-0a665deddea5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:42:00.330604171Z [2024-07-04 02:42:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e68f3c4-d0d1-4b12-a8b1-ab3ec8c25e3f] received 2024-07-04T02:42:00.335247123Z [2024-07-04 02:42:00,334: INFO/ForkPoolWorker-16] [faa2d8c3-ad39-46f4-825b-daa24ad037c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:42:00.365088261Z [2024-07-04 02:42:00,364: INFO/ForkPoolWorker-1] [8e68f3c4-d0d1-4b12-a8b1-ab3ec8c25e3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:42:01.019056468Z [2024-07-04 02:42:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:42:01.039753947Z [2024-07-04 02:42:01,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:42:01.046722255Z [2024-07-04 02:42:01,041: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:42:01.602518457Z [2024-07-04 02:42:01,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:42:02.493261444Z [2024-07-04 02:42:02,492: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[faa2d8c3-ad39-46f4-825b-daa24ad037c5] succeeded in 2.1869413160002296s: None 2024-07-04T02:42:03.245540539Z [2024-07-04 02:42:03,245: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:42:03.249129392Z [2024-07-04 02:42:03,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:42:03.284130235Z [2024-07-04 02:42:03,283: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:42:03.287038221Z [2024-07-04 02:42:03,286: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:42:03.287272418Z [2024-07-04 02:42:03,287: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:42:03.287620365Z [2024-07-04 02:42:03,287: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:42:03.287947021Z [2024-07-04 02:42:03,287: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:42:03.289097632Z [2024-07-04 02:42:03,288: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:42:03.289452194Z [2024-07-04 02:42:03,289: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:42:03.325423598Z [2024-07-04 02:42:03,325: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:42:03.328868280Z [2024-07-04 02:42:03,328: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:42:03.362648870Z [2024-07-04 02:42:03,362: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:42:03.364234448Z [2024-07-04 02:42:03,364: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:42:03.364291972Z [2024-07-04 02:42:03,364: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:42:03.364435009Z [2024-07-04 02:42:03,364: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:42:03.364491091Z [2024-07-04 02:42:03,364: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:42:03.365209806Z [2024-07-04 02:42:03,365: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:42:03.365247799Z [2024-07-04 02:42:03,365: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:42:03.369728649Z [2024-07-04 02:42:03,369: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:42:03.449654387Z [2024-07-04 02:42:03,449: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:42:04.917488638Z [2024-07-04 02:42:04,915: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8044bb48-cf76-4127-81a9-0a665deddea5] succeeded in 4.62429494800017s: None 2024-07-04T02:42:05.312735141Z [2024-07-04 02:42:05,312: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e68f3c4-d0d1-4b12-a8b1-ab3ec8c25e3f] succeeded in 4.972262576000503s: None 2024-07-04T02:43:00.334655516Z [2024-07-04 02:43:00,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70b63013-3501-4e12-b163-3f51d2ac714d] received 2024-07-04T02:43:00.338304238Z [2024-07-04 02:43:00,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[857797db-5847-4634-aacf-a9e43f9f64bf] received 2024-07-04T02:43:00.357979675Z [2024-07-04 02:43:00,357: INFO/ForkPoolWorker-15] [70b63013-3501-4e12-b163-3f51d2ac714d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:43:00.360088996Z [2024-07-04 02:43:00,359: INFO/ForkPoolWorker-16] [857797db-5847-4634-aacf-a9e43f9f64bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:43:00.787533760Z [2024-07-04 02:43:00,784: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:43:00.837970707Z [2024-07-04 02:43:00,831: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:43:02.139029170Z [2024-07-04 02:43:02,138: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:43:02.142279630Z [2024-07-04 02:43:02,141: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:43:02.186208139Z [2024-07-04 02:43:02,185: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:43:02.191134459Z [2024-07-04 02:43:02,190: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:43:02.191201420Z [2024-07-04 02:43:02,190: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:43:02.191576863Z [2024-07-04 02:43:02,191: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:43:02.191616163Z [2024-07-04 02:43:02,191: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:43:02.192037426Z [2024-07-04 02:43:02,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:43:02.192136914Z [2024-07-04 02:43:02,191: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:43:02.237334188Z [2024-07-04 02:43:02,236: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:43:02.241113795Z [2024-07-04 02:43:02,240: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:43:02.279398625Z [2024-07-04 02:43:02,279: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:43:02.280544884Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:43:02.280560618Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:43:02.280781137Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:43:02.280792309Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:43:02.281029365Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:43:02.281088668Z [2024-07-04 02:43:02,280: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:43:02.331059590Z [2024-07-04 02:43:02,330: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:43:02.376519721Z [2024-07-04 02:43:02,376: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:43:03.968862942Z [2024-07-04 02:43:03,968: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[857797db-5847-4634-aacf-a9e43f9f64bf] succeeded in 3.6259583900000507s: None 2024-07-04T02:43:04.452653097Z [2024-07-04 02:43:04,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70b63013-3501-4e12-b163-3f51d2ac714d] succeeded in 4.112283675999606s: None 2024-07-04T02:44:00.767829002Z [2024-07-04 02:44:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bfe6c6a-ecc8-4af9-97ba-2516e437f69a] received 2024-07-04T02:44:00.771386148Z [2024-07-04 02:44:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff2e7057-dd47-4735-acc8-1ecbfbb8de91] received 2024-07-04T02:44:00.786333350Z [2024-07-04 02:44:00,785: INFO/ForkPoolWorker-15] [5bfe6c6a-ecc8-4af9-97ba-2516e437f69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:44:00.796002649Z [2024-07-04 02:44:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9e529d7-1004-4faf-973c-3813f1f061dc] received 2024-07-04T02:44:00.816700435Z [2024-07-04 02:44:00,816: INFO/ForkPoolWorker-1] [a9e529d7-1004-4faf-973c-3813f1f061dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:44:00.823408200Z [2024-07-04 02:44:00,816: INFO/ForkPoolWorker-16] [ff2e7057-dd47-4735-acc8-1ecbfbb8de91] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:44:01.146134377Z [2024-07-04 02:44:01,142: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:44:01.219758921Z [2024-07-04 02:44:01,215: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:44:01.240600317Z [2024-07-04 02:44:01,236: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:44:01.571603681Z [2024-07-04 02:44:01,571: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:44:02.259597482Z [2024-07-04 02:44:02,259: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff2e7057-dd47-4735-acc8-1ecbfbb8de91] succeeded in 1.482808195999496s: None 2024-07-04T02:44:02.337686635Z [2024-07-04 02:44:02,337: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:44:02.340910498Z [2024-07-04 02:44:02,340: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:44:02.390646433Z [2024-07-04 02:44:02,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:44:02.392394796Z [2024-07-04 02:44:02,392: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:44:02.392545465Z [2024-07-04 02:44:02,392: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:44:02.392736930Z [2024-07-04 02:44:02,392: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:44:02.392819232Z [2024-07-04 02:44:02,392: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:44:02.393117835Z [2024-07-04 02:44:02,393: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:44:02.393211481Z [2024-07-04 02:44:02,393: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:44:02.478459715Z [2024-07-04 02:44:02,478: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:44:02.544611783Z [2024-07-04 02:44:02,544: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:44:02.547703404Z [2024-07-04 02:44:02,547: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:44:02.584607657Z [2024-07-04 02:44:02,584: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:44:02.586147794Z [2024-07-04 02:44:02,585: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:44:02.586210401Z [2024-07-04 02:44:02,586: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:44:02.586435679Z [2024-07-04 02:44:02,586: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:44:02.586529155Z [2024-07-04 02:44:02,586: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:44:02.586851521Z [2024-07-04 02:44:02,586: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:44:02.586996317Z [2024-07-04 02:44:02,586: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:44:02.661996612Z [2024-07-04 02:44:02,661: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:44:04.032577618Z [2024-07-04 02:44:04,032: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bfe6c6a-ecc8-4af9-97ba-2516e437f69a] succeeded in 3.2573761989997365s: None 2024-07-04T02:44:04.461691658Z [2024-07-04 02:44:04,461: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a9e529d7-1004-4faf-973c-3813f1f061dc] succeeded in 3.6626218569999764s: None 2024-07-04T02:45:01.353055719Z [2024-07-04 02:45:01,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[312b8453-5aac-4554-bddd-13871152693e] received 2024-07-04T02:45:01.369455709Z [2024-07-04 02:45:01,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d1179f6-753f-4989-8441-aefcd0e95f6d] received 2024-07-04T02:45:01.371716188Z [2024-07-04 02:45:01,371: INFO/ForkPoolWorker-15] [312b8453-5aac-4554-bddd-13871152693e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:01.373610814Z [2024-07-04 02:45:01,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd429493-4079-47e2-87a9-027795499b33] received 2024-07-04T02:45:01.404239082Z [2024-07-04 02:45:01,403: INFO/ForkPoolWorker-16] [6d1179f6-753f-4989-8441-aefcd0e95f6d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:45:01.404422246Z [2024-07-04 02:45:01,403: INFO/ForkPoolWorker-1] [cd429493-4079-47e2-87a9-027795499b33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:45:01.685972517Z [2024-07-04 02:45:01,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:45:01.782640967Z [2024-07-04 02:45:01,778: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:45:01.807406556Z [2024-07-04 02:45:01,803: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:45:02.906657580Z [2024-07-04 02:45:02,906: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:45:02.909971510Z [2024-07-04 02:45:02,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:02.941319503Z [2024-07-04 02:45:02,941: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:45:02.943118444Z [2024-07-04 02:45:02,942: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:02.943185564Z [2024-07-04 02:45:02,943: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:02.943318326Z [2024-07-04 02:45:02,943: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:02.943365313Z [2024-07-04 02:45:02,943: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:45:02.943611266Z [2024-07-04 02:45:02,943: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:45:02.943668782Z [2024-07-04 02:45:02,943: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:03.021157018Z [2024-07-04 02:45:03,020: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:45:03.023733601Z [2024-07-04 02:45:03,023: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:03.024502335Z [2024-07-04 02:45:03,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:03.041572310Z [2024-07-04 02:45:03,041: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:45:03.047191568Z [2024-07-04 02:45:03,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:03.066842553Z [2024-07-04 02:45:03,066: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:45:03.068230342Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:03.068299847Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:03.068483129Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:03.068546680Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:45:03.068790773Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:45:03.068866640Z [2024-07-04 02:45:03,068: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:03.081251128Z [2024-07-04 02:45:03,081: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:45:03.089335135Z [2024-07-04 02:45:03,088: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:03.089707412Z [2024-07-04 02:45:03,089: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:03.090184937Z [2024-07-04 02:45:03,089: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:03.090471010Z [2024-07-04 02:45:03,090: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:45:03.091082720Z [2024-07-04 02:45:03,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:45:03.091303835Z [2024-07-04 02:45:03,091: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:03.159633205Z [2024-07-04 02:45:03,159: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:03.210476019Z [2024-07-04 02:45:03,210: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:03.908448051Z [2024-07-04 02:45:03,907: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[312b8453-5aac-4554-bddd-13871152693e] succeeded in 2.550794787000086s: None 2024-07-04T02:45:04.544189668Z [2024-07-04 02:45:04,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9077e633-8e51-4915-a8d8-08d4cb54cc8a] received 2024-07-04T02:45:04.558842704Z [2024-07-04 02:45:04,558: INFO/ForkPoolWorker-15] [9077e633-8e51-4915-a8d8-08d4cb54cc8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:04.770653516Z [2024-07-04 02:45:04,763: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cd429493-4079-47e2-87a9-027795499b33] succeeded in 3.387469544999476s: None 2024-07-04T02:45:04.913118693Z [2024-07-04 02:45:04,909: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:45:05.048676301Z [2024-07-04 02:45:05,048: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d1179f6-753f-4989-8441-aefcd0e95f6d] succeeded in 3.6722561540000243s: None 2024-07-04T02:45:06.077766992Z [2024-07-04 02:45:06,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:45:06.081239789Z [2024-07-04 02:45:06,080: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:06.111924384Z [2024-07-04 02:45:06,111: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:45:06.113270086Z [2024-07-04 02:45:06,113: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:06.113449443Z [2024-07-04 02:45:06,113: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:06.113665658Z [2024-07-04 02:45:06,113: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:06.113852900Z [2024-07-04 02:45:06,113: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:45:06.114516373Z [2024-07-04 02:45:06,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:45:06.114618670Z [2024-07-04 02:45:06,114: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:06.206108930Z [2024-07-04 02:45:06,205: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:06.962859736Z [2024-07-04 02:45:06,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9077e633-8e51-4915-a8d8-08d4cb54cc8a] succeeded in 2.4157829050000146s: None 2024-07-04T02:45:07.007441254Z [2024-07-04 02:45:07,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7867f87-2650-4806-8ea8-899c4b091227] received 2024-07-04T02:45:07.021463223Z [2024-07-04 02:45:07,021: INFO/ForkPoolWorker-15] [a7867f87-2650-4806-8ea8-899c4b091227] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:45:07.327929128Z [2024-07-04 02:45:07,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:45:08.407417859Z [2024-07-04 02:45:08,406: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:45:08.410861585Z [2024-07-04 02:45:08,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:08.438476994Z [2024-07-04 02:45:08,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:45:08.440220173Z [2024-07-04 02:45:08,439: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:08.440639540Z [2024-07-04 02:45:08,440: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:08.440774699Z [2024-07-04 02:45:08,440: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:08.440908386Z [2024-07-04 02:45:08,440: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:45:08.441245580Z [2024-07-04 02:45:08,441: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:45:08.441701547Z [2024-07-04 02:45:08,441: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:08.544616834Z [2024-07-04 02:45:08,544: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:09.175049583Z [2024-07-04 02:45:09,174: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a7867f87-2650-4806-8ea8-899c4b091227] succeeded in 2.1600033579998126s: None 2024-07-04T02:45:09.598932234Z [2024-07-04 02:45:09,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9a1d6a7-6d8b-48fc-9d49-e205329a5ec3] received 2024-07-04T02:45:09.608602392Z [2024-07-04 02:45:09,608: INFO/ForkPoolWorker-15] [d9a1d6a7-6d8b-48fc-9d49-e205329a5ec3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:45:09.924012924Z [2024-07-04 02:45:09,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:45:11.030566890Z [2024-07-04 02:45:11,030: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:45:11.033958970Z [2024-07-04 02:45:11,033: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:45:11.069804864Z [2024-07-04 02:45:11,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:45:11.071167564Z [2024-07-04 02:45:11,070: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:45:11.071295240Z [2024-07-04 02:45:11,071: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:45:11.071449927Z [2024-07-04 02:45:11,071: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:45:11.071486319Z [2024-07-04 02:45:11,071: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:45:11.071811628Z [2024-07-04 02:45:11,071: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:45:11.071844630Z [2024-07-04 02:45:11,071: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:45:11.170391242Z [2024-07-04 02:45:11,169: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:45:11.798730223Z [2024-07-04 02:45:11,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9a1d6a7-6d8b-48fc-9d49-e205329a5ec3] succeeded in 2.194843519000642s: None 2024-07-04T02:46:00.578375828Z [2024-07-04 02:46:00,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7241e62-4edf-4bf8-9f2f-1c6b7369aa75] received 2024-07-04T02:46:00.584631221Z [2024-07-04 02:46:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ab23836-e99b-4173-8d93-938db4aee3c0] received 2024-07-04T02:46:00.598142576Z [2024-07-04 02:46:00,597: INFO/ForkPoolWorker-15] [d7241e62-4edf-4bf8-9f2f-1c6b7369aa75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:46:00.601112757Z [2024-07-04 02:46:00,600: INFO/ForkPoolWorker-16] [3ab23836-e99b-4173-8d93-938db4aee3c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:46:00.606272298Z [2024-07-04 02:46:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d250ac6-3ed8-4117-beea-05a94c85c075] received 2024-07-04T02:46:00.656501688Z [2024-07-04 02:46:00,656: INFO/ForkPoolWorker-1] [8d250ac6-3ed8-4117-beea-05a94c85c075] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:46:01.020885287Z [2024-07-04 02:46:01,016: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:46:01.153347032Z [2024-07-04 02:46:01,148: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:46:01.192360161Z [2024-07-04 02:46:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:46:01.307953232Z [2024-07-04 02:46:01,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:46:01.968035272Z [2024-07-04 02:46:01,964: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8d250ac6-3ed8-4117-beea-05a94c85c075] succeeded in 1.3414360540000416s: None 2024-07-04T02:46:02.443958546Z [2024-07-04 02:46:02,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:46:02.447042479Z [2024-07-04 02:46:02,446: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:46:02.484746309Z [2024-07-04 02:46:02,484: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:46:02.488348402Z [2024-07-04 02:46:02,487: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:46:02.497263165Z [2024-07-04 02:46:02,496: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:46:02.500879213Z [2024-07-04 02:46:02,500: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:46:02.501463797Z [2024-07-04 02:46:02,501: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:46:02.501834831Z [2024-07-04 02:46:02,501: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:46:02.502104886Z [2024-07-04 02:46:02,501: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:46:02.503043868Z [2024-07-04 02:46:02,502: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:46:02.503077469Z [2024-07-04 02:46:02,502: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:46:02.512626767Z [2024-07-04 02:46:02,512: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:46:02.513637837Z [2024-07-04 02:46:02,513: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:46:02.514183703Z [2024-07-04 02:46:02,514: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:46:02.514330066Z [2024-07-04 02:46:02,514: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:46:02.515245081Z [2024-07-04 02:46:02,515: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:46:02.515572344Z [2024-07-04 02:46:02,515: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:46:02.515648779Z [2024-07-04 02:46:02,515: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:46:02.587851419Z [2024-07-04 02:46:02,587: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:46:02.599922208Z [2024-07-04 02:46:02,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:46:04.189975596Z [2024-07-04 02:46:04,189: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7241e62-4edf-4bf8-9f2f-1c6b7369aa75] succeeded in 3.6063201779998053s: None 2024-07-04T02:46:04.575278462Z [2024-07-04 02:46:04,574: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ab23836-e99b-4173-8d93-938db4aee3c0] succeeded in 3.98733345599976s: None 2024-07-04T02:47:00.487511601Z [2024-07-04 02:47:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96463999-c017-4fa1-9a37-b080ac2edc72] received 2024-07-04T02:47:00.503546738Z [2024-07-04 02:47:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85095abb-1629-4c44-90c9-a13f9b4df9fd] received 2024-07-04T02:47:00.503572200Z [2024-07-04 02:47:00,503: INFO/ForkPoolWorker-15] [96463999-c017-4fa1-9a37-b080ac2edc72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:47:00.517488168Z [2024-07-04 02:47:00,517: INFO/ForkPoolWorker-16] [85095abb-1629-4c44-90c9-a13f9b4df9fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:47:00.861991162Z [2024-07-04 02:47:00,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:47:00.915963606Z [2024-07-04 02:47:00,912: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:47:02.093317327Z [2024-07-04 02:47:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:47:02.094174602Z [2024-07-04 02:47:02,093: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:47:02.096682056Z [2024-07-04 02:47:02,096: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:47:02.097339314Z [2024-07-04 02:47:02,096: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:47:02.126030491Z [2024-07-04 02:47:02,125: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:47:02.128723041Z [2024-07-04 02:47:02,128: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:47:02.128993332Z [2024-07-04 02:47:02,128: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:47:02.129251431Z [2024-07-04 02:47:02,128: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:47:02.129733391Z [2024-07-04 02:47:02,129: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:47:02.130265211Z [2024-07-04 02:47:02,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:47:02.130407289Z [2024-07-04 02:47:02,130: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:47:02.131740744Z [2024-07-04 02:47:02,131: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:47:02.135878761Z [2024-07-04 02:47:02,135: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:47:02.135913045Z [2024-07-04 02:47:02,135: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:47:02.136094065Z [2024-07-04 02:47:02,135: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:47:02.136111273Z [2024-07-04 02:47:02,136: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:47:02.137104716Z [2024-07-04 02:47:02,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:47:02.137143556Z [2024-07-04 02:47:02,137: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:47:02.229220752Z [2024-07-04 02:47:02,228: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:47:02.237274521Z [2024-07-04 02:47:02,236: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:47:03.842846633Z [2024-07-04 02:47:03,841: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85095abb-1629-4c44-90c9-a13f9b4df9fd] succeeded in 3.336544537000009s: None 2024-07-04T02:47:04.079502629Z [2024-07-04 02:47:04,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96463999-c017-4fa1-9a37-b080ac2edc72] succeeded in 3.58937930600041s: None 2024-07-04T02:47:39.652244381Z [2024-07-04 02:47:39,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5aee7d3-d453-4c46-ae4d-b694d79bf65d] received 2024-07-04T02:47:39.678577044Z [2024-07-04 02:47:39,678: INFO/ForkPoolWorker-15] [f5aee7d3-d453-4c46-ae4d-b694d79bf65d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240704024738_084940', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-07-04T02:47:40.130788627Z [2024-07-04 02:47:40,126: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-07-04T02:47:40.463724195Z [2024-07-04 02:47:40,463: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:47:41.103136717Z [2024-07-04 02:47:41,102: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5aee7d3-d453-4c46-ae4d-b694d79bf65d] succeeded in 1.4454846879998513s: None 2024-07-04T02:48:00.909817789Z [2024-07-04 02:48:00,909: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9da0d3e-7084-40e3-8f8a-82273b56280c] received 2024-07-04T02:48:00.923869523Z [2024-07-04 02:48:00,923: INFO/ForkPoolWorker-15] [b9da0d3e-7084-40e3-8f8a-82273b56280c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:48:00.927804698Z [2024-07-04 02:48:00,927: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ca6ee21-c585-4051-9410-c1f325cda1d2] received 2024-07-04T02:48:00.933953507Z [2024-07-04 02:48:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d81cdf10-8e00-4377-8374-e7f77fa93058] received 2024-07-04T02:48:00.952735518Z [2024-07-04 02:48:00,952: INFO/ForkPoolWorker-1] [d81cdf10-8e00-4377-8374-e7f77fa93058] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:48:00.960725311Z [2024-07-04 02:48:00,960: INFO/ForkPoolWorker-16] [0ca6ee21-c585-4051-9410-c1f325cda1d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:48:01.289775689Z [2024-07-04 02:48:01,286: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:48:01.316246069Z [2024-07-04 02:48:01,312: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:48:01.322666143Z [2024-07-04 02:48:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:48:01.583222187Z [2024-07-04 02:48:01,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:48:02.230730312Z [2024-07-04 02:48:02,230: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9da0d3e-7084-40e3-8f8a-82273b56280c] succeeded in 1.316214059000231s: None 2024-07-04T02:48:02.552359066Z [2024-07-04 02:48:02,551: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:48:02.555638818Z [2024-07-04 02:48:02,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:48:02.581270990Z [2024-07-04 02:48:02,581: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:48:02.587662161Z [2024-07-04 02:48:02,587: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:48:02.587804986Z [2024-07-04 02:48:02,587: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:48:02.588005009Z [2024-07-04 02:48:02,587: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:48:02.588159337Z [2024-07-04 02:48:02,587: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:48:02.588919303Z [2024-07-04 02:48:02,588: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:48:02.589130613Z [2024-07-04 02:48:02,588: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:48:02.675799005Z [2024-07-04 02:48:02,675: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:48:02.693978945Z [2024-07-04 02:48:02,693: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:48:02.697264547Z [2024-07-04 02:48:02,696: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:48:02.724218779Z [2024-07-04 02:48:02,723: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:48:02.726566938Z [2024-07-04 02:48:02,726: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:48:02.726582204Z [2024-07-04 02:48:02,726: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:48:02.726714145Z [2024-07-04 02:48:02,726: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:48:02.726753857Z [2024-07-04 02:48:02,726: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:48:02.728264499Z [2024-07-04 02:48:02,727: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:48:02.728362034Z [2024-07-04 02:48:02,728: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:48:02.829618521Z [2024-07-04 02:48:02,829: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:48:04.581613598Z [2024-07-04 02:48:04,581: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ca6ee21-c585-4051-9410-c1f325cda1d2] succeeded in 3.6481955680001192s: None 2024-07-04T02:48:04.823282493Z [2024-07-04 02:48:04,822: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d81cdf10-8e00-4377-8374-e7f77fa93058] succeeded in 3.8856008809998457s: None 2024-07-04T02:49:01.165158383Z [2024-07-04 02:49:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7fda0af-c319-4a46-a20a-1734fe2a781b] received 2024-07-04T02:49:01.170744322Z [2024-07-04 02:49:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd209984-3133-4403-a5eb-1d23c20e24a6] received 2024-07-04T02:49:01.186495052Z [2024-07-04 02:49:01,185: INFO/ForkPoolWorker-15] [e7fda0af-c319-4a46-a20a-1734fe2a781b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:49:01.189692556Z [2024-07-04 02:49:01,189: INFO/ForkPoolWorker-16] [dd209984-3133-4403-a5eb-1d23c20e24a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:49:01.515412345Z [2024-07-04 02:49:01,511: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:49:01.579669000Z [2024-07-04 02:49:01,574: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:49:02.748349194Z [2024-07-04 02:49:02,747: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:49:02.752081871Z [2024-07-04 02:49:02,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:02.790387008Z [2024-07-04 02:49:02,789: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:49:02.793564715Z [2024-07-04 02:49:02,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:02.797431844Z [2024-07-04 02:49:02,797: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:49:02.799676287Z [2024-07-04 02:49:02,799: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:02.800621058Z [2024-07-04 02:49:02,799: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:02.800924678Z [2024-07-04 02:49:02,800: INFO/ForkPoolWorker-15] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:02.801458470Z [2024-07-04 02:49:02,800: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:02.802804578Z [2024-07-04 02:49:02,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:49:02.803437962Z [2024-07-04 02:49:02,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:49:02.805059384Z [2024-07-04 02:49:02,803: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:02.822455239Z [2024-07-04 02:49:02,822: INFO/ForkPoolWorker-15] Creating DAG vim_status_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:02.839206765Z [2024-07-04 02:49:02,838: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:49:02.841270169Z [2024-07-04 02:49:02,840: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:02.841402135Z [2024-07-04 02:49:02,841: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:02.841528235Z [2024-07-04 02:49:02,841: INFO/ForkPoolWorker-16] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:02.841784576Z [2024-07-04 02:49:02,841: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:02.841905202Z [2024-07-04 02:49:02,841: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:49:02.842322052Z [2024-07-04 02:49:02,842: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:49:02.842437048Z [2024-07-04 02:49:02,842: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:02.851523940Z [2024-07-04 02:49:02,851: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:02.912523822Z [2024-07-04 02:49:02,912: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:02.941532734Z [2024-07-04 02:49:02,941: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:05.020573546Z [2024-07-04 02:49:05,020: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7fda0af-c319-4a46-a20a-1734fe2a781b] succeeded in 3.8489004660004866s: None 2024-07-04T02:49:05.557808824Z [2024-07-04 02:49:05,557: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd209984-3133-4403-a5eb-1d23c20e24a6] succeeded in 4.3837579949995416s: None 2024-07-04T02:49:23.179965006Z [2024-07-04 02:49:23,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1109ba17-548b-4e87-acea-7442f011d96a] received 2024-07-04T02:49:23.188038720Z [2024-07-04 02:49:23,187: INFO/ForkPoolWorker-15] [1109ba17-548b-4e87-acea-7442f011d96a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:49:23.503243836Z [2024-07-04 02:49:23,500: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:49:24.645825335Z [2024-07-04 02:49:24,645: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:49:24.651267308Z [2024-07-04 02:49:24,648: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:24.673654151Z [2024-07-04 02:49:24,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:49:24.676241241Z [2024-07-04 02:49:24,675: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:24.676448812Z [2024-07-04 02:49:24,676: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:24.676520646Z [2024-07-04 02:49:24,676: INFO/ForkPoolWorker-15] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:24.676728507Z [2024-07-04 02:49:24,676: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:24.676896186Z [2024-07-04 02:49:24,676: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:49:24.677613170Z [2024-07-04 02:49:24,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:49:24.677628667Z [2024-07-04 02:49:24,677: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:24.683170391Z [2024-07-04 02:49:24,682: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:24.763725563Z [2024-07-04 02:49:24,762: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:26.561488839Z [2024-07-04 02:49:26,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1109ba17-548b-4e87-acea-7442f011d96a] succeeded in 3.379001455999969s: None 2024-07-04T02:49:29.493034098Z [2024-07-04 02:49:29,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adbec57e-886e-4734-b228-05d68e9b5a83] received 2024-07-04T02:49:29.508751573Z [2024-07-04 02:49:29,508: INFO/ForkPoolWorker-15] [adbec57e-886e-4734-b228-05d68e9b5a83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:29.980011691Z [2024-07-04 02:49:29,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:49:31.285107639Z [2024-07-04 02:49:31,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a00c2ef-80d1-4d04-83a7-9643a3f4c774] received 2024-07-04T02:49:31.309591902Z [2024-07-04 02:49:31,309: INFO/ForkPoolWorker-16] [4a00c2ef-80d1-4d04-83a7-9643a3f4c774] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:49:31.379640674Z [2024-07-04 02:49:31,379: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:49:31.382789785Z [2024-07-04 02:49:31,382: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:31.417227840Z [2024-07-04 02:49:31,417: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:49:31.418432472Z [2024-07-04 02:49:31,418: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:31.418485853Z [2024-07-04 02:49:31,418: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:31.418562566Z [2024-07-04 02:49:31,418: INFO/ForkPoolWorker-15] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:31.418705374Z [2024-07-04 02:49:31,418: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:31.418765661Z [2024-07-04 02:49:31,418: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:49:31.419358278Z [2024-07-04 02:49:31,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:49:31.419382771Z [2024-07-04 02:49:31,419: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:31.426017476Z [2024-07-04 02:49:31,425: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:31.609041058Z [2024-07-04 02:49:31,606: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:49:31.624318238Z [2024-07-04 02:49:31,624: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:32.323826258Z [2024-07-04 02:49:32,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[adbec57e-886e-4734-b228-05d68e9b5a83] succeeded in 2.829086654999628s: None 2024-07-04T02:49:32.515507938Z [2024-07-04 02:49:32,515: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08c54cd4-a4a7-45ca-affc-592a76fc1d85] received 2024-07-04T02:49:32.532801812Z [2024-07-04 02:49:32,532: INFO/ForkPoolWorker-15] [08c54cd4-a4a7-45ca-affc-592a76fc1d85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'split_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:32.702633163Z [2024-07-04 02:49:32,702: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:49:32.705855732Z [2024-07-04 02:49:32,705: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:32.734455710Z [2024-07-04 02:49:32,734: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:49:32.736251068Z [2024-07-04 02:49:32,735: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:32.736388546Z [2024-07-04 02:49:32,736: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:32.736529499Z [2024-07-04 02:49:32,736: INFO/ForkPoolWorker-16] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:32.736778859Z [2024-07-04 02:49:32,736: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:32.736949738Z [2024-07-04 02:49:32,736: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:49:32.738200040Z [2024-07-04 02:49:32,737: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:49:32.738422494Z [2024-07-04 02:49:32,738: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:32.743663931Z [2024-07-04 02:49:32,743: INFO/ForkPoolWorker-16] Creating DAG vim_status_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:32.793869702Z [2024-07-04 02:49:32,790: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:49:32.841822246Z [2024-07-04 02:49:32,841: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:33.875840211Z [2024-07-04 02:49:33,875: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:49:33.879158239Z [2024-07-04 02:49:33,878: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:33.902530494Z [2024-07-04 02:49:33,902: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:49:33.905490168Z [2024-07-04 02:49:33,905: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:33.905584463Z [2024-07-04 02:49:33,905: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:33.905594613Z [2024-07-04 02:49:33,905: INFO/ForkPoolWorker-15] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:33.905698250Z [2024-07-04 02:49:33,905: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:33.905884720Z [2024-07-04 02:49:33,905: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:49:33.906470013Z [2024-07-04 02:49:33,906: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:49:33.906533566Z [2024-07-04 02:49:33,906: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:33.913108714Z [2024-07-04 02:49:33,912: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:33.996443900Z [2024-07-04 02:49:33,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:34.410258979Z [2024-07-04 02:49:34,409: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a00c2ef-80d1-4d04-83a7-9643a3f4c774] succeeded in 3.117848844999571s: None 2024-07-04T02:49:34.586525017Z [2024-07-04 02:49:34,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a69d168-a99b-4649-a0dd-d304dd7f255d] received 2024-07-04T02:49:34.594435461Z [2024-07-04 02:49:34,594: INFO/ForkPoolWorker-16] [5a69d168-a99b-4649-a0dd-d304dd7f255d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'collect_metrics', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:49:34.635471698Z [2024-07-04 02:49:34,635: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08c54cd4-a4a7-45ca-affc-592a76fc1d85] succeeded in 2.117903774000297s: None 2024-07-04T02:49:34.893017850Z [2024-07-04 02:49:34,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:49:35.948118576Z [2024-07-04 02:49:35,947: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:49:35.951531524Z [2024-07-04 02:49:35,950: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:35.980727793Z [2024-07-04 02:49:35,980: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:49:35.982506306Z [2024-07-04 02:49:35,982: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:35.982528224Z [2024-07-04 02:49:35,982: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:35.982678537Z [2024-07-04 02:49:35,982: INFO/ForkPoolWorker-16] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:35.983403642Z [2024-07-04 02:49:35,983: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:35.983414833Z [2024-07-04 02:49:35,983: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:49:35.983777739Z [2024-07-04 02:49:35,983: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:49:35.983791856Z [2024-07-04 02:49:35,983: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:35.992505456Z [2024-07-04 02:49:35,992: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:36.074185985Z [2024-07-04 02:49:36,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:36.685792811Z [2024-07-04 02:49:36,685: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a69d168-a99b-4649-a0dd-d304dd7f255d] succeeded in 2.096084038999834s: None 2024-07-04T02:49:36.916498981Z [2024-07-04 02:49:36,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6865f15-8d2f-4179-ad40-be4a8785e7ba] received 2024-07-04T02:49:36.929882267Z [2024-07-04 02:49:36,929: INFO/ForkPoolWorker-15] [c6865f15-8d2f-4179-ad40-be4a8785e7ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'send_prometheus', 'scheduled__2024-07-04T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:49:37.257654682Z [2024-07-04 02:49:37,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:49:38.413671939Z [2024-07-04 02:49:38,413: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:49:38.417089667Z [2024-07-04 02:49:38,416: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:49:38.460183066Z [2024-07-04 02:49:38,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:49:38.464769156Z [2024-07-04 02:49:38,464: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:49:38.464797187Z [2024-07-04 02:49:38,464: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:49:38.464967974Z [2024-07-04 02:49:38,464: INFO/ForkPoolWorker-15] Read VIM 34858745-d98b-4cab-9dea-63242887bdfc (basic01_665903) 2024-07-04T02:49:38.465298519Z [2024-07-04 02:49:38,464: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '34858745-d98b-4cab-9dea-63242887bdfc', 'name': 'basic01_665903', 'vim_type': 'openstack'}] 2024-07-04T02:49:38.465410849Z [2024-07-04 02:49:38,465: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:49:38.467180297Z [2024-07-04 02:49:38,465: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:49:38.467205738Z [2024-07-04 02:49:38,467: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:49:38.476815906Z [2024-07-04 02:49:38,476: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc 2024-07-04T02:49:38.555032648Z [2024-07-04 02:49:38,554: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:39.092850090Z [2024-07-04 02:49:39,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6865f15-8d2f-4179-ad40-be4a8785e7ba] succeeded in 2.171414761000051s: None 2024-07-04T02:49:39.703208856Z [2024-07-04 02:49:39,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82c70984-8ae2-4ccc-8f60-a5d218039da5] received 2024-07-04T02:49:39.712330120Z [2024-07-04 02:49:39,712: INFO/ForkPoolWorker-15] [82c70984-8ae2-4ccc-8f60-a5d218039da5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240704024938_675020', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-07-04T02:49:40.001324884Z [2024-07-04 02:49:39,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-07-04T02:49:40.291002798Z [2024-07-04 02:49:40,290: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:49:40.879767392Z [2024-07-04 02:49:40,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82c70984-8ae2-4ccc-8f60-a5d218039da5] succeeded in 1.174139168999318s: None 2024-07-04T02:50:00.437116834Z [2024-07-04 02:50:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d71e7d2-4312-4755-a94f-ae603201765a] received 2024-07-04T02:50:00.445084703Z [2024-07-04 02:50:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[929e9b72-9fc9-45c2-880a-2d3791f7e50d] received 2024-07-04T02:50:00.451533774Z [2024-07-04 02:50:00,451: INFO/ForkPoolWorker-15] [2d71e7d2-4312-4755-a94f-ae603201765a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:00.457533606Z [2024-07-04 02:50:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b714d869-5b6d-4e3f-88cc-272f6ec652d0] received 2024-07-04T02:50:00.460341918Z [2024-07-04 02:50:00,460: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7138d0a4-1568-4645-88cd-13c4a39cfd84] received 2024-07-04T02:50:00.461964005Z [2024-07-04 02:50:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[486bad40-b766-4a67-9957-93ae1daac0e0] received 2024-07-04T02:50:00.463560963Z [2024-07-04 02:50:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87b67594-af08-46ea-bc39-7797dfef469a] received 2024-07-04T02:50:00.464898134Z [2024-07-04 02:50:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fdd6d6b-fc0b-4026-83b5-53735951d6ad] received 2024-07-04T02:50:00.504038586Z [2024-07-04 02:50:00,503: INFO/ForkPoolWorker-4] [87b67594-af08-46ea-bc39-7797dfef469a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:00.515916386Z [2024-07-04 02:50:00,515: INFO/ForkPoolWorker-16] [929e9b72-9fc9-45c2-880a-2d3791f7e50d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:00.529285012Z [2024-07-04 02:50:00,528: INFO/ForkPoolWorker-2] [7138d0a4-1568-4645-88cd-13c4a39cfd84] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:50:00.534096427Z [2024-07-04 02:50:00,533: INFO/ForkPoolWorker-5] [7fdd6d6b-fc0b-4026-83b5-53735951d6ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:00.866953263Z [2024-07-04 02:50:00,866: INFO/ForkPoolWorker-1] [b714d869-5b6d-4e3f-88cc-272f6ec652d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:00.873375550Z [2024-07-04 02:50:00,872: INFO/ForkPoolWorker-3] [486bad40-b766-4a67-9957-93ae1daac0e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:01.059630820Z [2024-07-04 02:50:01,055: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:01.520028589Z [2024-07-04 02:50:01,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:01.651129519Z [2024-07-04 02:50:01,609: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:01.745759816Z [2024-07-04 02:50:01,741: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:50:02.092373637Z [2024-07-04 02:50:02,083: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:02.288005969Z [2024-07-04 02:50:02,283: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:02.941335938Z [2024-07-04 02:50:02,940: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:03.572366227Z [2024-07-04 02:50:03,534: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:04.410131065Z [2024-07-04 02:50:04,409: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7138d0a4-1568-4645-88cd-13c4a39cfd84] succeeded in 3.945534611999392s: None 2024-07-04T02:50:06.286271522Z [2024-07-04 02:50:06,285: INFO/ForkPoolWorker-5] Getting VIM list 2024-07-04T02:50:06.290364371Z [2024-07-04 02:50:06,289: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:06.417095466Z [2024-07-04 02:50:06,416: INFO/ForkPoolWorker-5] Connected to database osm version 1.2 2024-07-04T02:50:06.424841783Z [2024-07-04 02:50:06,424: INFO/ForkPoolWorker-5] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:06.424856047Z [2024-07-04 02:50:06,424: INFO/ForkPoolWorker-5] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:06.425033671Z [2024-07-04 02:50:06,424: INFO/ForkPoolWorker-5] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:06.425080094Z [2024-07-04 02:50:06,424: INFO/ForkPoolWorker-5] Getting VIM list OK 2024-07-04T02:50:06.425488291Z [2024-07-04 02:50:06,425: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:50:06.425693018Z [2024-07-04 02:50:06,425: INFO/ForkPoolWorker-5] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:06.622271211Z [2024-07-04 02:50:06,622: INFO/ForkPoolWorker-5] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:06.743377094Z [2024-07-04 02:50:06,734: INFO/ForkPoolWorker-4] Getting VIM list 2024-07-04T02:50:06.788940687Z [2024-07-04 02:50:06,788: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:06.885773118Z [2024-07-04 02:50:06,885: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T02:50:06.889408078Z [2024-07-04 02:50:06,888: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:06.930396078Z [2024-07-04 02:50:06,930: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T02:50:06.930952403Z [2024-07-04 02:50:06,930: INFO/ForkPoolWorker-4] Connected to database osm version 1.2 2024-07-04T02:50:06.936163571Z [2024-07-04 02:50:06,935: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:06.936195788Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:06.936685652Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-4] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:06.936757684Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-4] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:06.936770258Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-4] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:06.936824652Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-4] Getting VIM list OK 2024-07-04T02:50:06.937060133Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:50:06.937071863Z [2024-07-04 02:50:06,937: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:06.939520553Z [2024-07-04 02:50:06,936: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:06.939661481Z [2024-07-04 02:50:06,939: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T02:50:06.939861451Z [2024-07-04 02:50:06,939: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:50:06.940225799Z [2024-07-04 02:50:06,939: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:50:06.940358387Z [2024-07-04 02:50:06,940: INFO/ForkPoolWorker-3] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:06.943897107Z [2024-07-04 02:50:06,943: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:06.955136894Z [2024-07-04 02:50:06,954: WARNING/ForkPoolWorker-3] Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:06.956232499Z [2024-07-04 02:50:06,955: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:06.958808646Z [2024-07-04 02:50:06,958: INFO/ForkPoolWorker-3] Getting VIM list 2024-07-04T02:50:06.965201863Z [2024-07-04 02:50:06,964: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:07.055532896Z [2024-07-04 02:50:07,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:50:07.063844817Z [2024-07-04 02:50:07,063: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.063880464Z [2024-07-04 02:50:07,063: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.064737782Z [2024-07-04 02:50:07,063: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.064837057Z [2024-07-04 02:50:07,064: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:50:07.066184669Z [2024-07-04 02:50:07,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:50:07.066722373Z [2024-07-04 02:50:07,066: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.072106835Z [2024-07-04 02:50:07,071: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-07-04T02:50:07.077211051Z [2024-07-04 02:50:07,077: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:07.078718992Z [2024-07-04 02:50:07,077: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:07.078993286Z [2024-07-04 02:50:07,078: INFO/ForkPoolWorker-3] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.079111786Z [2024-07-04 02:50:07,078: INFO/ForkPoolWorker-3] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.079337823Z [2024-07-04 02:50:07,079: INFO/ForkPoolWorker-3] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.079443255Z [2024-07-04 02:50:07,079: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-07-04T02:50:07.079774144Z [2024-07-04 02:50:07,079: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:50:07.079882175Z [2024-07-04 02:50:07,079: INFO/ForkPoolWorker-3] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.081068895Z [2024-07-04 02:50:07,080: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:50:07.084685874Z [2024-07-04 02:50:07,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:07.085083038Z [2024-07-04 02:50:07,084: ERROR/ForkPoolWorker-3] [486bad40-b766-4a67-9957-93ae1daac0e0] Failed to execute task Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:07.085135994Z Traceback (most recent call last): 2024-07-04T02:50:07.085141036Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:07.085144804Z args.func(args) 2024-07-04T02:50:07.085148586Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:07.085151973Z return func(*args, **kwargs) 2024-07-04T02:50:07.085155273Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:07.085158292Z return f(*args, **kwargs) 2024-07-04T02:50:07.085161328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:07.085164467Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:07.085183271Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:07.085186304Z raise AirflowException( 2024-07-04T02:50:07.085190067Z airflow.exceptions.AirflowException: Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:07.138005557Z [2024-07-04 02:50:07,137: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:50:07.140408700Z [2024-07-04 02:50:07,140: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.140443302Z [2024-07-04 02:50:07,140: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.141917592Z [2024-07-04 02:50:07,141: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.141947476Z [2024-07-04 02:50:07,141: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:50:07.144388344Z [2024-07-04 02:50:07,144: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:50:07.144424998Z [2024-07-04 02:50:07,144: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.157685919Z [2024-07-04 02:50:07,157: ERROR/ForkPoolWorker-16] [929e9b72-9fc9-45c2-880a-2d3791f7e50d] Failed to execute task Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:07.157706366Z Traceback (most recent call last): 2024-07-04T02:50:07.157710194Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:07.157713783Z args.func(args) 2024-07-04T02:50:07.157717373Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:07.157721360Z return func(*args, **kwargs) 2024-07-04T02:50:07.157724481Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:07.157727518Z return f(*args, **kwargs) 2024-07-04T02:50:07.157730523Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:07.157733487Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:07.157736461Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:07.157739363Z raise AirflowException( 2024-07-04T02:50:07.157743196Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:07.167241229Z [2024-07-04 02:50:07,166: INFO/ForkPoolWorker-4] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:07.215586029Z [2024-07-04 02:50:07,215: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[929e9b72-9fc9-45c2-880a-2d3791f7e50d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 929e9b72-9fc9-45c2-880a-2d3791f7e50d') 2024-07-04T02:50:07.215608577Z Traceback (most recent call last): 2024-07-04T02:50:07.215612848Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:07.215628567Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:07.215631797Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:07.215635074Z return self.run(*args, **kwargs) 2024-07-04T02:50:07.215649022Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:07.215652686Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:07.215655888Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:07.215659709Z raise AirflowException(msg) 2024-07-04T02:50:07.215663603Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 929e9b72-9fc9-45c2-880a-2d3791f7e50d 2024-07-04T02:50:07.235025021Z [2024-07-04 02:50:07,234: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:07.238647792Z [2024-07-04 02:50:07,238: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:07.282975740Z [2024-07-04 02:50:07,282: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[486bad40-b766-4a67-9957-93ae1daac0e0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 486bad40-b766-4a67-9957-93ae1daac0e0') 2024-07-04T02:50:07.282996494Z Traceback (most recent call last): 2024-07-04T02:50:07.283002315Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:07.283006884Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:07.283011303Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:07.283015971Z return self.run(*args, **kwargs) 2024-07-04T02:50:07.283020986Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:07.283026011Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:07.283030905Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:07.283036241Z raise AirflowException(msg) 2024-07-04T02:50:07.283041502Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 486bad40-b766-4a67-9957-93ae1daac0e0 2024-07-04T02:50:07.288614641Z [2024-07-04 02:50:07,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:07.290042599Z [2024-07-04 02:50:07,289: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.290291538Z [2024-07-04 02:50:07,290: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.291606287Z [2024-07-04 02:50:07,291: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.292604178Z [2024-07-04 02:50:07,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:07.293011488Z [2024-07-04 02:50:07,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:07.293609242Z [2024-07-04 02:50:07,293: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.402242376Z [2024-07-04 02:50:07,401: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:50:07.409995860Z [2024-07-04 02:50:07,409: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:07.413370415Z [2024-07-04 02:50:07,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:07.472428260Z [2024-07-04 02:50:07,472: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:50:07.473873997Z [2024-07-04 02:50:07,473: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.473957007Z [2024-07-04 02:50:07,473: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.474266361Z [2024-07-04 02:50:07,473: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.474375108Z [2024-07-04 02:50:07,474: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:50:07.474709346Z [2024-07-04 02:50:07,474: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:07.475028978Z [2024-07-04 02:50:07,474: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.494489346Z [2024-07-04 02:50:07,494: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:07.495711984Z [2024-07-04 02:50:07,494: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:07.496801672Z [2024-07-04 02:50:07,496: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:50:07.505574955Z [2024-07-04 02:50:07,505: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:07.567165311Z [2024-07-04 02:50:07,566: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:50:07.571503215Z [2024-07-04 02:50:07,571: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:07.571757951Z [2024-07-04 02:50:07,571: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:07.572002476Z [2024-07-04 02:50:07,571: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:07.572084119Z [2024-07-04 02:50:07,571: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:50:07.572563339Z [2024-07-04 02:50:07,572: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:07.572760457Z [2024-07-04 02:50:07,572: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:07.577727184Z [2024-07-04 02:50:07,575: ERROR/ForkPoolWorker-1] [b714d869-5b6d-4e3f-88cc-272f6ec652d0] Failed to execute task Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:07.577742500Z Traceback (most recent call last): 2024-07-04T02:50:07.577746408Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:07.577750264Z args.func(args) 2024-07-04T02:50:07.577753891Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:07.577757640Z return func(*args, **kwargs) 2024-07-04T02:50:07.577761053Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:07.577764211Z return f(*args, **kwargs) 2024-07-04T02:50:07.577767302Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:07.577773509Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:07.577776939Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:07.577780102Z raise AirflowException( 2024-07-04T02:50:07.577784135Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:07.632446206Z [2024-07-04 02:50:07,630: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b714d869-5b6d-4e3f-88cc-272f6ec652d0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b714d869-5b6d-4e3f-88cc-272f6ec652d0') 2024-07-04T02:50:07.632467971Z Traceback (most recent call last): 2024-07-04T02:50:07.632472174Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:07.632475392Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:07.632478471Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:07.632481630Z return self.run(*args, **kwargs) 2024-07-04T02:50:07.632485655Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:07.632489226Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:07.632492173Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:07.632495773Z raise AirflowException(msg) 2024-07-04T02:50:07.632499534Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b714d869-5b6d-4e3f-88cc-272f6ec652d0 2024-07-04T02:50:08.033570857Z [2024-07-04 02:50:08,033: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d71e7d2-4312-4755-a94f-ae603201765a] succeeded in 7.594917823000287s: None 2024-07-04T02:50:08.314203028Z [2024-07-04 02:50:08,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc03c2b9-f196-466b-bde0-a4d8362ff90c] received 2024-07-04T02:50:08.320303053Z [2024-07-04 02:50:08,320: INFO/ForkPoolWorker-15] [fc03c2b9-f196-466b-bde0-a4d8362ff90c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:08.412538925Z [2024-07-04 02:50:08,412: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[7fdd6d6b-fc0b-4026-83b5-53735951d6ad] succeeded in 7.933201290999932s: None 2024-07-04T02:50:08.728199819Z [2024-07-04 02:50:08,724: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:09.085690752Z [2024-07-04 02:50:09,085: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[87b67594-af08-46ea-bc39-7797dfef469a] succeeded in 8.619346330000553s: None 2024-07-04T02:50:10.395712481Z [2024-07-04 02:50:10,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:10.399447953Z [2024-07-04 02:50:10,398: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:10.440910648Z [2024-07-04 02:50:10,440: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:10.443017114Z [2024-07-04 02:50:10,442: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:10.443188258Z [2024-07-04 02:50:10,443: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:10.444034914Z [2024-07-04 02:50:10,443: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:10.444146860Z [2024-07-04 02:50:10,444: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:10.445695941Z [2024-07-04 02:50:10,445: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:10.445787829Z [2024-07-04 02:50:10,445: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:10.568425574Z [2024-07-04 02:50:10,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:11.267999453Z [2024-07-04 02:50:11,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc03c2b9-f196-466b-bde0-a4d8362ff90c] succeeded in 2.9522194389992364s: None 2024-07-04T02:50:12.073149674Z [2024-07-04 02:50:12,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6643749-e53a-4bf4-81d6-9116b0885cff] received 2024-07-04T02:50:12.084495806Z [2024-07-04 02:50:12,084: INFO/ForkPoolWorker-15] [a6643749-e53a-4bf4-81d6-9116b0885cff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:50:12.423178040Z [2024-07-04 02:50:12,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:13.600641862Z [2024-07-04 02:50:13,600: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:13.604016688Z [2024-07-04 02:50:13,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:13.631182416Z [2024-07-04 02:50:13,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:13.633470294Z [2024-07-04 02:50:13,633: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:13.633540401Z [2024-07-04 02:50:13,633: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:13.634038168Z [2024-07-04 02:50:13,633: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:13.634158228Z [2024-07-04 02:50:13,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:13.635250308Z [2024-07-04 02:50:13,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:13.635270562Z [2024-07-04 02:50:13,635: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:13.764824377Z [2024-07-04 02:50:13,764: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:14.459124021Z [2024-07-04 02:50:14,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6643749-e53a-4bf4-81d6-9116b0885cff] succeeded in 2.383487922999848s: None 2024-07-04T02:50:14.564558184Z [2024-07-04 02:50:14,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8374d039-938c-458a-8a97-3fc11e1f8207] received 2024-07-04T02:50:14.575392671Z [2024-07-04 02:50:14,574: INFO/ForkPoolWorker-15] [8374d039-938c-458a-8a97-3fc11e1f8207] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:14.926083160Z [2024-07-04 02:50:14,922: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:16.002150441Z [2024-07-04 02:50:16,001: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:16.005576507Z [2024-07-04 02:50:16,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:16.035311544Z [2024-07-04 02:50:16,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:16.036674858Z [2024-07-04 02:50:16,036: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:16.036930071Z [2024-07-04 02:50:16,036: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:16.037097030Z [2024-07-04 02:50:16,036: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:16.037222960Z [2024-07-04 02:50:16,037: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:16.037939912Z [2024-07-04 02:50:16,037: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:16.038080028Z [2024-07-04 02:50:16,037: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:16.147101287Z [2024-07-04 02:50:16,146: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:50:16.825443490Z [2024-07-04 02:50:16,824: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8374d039-938c-458a-8a97-3fc11e1f8207] succeeded in 2.258631917999992s: None 2024-07-04T02:50:19.179005229Z [2024-07-04 02:50:19,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59d3df1e-eff3-4050-bf59-e16102e68ba8] received 2024-07-04T02:50:19.192191577Z [2024-07-04 02:50:19,191: INFO/ForkPoolWorker-15] [59d3df1e-eff3-4050-bf59-e16102e68ba8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:50:19.198179853Z [2024-07-04 02:50:19,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4887adf1-41e0-4cd3-a6ec-aa8835f505ce] received 2024-07-04T02:50:19.202207086Z [2024-07-04 02:50:19,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc498727-79f4-4fd7-af01-b3a7689678dd] received 2024-07-04T02:50:19.215884084Z [2024-07-04 02:50:19,215: INFO/ForkPoolWorker-16] [4887adf1-41e0-4cd3-a6ec-aa8835f505ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:50:19.227022232Z [2024-07-04 02:50:19,226: INFO/ForkPoolWorker-1] [dc498727-79f4-4fd7-af01-b3a7689678dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:50:19.514971705Z [2024-07-04 02:50:19,500: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:19.892622308Z [2024-07-04 02:50:19,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:20.280135457Z [2024-07-04 02:50:20,258: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:21.565952579Z [2024-07-04 02:50:21,565: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:50:21.570128121Z [2024-07-04 02:50:21,569: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.654746552Z [2024-07-04 02:50:21,653: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:21.658479074Z [2024-07-04 02:50:21,657: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.671604893Z [2024-07-04 02:50:21,671: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:50:21.674696741Z [2024-07-04 02:50:21,674: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.674736065Z [2024-07-04 02:50:21,674: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.674914352Z [2024-07-04 02:50:21,674: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.674974717Z [2024-07-04 02:50:21,674: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:50:21.675251671Z [2024-07-04 02:50:21,675: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:50:21.675304340Z [2024-07-04 02:50:21,675: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.684625585Z [2024-07-04 02:50:21,684: WARNING/ForkPoolWorker-16] Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:21.685736743Z [2024-07-04 02:50:21,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:50:21.687683732Z [2024-07-04 02:50:21,687: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:50:21.692581650Z [2024-07-04 02:50:21,692: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.707224244Z [2024-07-04 02:50:21,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:21.708322453Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.708337128Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.708446152Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.708460228Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:21.708747872Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:50:21.708956943Z [2024-07-04 02:50:21,708: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.716869615Z [2024-07-04 02:50:21,716: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:21.718053573Z [2024-07-04 02:50:21,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:50:21.719026865Z [2024-07-04 02:50:21,718: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:50:21.723407664Z [2024-07-04 02:50:21,723: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.723729507Z [2024-07-04 02:50:21,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:50:21.725167024Z [2024-07-04 02:50:21,724: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.725490669Z [2024-07-04 02:50:21,725: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.725695265Z [2024-07-04 02:50:21,725: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.725769463Z [2024-07-04 02:50:21,725: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:50:21.726340078Z [2024-07-04 02:50:21,726: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:50:21.726814309Z [2024-07-04 02:50:21,726: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.730576778Z [2024-07-04 02:50:21,730: ERROR/ForkPoolWorker-16] [4887adf1-41e0-4cd3-a6ec-aa8835f505ce] Failed to execute task Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:21.730589905Z Traceback (most recent call last): 2024-07-04T02:50:21.730594241Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:21.730597963Z args.func(args) 2024-07-04T02:50:21.730602309Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:21.730606181Z return func(*args, **kwargs) 2024-07-04T02:50:21.730609362Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:21.730620970Z return f(*args, **kwargs) 2024-07-04T02:50:21.730624157Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:21.730627366Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:21.730630466Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:21.730633530Z raise AirflowException( 2024-07-04T02:50:21.730637430Z airflow.exceptions.AirflowException: Dag 'vim_status_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:21.740887535Z [2024-07-04 02:50:21,740: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:50:21.742285030Z [2024-07-04 02:50:21,742: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.742300342Z [2024-07-04 02:50:21,742: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.742454045Z [2024-07-04 02:50:21,742: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.742469947Z [2024-07-04 02:50:21,742: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:50:21.743155493Z [2024-07-04 02:50:21,742: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:50:21.743205055Z [2024-07-04 02:50:21,743: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.746410884Z [2024-07-04 02:50:21,745: ERROR/ForkPoolWorker-15] [59d3df1e-eff3-4050-bf59-e16102e68ba8] Failed to execute task Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:21.746429708Z Traceback (most recent call last): 2024-07-04T02:50:21.746434590Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:21.746438592Z args.func(args) 2024-07-04T02:50:21.746442218Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:21.746457739Z return func(*args, **kwargs) 2024-07-04T02:50:21.746460913Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:21.746464034Z return f(*args, **kwargs) 2024-07-04T02:50:21.746467245Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:21.746470320Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:21.746473400Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:21.746476697Z raise AirflowException( 2024-07-04T02:50:21.746480594Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:21.781085372Z [2024-07-04 02:50:21,778: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4887adf1-41e0-4cd3-a6ec-aa8835f505ce] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4887adf1-41e0-4cd3-a6ec-aa8835f505ce') 2024-07-04T02:50:21.781101305Z Traceback (most recent call last): 2024-07-04T02:50:21.781105799Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:21.781108823Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:21.781112073Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:21.781115128Z return self.run(*args, **kwargs) 2024-07-04T02:50:21.781119144Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:21.781122646Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:21.781125575Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:21.781128978Z raise AirflowException(msg) 2024-07-04T02:50:21.781132791Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 4887adf1-41e0-4cd3-a6ec-aa8835f505ce 2024-07-04T02:50:21.785293624Z [2024-07-04 02:50:21,784: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[59d3df1e-eff3-4050-bf59-e16102e68ba8] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 59d3df1e-eff3-4050-bf59-e16102e68ba8') 2024-07-04T02:50:21.785308060Z Traceback (most recent call last): 2024-07-04T02:50:21.785311958Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:21.785315371Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:21.785318805Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:21.785321928Z return self.run(*args, **kwargs) 2024-07-04T02:50:21.785325855Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:21.785329689Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:21.785332738Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:21.785336531Z raise AirflowException(msg) 2024-07-04T02:50:21.785340899Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 59d3df1e-eff3-4050-bf59-e16102e68ba8 2024-07-04T02:50:21.870945421Z [2024-07-04 02:50:21,867: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:50:21.875348843Z [2024-07-04 02:50:21,872: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.925528622Z [2024-07-04 02:50:21,925: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:50:21.927823716Z [2024-07-04 02:50:21,927: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.927957131Z [2024-07-04 02:50:21,927: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.928703347Z [2024-07-04 02:50:21,928: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.928857633Z [2024-07-04 02:50:21,928: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:50:21.929142731Z [2024-07-04 02:50:21,929: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:21.929289103Z [2024-07-04 02:50:21,929: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.937486283Z [2024-07-04 02:50:21,937: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:21.938205921Z [2024-07-04 02:50:21,937: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:50:21.939169980Z [2024-07-04 02:50:21,939: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:50:21.941600984Z [2024-07-04 02:50:21,941: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:50:21.961612061Z [2024-07-04 02:50:21,961: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:50:21.963532644Z [2024-07-04 02:50:21,962: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:50:21.964800426Z [2024-07-04 02:50:21,964: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:50:21.965626666Z [2024-07-04 02:50:21,965: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:50:21.965793135Z [2024-07-04 02:50:21,965: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:50:21.966985595Z [2024-07-04 02:50:21,966: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:50:21.967539588Z [2024-07-04 02:50:21,967: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:50:21.973073660Z [2024-07-04 02:50:21,972: ERROR/ForkPoolWorker-1] [dc498727-79f4-4fd7-af01-b3a7689678dd] Failed to execute task Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse.. 2024-07-04T02:50:21.973122200Z Traceback (most recent call last): 2024-07-04T02:50:21.973132918Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-07-04T02:50:21.973142469Z args.func(args) 2024-07-04T02:50:21.973152117Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-07-04T02:50:21.973161297Z return func(*args, **kwargs) 2024-07-04T02:50:21.973169706Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-07-04T02:50:21.973178092Z return f(*args, **kwargs) 2024-07-04T02:50:21.973186429Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-07-04T02:50:21.973194817Z dag = get_dag(args.subdir, args.dag_id) 2024-07-04T02:50:21.973203409Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-07-04T02:50:21.973211749Z raise AirflowException( 2024-07-04T02:50:21.973220872Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_34858745-d98b-4cab-9dea-63242887bdfc' could not be found; either it does not exist or it failed to parse. 2024-07-04T02:50:22.010806968Z [2024-07-04 02:50:22,010: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc498727-79f4-4fd7-af01-b3a7689678dd] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id dc498727-79f4-4fd7-af01-b3a7689678dd') 2024-07-04T02:50:22.010838725Z Traceback (most recent call last): 2024-07-04T02:50:22.010849306Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-07-04T02:50:22.010857545Z R = retval = fun(*args, **kwargs) 2024-07-04T02:50:22.010920562Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-07-04T02:50:22.010935496Z return self.run(*args, **kwargs) 2024-07-04T02:50:22.010945171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-07-04T02:50:22.010955091Z _execute_in_fork(command_to_exec, celery_task_id) 2024-07-04T02:50:22.010964023Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-07-04T02:50:22.010974108Z raise AirflowException(msg) 2024-07-04T02:50:22.010984089Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id dc498727-79f4-4fd7-af01-b3a7689678dd 2024-07-04T02:51:00.937519618Z [2024-07-04 02:51:00,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f59cbdfa-243d-41c3-8b50-51fa8cfa5796] received 2024-07-04T02:51:00.947446280Z [2024-07-04 02:51:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e976d592-ddc6-4406-8571-07ec4730f476] received 2024-07-04T02:51:00.952438966Z [2024-07-04 02:51:00,952: INFO/ForkPoolWorker-15] [f59cbdfa-243d-41c3-8b50-51fa8cfa5796] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:51:00.960465197Z [2024-07-04 02:51:00,960: INFO/ForkPoolWorker-16] [e976d592-ddc6-4406-8571-07ec4730f476] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:51:01.247910024Z [2024-07-04 02:51:01,244: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:51:01.291992207Z [2024-07-04 02:51:01,288: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:51:02.373803165Z [2024-07-04 02:51:02,373: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:51:02.376956074Z [2024-07-04 02:51:02,376: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:51:02.468416727Z [2024-07-04 02:51:02,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:51:02.468468486Z [2024-07-04 02:51:02,452: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:51:02.468475804Z [2024-07-04 02:51:02,453: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:51:02.468482677Z [2024-07-04 02:51:02,453: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:51:02.468489799Z [2024-07-04 02:51:02,453: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:51:02.468494337Z [2024-07-04 02:51:02,453: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:51:02.468498862Z [2024-07-04 02:51:02,453: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:51:02.524704605Z [2024-07-04 02:51:02,524: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:51:02.528045831Z [2024-07-04 02:51:02,527: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:51:02.569092388Z [2024-07-04 02:51:02,568: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:51:02.570441848Z [2024-07-04 02:51:02,570: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:51:02.570653034Z [2024-07-04 02:51:02,570: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:51:02.570832338Z [2024-07-04 02:51:02,570: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:51:02.571089314Z [2024-07-04 02:51:02,570: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:51:02.571550915Z [2024-07-04 02:51:02,571: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:51:02.572294931Z [2024-07-04 02:51:02,572: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:51:02.588675124Z [2024-07-04 02:51:02,588: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:51:02.670691204Z [2024-07-04 02:51:02,670: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:51:04.158108420Z [2024-07-04 02:51:04,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f59cbdfa-243d-41c3-8b50-51fa8cfa5796] succeeded in 3.21817498099972s: None 2024-07-04T02:51:04.466412716Z [2024-07-04 02:51:04,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e976d592-ddc6-4406-8571-07ec4730f476] succeeded in 3.5163805319998573s: None 2024-07-04T02:52:00.245064201Z [2024-07-04 02:52:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[418841cd-292d-4583-9c83-f7685161a952] received 2024-07-04T02:52:00.263460075Z [2024-07-04 02:52:00,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66833f33-b7b1-495b-a6f5-a8464832c37d] received 2024-07-04T02:52:00.265906606Z [2024-07-04 02:52:00,263: INFO/ForkPoolWorker-15] [418841cd-292d-4583-9c83-f7685161a952] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:52:00.272901942Z [2024-07-04 02:52:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ec4ecaf-c49b-4320-91dc-38983388f105] received 2024-07-04T02:52:00.286775710Z [2024-07-04 02:52:00,286: INFO/ForkPoolWorker-1] [8ec4ecaf-c49b-4320-91dc-38983388f105] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:52:00.296365555Z [2024-07-04 02:52:00,296: INFO/ForkPoolWorker-16] [66833f33-b7b1-495b-a6f5-a8464832c37d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:52:00.817052758Z [2024-07-04 02:52:00,813: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:52:01.213638706Z [2024-07-04 02:52:01,208: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:52:01.347878169Z [2024-07-04 02:52:01,342: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:52:01.820711066Z [2024-07-04 02:52:01,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:52:02.811273992Z [2024-07-04 02:52:02,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[418841cd-292d-4583-9c83-f7685161a952] succeeded in 2.5630876549994355s: None 2024-07-04T02:52:03.050473979Z [2024-07-04 02:52:03,049: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:52:03.053448860Z [2024-07-04 02:52:03,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:52:03.075167503Z [2024-07-04 02:52:03,074: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:52:03.077343542Z [2024-07-04 02:52:03,077: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:52:03.077477634Z [2024-07-04 02:52:03,077: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:52:03.077671842Z [2024-07-04 02:52:03,077: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:52:03.077755989Z [2024-07-04 02:52:03,077: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:52:03.078483328Z [2024-07-04 02:52:03,078: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:52:03.078575922Z [2024-07-04 02:52:03,078: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:52:03.081483765Z [2024-07-04 02:52:03,081: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:52:03.085078752Z [2024-07-04 02:52:03,084: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:52:03.117472637Z [2024-07-04 02:52:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:52:03.118962067Z [2024-07-04 02:52:03,118: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:52:03.118980163Z [2024-07-04 02:52:03,118: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:52:03.119201187Z [2024-07-04 02:52:03,118: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:52:03.119360911Z [2024-07-04 02:52:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:52:03.119732485Z [2024-07-04 02:52:03,119: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:52:03.119744506Z [2024-07-04 02:52:03,119: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:52:03.159205511Z [2024-07-04 02:52:03,158: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:52:03.214155695Z [2024-07-04 02:52:03,213: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:52:04.812237712Z [2024-07-04 02:52:04,811: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ec4ecaf-c49b-4320-91dc-38983388f105] succeeded in 4.536530428999868s: None 2024-07-04T02:52:05.222238585Z [2024-07-04 02:52:05,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[66833f33-b7b1-495b-a6f5-a8464832c37d] succeeded in 4.95708256799935s: None 2024-07-04T02:53:00.319157096Z [2024-07-04 02:53:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a84a3e15-c4e7-4776-8b1e-0c1074524cbf] received 2024-07-04T02:53:00.334258199Z [2024-07-04 02:53:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa04fffb-07fb-45b6-bf7c-f9832e1a175b] received 2024-07-04T02:53:00.357889343Z [2024-07-04 02:53:00,357: INFO/ForkPoolWorker-15] [a84a3e15-c4e7-4776-8b1e-0c1074524cbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:53:00.366763142Z [2024-07-04 02:53:00,366: INFO/ForkPoolWorker-16] [aa04fffb-07fb-45b6-bf7c-f9832e1a175b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:53:00.672851200Z [2024-07-04 02:53:00,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:53:00.713879262Z [2024-07-04 02:53:00,709: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:53:02.035433560Z [2024-07-04 02:53:02,035: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:53:02.038241743Z [2024-07-04 02:53:02,037: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:53:02.038734840Z [2024-07-04 02:53:02,038: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:53:02.041447574Z [2024-07-04 02:53:02,041: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:53:02.072360687Z [2024-07-04 02:53:02,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:53:02.073430317Z [2024-07-04 02:53:02,073: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:53:02.073827229Z [2024-07-04 02:53:02,073: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:53:02.074025433Z [2024-07-04 02:53:02,073: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:53:02.074148277Z [2024-07-04 02:53:02,073: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:53:02.074435781Z [2024-07-04 02:53:02,074: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:53:02.074543119Z [2024-07-04 02:53:02,074: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:53:02.075392226Z [2024-07-04 02:53:02,075: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:53:02.076703322Z [2024-07-04 02:53:02,076: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:53:02.076829591Z [2024-07-04 02:53:02,076: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:53:02.077020276Z [2024-07-04 02:53:02,076: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:53:02.077129311Z [2024-07-04 02:53:02,076: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:53:02.077821975Z [2024-07-04 02:53:02,077: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:53:02.077917614Z [2024-07-04 02:53:02,077: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:53:02.159171396Z [2024-07-04 02:53:02,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:53:02.172778287Z [2024-07-04 02:53:02,172: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:53:03.737490005Z [2024-07-04 02:53:03,736: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa04fffb-07fb-45b6-bf7c-f9832e1a175b] succeeded in 3.3969676930000787s: None 2024-07-04T02:53:04.219520758Z [2024-07-04 02:53:04,219: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a84a3e15-c4e7-4776-8b1e-0c1074524cbf] succeeded in 3.8943354599996383s: None 2024-07-04T02:54:00.471990731Z [2024-07-04 02:54:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a186e1a0-fa38-4af3-b615-a297d76921c3] received 2024-07-04T02:54:00.485469137Z [2024-07-04 02:54:00,485: INFO/ForkPoolWorker-15] [a186e1a0-fa38-4af3-b615-a297d76921c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:54:00.539868898Z [2024-07-04 02:54:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed097b54-0c93-4df5-8133-99bcb452f040] received 2024-07-04T02:54:00.551741351Z [2024-07-04 02:54:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e40058d5-387c-4999-a7ec-9bcae4fa6a33] received 2024-07-04T02:54:00.554411198Z [2024-07-04 02:54:00,554: INFO/ForkPoolWorker-16] [ed097b54-0c93-4df5-8133-99bcb452f040] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:54:00.580299011Z [2024-07-04 02:54:00,579: INFO/ForkPoolWorker-1] [e40058d5-387c-4999-a7ec-9bcae4fa6a33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:54:01.120398658Z [2024-07-04 02:54:01,111: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:54:01.148482546Z [2024-07-04 02:54:01,144: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:54:01.309351625Z [2024-07-04 02:54:01,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:54:01.765985444Z [2024-07-04 02:54:01,765: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:54:02.423207681Z [2024-07-04 02:54:02,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed097b54-0c93-4df5-8133-99bcb452f040] succeeded in 1.8795173660000728s: None 2024-07-04T02:54:02.687957241Z [2024-07-04 02:54:02,687: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:54:02.691226771Z [2024-07-04 02:54:02,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:54:02.724623973Z [2024-07-04 02:54:02,724: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:54:02.727889991Z [2024-07-04 02:54:02,727: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:54:02.728025401Z [2024-07-04 02:54:02,727: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:54:02.728197948Z [2024-07-04 02:54:02,728: INFO/ForkPoolWorker-1] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:54:02.728520228Z [2024-07-04 02:54:02,728: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:54:02.728698094Z [2024-07-04 02:54:02,728: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:54:02.729113169Z [2024-07-04 02:54:02,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:54:02.729347784Z [2024-07-04 02:54:02,729: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:54:02.735400667Z [2024-07-04 02:54:02,735: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:54:02.771716032Z [2024-07-04 02:54:02,771: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:54:02.776669029Z [2024-07-04 02:54:02,776: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:54:02.804045434Z [2024-07-04 02:54:02,803: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:54:02.806325595Z [2024-07-04 02:54:02,805: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:54:02.806493017Z [2024-07-04 02:54:02,806: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:54:02.806577358Z [2024-07-04 02:54:02,806: INFO/ForkPoolWorker-15] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:54:02.806846178Z [2024-07-04 02:54:02,806: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:54:02.807044945Z [2024-07-04 02:54:02,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:54:02.807455270Z [2024-07-04 02:54:02,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:54:02.807675911Z [2024-07-04 02:54:02,807: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:54:02.811802584Z [2024-07-04 02:54:02,811: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:54:02.817139201Z [2024-07-04 02:54:02,816: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:54:02.900885511Z [2024-07-04 02:54:02,900: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:54:04.681610545Z [2024-07-04 02:54:04,680: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a186e1a0-fa38-4af3-b615-a297d76921c3] succeeded in 4.206580387000031s: None 2024-07-04T02:54:04.877049096Z [2024-07-04 02:54:04,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e40058d5-387c-4999-a7ec-9bcae4fa6a33] succeeded in 4.312226372999248s: None 2024-07-04T02:55:00.334672948Z [2024-07-04 02:55:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[133956d3-a745-4178-a529-7c9058a88b8b] received 2024-07-04T02:55:00.353817704Z [2024-07-04 02:55:00,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d367f50-2870-4e60-84c3-94f77fdf0caf] received 2024-07-04T02:55:00.357235950Z [2024-07-04 02:55:00,356: INFO/ForkPoolWorker-15] [133956d3-a745-4178-a529-7c9058a88b8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:55:00.380620490Z [2024-07-04 02:55:00,380: INFO/ForkPoolWorker-16] [1d367f50-2870-4e60-84c3-94f77fdf0caf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:00.394105935Z [2024-07-04 02:55:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb3d9063-e2b3-43b0-b26b-176c6f1d90d0] received 2024-07-04T02:55:00.427597441Z [2024-07-04 02:55:00,427: INFO/ForkPoolWorker-1] [bb3d9063-e2b3-43b0-b26b-176c6f1d90d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:55:00.905418531Z [2024-07-04 02:55:00,901: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:55:00.954694898Z [2024-07-04 02:55:00,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:55:01.002078716Z [2024-07-04 02:55:00,997: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:55:02.487852689Z [2024-07-04 02:55:02,487: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:55:02.491391266Z [2024-07-04 02:55:02,490: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:02.529066903Z [2024-07-04 02:55:02,528: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:55:02.530797257Z [2024-07-04 02:55:02,530: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:02.532649233Z [2024-07-04 02:55:02,532: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:02.533158304Z [2024-07-04 02:55:02,533: INFO/ForkPoolWorker-16] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:02.533846564Z [2024-07-04 02:55:02,533: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:02.534142074Z [2024-07-04 02:55:02,534: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:55:02.534702541Z [2024-07-04 02:55:02,534: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:02.535367520Z [2024-07-04 02:55:02,535: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:02.541421111Z [2024-07-04 02:55:02,541: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:02.675232075Z [2024-07-04 02:55:02,672: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:02.831615872Z [2024-07-04 02:55:02,831: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:55:02.834768758Z [2024-07-04 02:55:02,834: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:02.854662848Z [2024-07-04 02:55:02,854: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:55:02.855647404Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:02.855667334Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:02.855720849Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:02.855852917Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:02.855865211Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:55:02.856083637Z [2024-07-04 02:55:02,855: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:55:02.856716519Z [2024-07-04 02:55:02,856: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:02.861715777Z [2024-07-04 02:55:02,861: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:55:02.932591669Z [2024-07-04 02:55:02,932: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:03.254097531Z [2024-07-04 02:55:03,253: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:55:03.257554012Z [2024-07-04 02:55:03,257: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:03.298088324Z [2024-07-04 02:55:03,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:55:03.299771707Z [2024-07-04 02:55:03,299: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:03.299795555Z [2024-07-04 02:55:03,299: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:03.300582837Z [2024-07-04 02:55:03,300: INFO/ForkPoolWorker-15] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:03.300904717Z [2024-07-04 02:55:03,300: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:03.301102826Z [2024-07-04 02:55:03,300: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:55:03.302479478Z [2024-07-04 02:55:03,301: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:55:03.302767759Z [2024-07-04 02:55:03,302: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:03.304812657Z [2024-07-04 02:55:03,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14dc8b78-a776-4b7d-a886-d5337665d5b6] received 2024-07-04T02:55:03.311143831Z [2024-07-04 02:55:03,310: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:55:03.328587532Z [2024-07-04 02:55:03,328: INFO/ForkPoolWorker-2] [14dc8b78-a776-4b7d-a886-d5337665d5b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:03.381824141Z [2024-07-04 02:55:03,381: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d367f50-2870-4e60-84c3-94f77fdf0caf] succeeded in 3.023567322999952s: None 2024-07-04T02:55:03.413710903Z [2024-07-04 02:55:03,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:03.649240855Z [2024-07-04 02:55:03,641: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:55:04.437765376Z [2024-07-04 02:55:04,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb3d9063-e2b3-43b0-b26b-176c6f1d90d0] succeeded in 4.03726101600023s: None 2024-07-04T02:55:04.880743928Z [2024-07-04 02:55:04,880: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T02:55:04.884199135Z [2024-07-04 02:55:04,883: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:04.913877451Z [2024-07-04 02:55:04,913: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T02:55:04.917515226Z [2024-07-04 02:55:04,917: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:04.919023100Z [2024-07-04 02:55:04,918: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:04.919163543Z [2024-07-04 02:55:04,918: INFO/ForkPoolWorker-2] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:04.919924511Z [2024-07-04 02:55:04,919: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:04.920013603Z [2024-07-04 02:55:04,919: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T02:55:04.920527322Z [2024-07-04 02:55:04,920: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:04.920803482Z [2024-07-04 02:55:04,920: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:04.930565125Z [2024-07-04 02:55:04,930: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:05.013813552Z [2024-07-04 02:55:05,013: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:05.387706785Z [2024-07-04 02:55:05,387: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[133956d3-a745-4178-a529-7c9058a88b8b] succeeded in 5.049073465999754s: None 2024-07-04T02:55:05.737242900Z [2024-07-04 02:55:05,736: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[14dc8b78-a776-4b7d-a886-d5337665d5b6] succeeded in 2.4295158679997257s: None 2024-07-04T02:55:05.766382665Z [2024-07-04 02:55:05,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38d0c1ab-143e-4d38-827e-ef822187259d] received 2024-07-04T02:55:05.777102307Z [2024-07-04 02:55:05,776: INFO/ForkPoolWorker-15] [38d0c1ab-143e-4d38-827e-ef822187259d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T02:55:06.173388748Z [2024-07-04 02:55:06,168: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:55:07.417307984Z [2024-07-04 02:55:07,416: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:55:07.420802386Z [2024-07-04 02:55:07,420: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:07.453743179Z [2024-07-04 02:55:07,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:55:07.456282521Z [2024-07-04 02:55:07,455: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:07.456778100Z [2024-07-04 02:55:07,456: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:07.456972430Z [2024-07-04 02:55:07,456: INFO/ForkPoolWorker-15] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:07.457188551Z [2024-07-04 02:55:07,456: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:07.457268686Z [2024-07-04 02:55:07,457: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:55:07.457667808Z [2024-07-04 02:55:07,457: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:07.458338170Z [2024-07-04 02:55:07,458: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:07.465496800Z [2024-07-04 02:55:07,465: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:07.596354170Z [2024-07-04 02:55:07,595: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:08.354389052Z [2024-07-04 02:55:08,353: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38d0c1ab-143e-4d38-827e-ef822187259d] succeeded in 2.5832879170002343s: None 2024-07-04T02:55:09.156910040Z [2024-07-04 02:55:09,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24c5a01a-6d57-4ce2-b94c-50e781cb8c5c] received 2024-07-04T02:55:09.164873274Z [2024-07-04 02:55:09,164: INFO/ForkPoolWorker-15] [24c5a01a-6d57-4ce2-b94c-50e781cb8c5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T02:55:09.493376587Z [2024-07-04 02:55:09,489: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T02:55:10.612321613Z [2024-07-04 02:55:10,611: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:55:10.615375509Z [2024-07-04 02:55:10,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:55:10.652486654Z [2024-07-04 02:55:10,652: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:55:10.654059463Z [2024-07-04 02:55:10,653: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:55:10.654153940Z [2024-07-04 02:55:10,653: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:55:10.654317464Z [2024-07-04 02:55:10,654: INFO/ForkPoolWorker-15] Read VIM 26ca0118-2956-4022-8cd0-e6ff4536e791 (k8s07_dummy) 2024-07-04T02:55:10.654484228Z [2024-07-04 02:55:10,654: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '26ca0118-2956-4022-8cd0-e6ff4536e791', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-07-04T02:55:10.654580922Z [2024-07-04 02:55:10,654: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:55:10.654945374Z [2024-07-04 02:55:10,654: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:10.654996426Z [2024-07-04 02:55:10,654: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:55:10.663310092Z [2024-07-04 02:55:10,662: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T02:55:10.757389984Z [2024-07-04 02:55:10,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:55:11.417660462Z [2024-07-04 02:55:11,417: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[24c5a01a-6d57-4ce2-b94c-50e781cb8c5c] succeeded in 2.2574007399998663s: None 2024-07-04T02:56:01.072231656Z [2024-07-04 02:56:01,071: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[192afd1e-d44a-4cde-bb7c-ff1511ef2b58] received 2024-07-04T02:56:01.091783884Z [2024-07-04 02:56:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cef2c9b5-3497-4703-9fb6-faf0b59f0be6] received 2024-07-04T02:56:01.093752901Z [2024-07-04 02:56:01,091: INFO/ForkPoolWorker-15] [192afd1e-d44a-4cde-bb7c-ff1511ef2b58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:56:01.132637602Z [2024-07-04 02:56:01,132: INFO/ForkPoolWorker-16] [cef2c9b5-3497-4703-9fb6-faf0b59f0be6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:56:01.134617406Z [2024-07-04 02:56:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c100b8b0-2e8d-4683-96f5-665e437a243b] received 2024-07-04T02:56:01.169778181Z [2024-07-04 02:56:01,169: INFO/ForkPoolWorker-1] [c100b8b0-2e8d-4683-96f5-665e437a243b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:56:01.425215067Z [2024-07-04 02:56:01,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:56:01.485919504Z [2024-07-04 02:56:01,482: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:56:01.667897212Z [2024-07-04 02:56:01,655: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:56:02.008008500Z [2024-07-04 02:56:02,007: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:56:02.630189167Z [2024-07-04 02:56:02,629: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cef2c9b5-3497-4703-9fb6-faf0b59f0be6] succeeded in 1.5294179250004163s: None 2024-07-04T02:56:02.828747711Z [2024-07-04 02:56:02,828: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:56:02.833958834Z [2024-07-04 02:56:02,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:56:02.836333702Z [2024-07-04 02:56:02,836: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:56:02.839611988Z [2024-07-04 02:56:02,839: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:56:02.871469053Z [2024-07-04 02:56:02,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:56:02.875869454Z [2024-07-04 02:56:02,875: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:56:02.875888628Z [2024-07-04 02:56:02,875: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:56:02.876002877Z [2024-07-04 02:56:02,875: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:56:02.876027146Z [2024-07-04 02:56:02,875: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:56:02.876244581Z [2024-07-04 02:56:02,876: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:56:02.876291050Z [2024-07-04 02:56:02,876: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:56:02.880752956Z [2024-07-04 02:56:02,880: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:56:02.881999953Z [2024-07-04 02:56:02,881: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:56:02.882128758Z [2024-07-04 02:56:02,882: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:56:02.882312482Z [2024-07-04 02:56:02,882: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:56:02.882395697Z [2024-07-04 02:56:02,882: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:56:02.882673465Z [2024-07-04 02:56:02,882: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:56:02.882811057Z [2024-07-04 02:56:02,882: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:56:02.957857888Z [2024-07-04 02:56:02,957: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:56:02.970430430Z [2024-07-04 02:56:02,970: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:56:04.669316211Z [2024-07-04 02:56:04,668: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c100b8b0-2e8d-4683-96f5-665e437a243b] succeeded in 3.5241004520003116s: None 2024-07-04T02:56:05.020245909Z [2024-07-04 02:56:05,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[192afd1e-d44a-4cde-bb7c-ff1511ef2b58] succeeded in 3.944511727000645s: None 2024-07-04T02:57:00.813528277Z [2024-07-04 02:57:00,812: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c56b3e5-b170-4248-9951-61a0edf193f8] received 2024-07-04T02:57:00.833694796Z [2024-07-04 02:57:00,833: INFO/ForkPoolWorker-15] [8c56b3e5-b170-4248-9951-61a0edf193f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:57:00.843282277Z [2024-07-04 02:57:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8907cb1-3110-44d0-99f7-cf0beb2e4130] received 2024-07-04T02:57:00.864986380Z [2024-07-04 02:57:00,864: INFO/ForkPoolWorker-16] [d8907cb1-3110-44d0-99f7-cf0beb2e4130] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:57:01.162686380Z [2024-07-04 02:57:01,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:57:01.173712609Z [2024-07-04 02:57:01,170: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:57:02.291930431Z [2024-07-04 02:57:02,291: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:57:02.295170516Z [2024-07-04 02:57:02,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:57:02.299351546Z [2024-07-04 02:57:02,299: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:57:02.302586944Z [2024-07-04 02:57:02,302: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:57:02.321431756Z [2024-07-04 02:57:02,321: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:57:02.323045402Z [2024-07-04 02:57:02,322: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:57:02.323084246Z [2024-07-04 02:57:02,322: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:57:02.323210520Z [2024-07-04 02:57:02,323: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:57:02.323242927Z [2024-07-04 02:57:02,323: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:57:02.323445940Z [2024-07-04 02:57:02,323: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:57:02.323626102Z [2024-07-04 02:57:02,323: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:57:02.333851442Z [2024-07-04 02:57:02,333: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:57:02.334805871Z [2024-07-04 02:57:02,334: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:57:02.335105455Z [2024-07-04 02:57:02,334: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:57:02.335533104Z [2024-07-04 02:57:02,335: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:57:02.335751783Z [2024-07-04 02:57:02,335: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:57:02.336008923Z [2024-07-04 02:57:02,335: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:57:02.336069220Z [2024-07-04 02:57:02,335: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:57:02.412775026Z [2024-07-04 02:57:02,412: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:57:02.414974628Z [2024-07-04 02:57:02,414: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:57:03.952738474Z [2024-07-04 02:57:03,952: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8c56b3e5-b170-4248-9951-61a0edf193f8] succeeded in 3.133534779999536s: None 2024-07-04T02:57:04.354066583Z [2024-07-04 02:57:04,353: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8907cb1-3110-44d0-99f7-cf0beb2e4130] succeeded in 3.5018919020003523s: None 2024-07-04T02:58:00.737128709Z [2024-07-04 02:58:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e845f038-2f7e-441c-9db2-a57533f612c2] received 2024-07-04T02:58:00.747648213Z [2024-07-04 02:58:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13798795-2109-428b-b807-89527378b81a] received 2024-07-04T02:58:00.752989984Z [2024-07-04 02:58:00,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24d61027-6dba-4572-9d0d-529920ec83c5] received 2024-07-04T02:58:00.753707733Z [2024-07-04 02:58:00,753: INFO/ForkPoolWorker-15] [e845f038-2f7e-441c-9db2-a57533f612c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T02:58:00.792628595Z [2024-07-04 02:58:00,792: INFO/ForkPoolWorker-16] [13798795-2109-428b-b807-89527378b81a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:58:00.798437677Z [2024-07-04 02:58:00,797: INFO/ForkPoolWorker-1] [24d61027-6dba-4572-9d0d-529920ec83c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:58:01.255113978Z [2024-07-04 02:58:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:58:01.558470470Z [2024-07-04 02:58:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:58:01.570008823Z [2024-07-04 02:58:01,565: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T02:58:01.897056447Z [2024-07-04 02:58:01,883: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:58:02.760257724Z [2024-07-04 02:58:02,759: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e845f038-2f7e-441c-9db2-a57533f612c2] succeeded in 2.018447830999321s: None 2024-07-04T02:58:02.845388332Z [2024-07-04 02:58:02,844: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:58:02.849375843Z [2024-07-04 02:58:02,848: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:58:02.889704555Z [2024-07-04 02:58:02,889: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:58:02.896987147Z [2024-07-04 02:58:02,896: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:58:02.897111567Z [2024-07-04 02:58:02,896: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:58:02.897289345Z [2024-07-04 02:58:02,897: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:58:02.897367132Z [2024-07-04 02:58:02,897: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:58:02.897652948Z [2024-07-04 02:58:02,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:58:02.897728722Z [2024-07-04 02:58:02,897: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:58:03.005578551Z [2024-07-04 02:58:03,005: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:58:03.216355797Z [2024-07-04 02:58:03,215: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T02:58:03.220426829Z [2024-07-04 02:58:03,219: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:58:03.249357513Z [2024-07-04 02:58:03,249: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T02:58:03.251250714Z [2024-07-04 02:58:03,250: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:58:03.251487783Z [2024-07-04 02:58:03,251: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:58:03.251973482Z [2024-07-04 02:58:03,251: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:58:03.252075684Z [2024-07-04 02:58:03,251: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T02:58:03.254338329Z [2024-07-04 02:58:03,252: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:58:03.254489331Z [2024-07-04 02:58:03,254: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:58:03.355296230Z [2024-07-04 02:58:03,354: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:58:04.881192525Z [2024-07-04 02:58:04,880: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13798795-2109-428b-b807-89527378b81a] succeeded in 4.13106997199975s: None 2024-07-04T02:58:05.578530922Z [2024-07-04 02:58:05,577: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[24d61027-6dba-4572-9d0d-529920ec83c5] succeeded in 4.816616926999814s: None 2024-07-04T02:59:00.578688701Z [2024-07-04 02:59:00,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a10fd38-8e85-49a8-9efc-aa8708e36406] received 2024-07-04T02:59:00.580901033Z [2024-07-04 02:59:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d80d0e7b-ad93-49bb-9092-965974c8265a] received 2024-07-04T02:59:00.592189134Z [2024-07-04 02:59:00,591: INFO/ForkPoolWorker-15] [6a10fd38-8e85-49a8-9efc-aa8708e36406] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T02:59:00.603186250Z [2024-07-04 02:59:00,602: INFO/ForkPoolWorker-16] [d80d0e7b-ad93-49bb-9092-965974c8265a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T02:59:00.925541335Z [2024-07-04 02:59:00,921: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T02:59:01.080470731Z [2024-07-04 02:59:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T02:59:02.257267872Z [2024-07-04 02:59:02,256: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T02:59:02.260661646Z [2024-07-04 02:59:02,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:59:02.292826467Z [2024-07-04 02:59:02,292: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T02:59:02.294556929Z [2024-07-04 02:59:02,294: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:59:02.294700271Z [2024-07-04 02:59:02,294: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:59:02.294967330Z [2024-07-04 02:59:02,294: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:59:02.295105693Z [2024-07-04 02:59:02,294: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T02:59:02.295822520Z [2024-07-04 02:59:02,295: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T02:59:02.296025398Z [2024-07-04 02:59:02,295: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:59:02.298284213Z [2024-07-04 02:59:02,297: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T02:59:02.302129835Z [2024-07-04 02:59:02,301: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T02:59:02.330542998Z [2024-07-04 02:59:02,329: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T02:59:02.331748780Z [2024-07-04 02:59:02,331: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T02:59:02.331779252Z [2024-07-04 02:59:02,331: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T02:59:02.331993898Z [2024-07-04 02:59:02,331: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T02:59:02.332018322Z [2024-07-04 02:59:02,331: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T02:59:02.332771524Z [2024-07-04 02:59:02,332: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T02:59:02.332814626Z [2024-07-04 02:59:02,332: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T02:59:02.400713216Z [2024-07-04 02:59:02,400: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:59:02.424684659Z [2024-07-04 02:59:02,424: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T02:59:04.247180004Z [2024-07-04 02:59:04,246: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a10fd38-8e85-49a8-9efc-aa8708e36406] succeeded in 3.6643148590001147s: None 2024-07-04T02:59:04.687091674Z [2024-07-04 02:59:04,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d80d0e7b-ad93-49bb-9092-965974c8265a] succeeded in 4.102136073999645s: None 2024-07-04T03:00:00.512113697Z [2024-07-04 03:00:00,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c39002bc-6f14-40fe-8675-0f673152a079] received 2024-07-04T03:00:00.523557889Z [2024-07-04 03:00:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d4edb24a-860e-4bdd-9001-3d4f3c3dda50] received 2024-07-04T03:00:00.542526215Z [2024-07-04 03:00:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd8384d-5aff-4a9a-a36f-cc79c62e7dba] received 2024-07-04T03:00:00.546052062Z [2024-07-04 03:00:00,545: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a369c16d-1b74-43f5-a41e-5e68c04092f4] received 2024-07-04T03:00:00.548675254Z [2024-07-04 03:00:00,548: INFO/ForkPoolWorker-16] [d4edb24a-860e-4bdd-9001-3d4f3c3dda50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:00:00.551908720Z [2024-07-04 03:00:00,551: INFO/ForkPoolWorker-15] [c39002bc-6f14-40fe-8675-0f673152a079] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:00:00.636838796Z [2024-07-04 03:00:00,636: INFO/ForkPoolWorker-2] [a369c16d-1b74-43f5-a41e-5e68c04092f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:00:00.651939180Z [2024-07-04 03:00:00,651: INFO/ForkPoolWorker-1] [cfd8384d-5aff-4a9a-a36f-cc79c62e7dba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:01.057763204Z [2024-07-04 03:00:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:00:01.237611525Z [2024-07-04 03:00:01,218: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:00:01.289406404Z [2024-07-04 03:00:01,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:00:01.414762569Z [2024-07-04 03:00:01,405: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:00:01.749928754Z [2024-07-04 03:00:01,749: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:02.544751198Z [2024-07-04 03:00:02,544: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a369c16d-1b74-43f5-a41e-5e68c04092f4] succeeded in 1.993995871000152s: None 2024-07-04T03:00:02.693263597Z [2024-07-04 03:00:02,692: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:00:02.696456779Z [2024-07-04 03:00:02,696: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:02.723120809Z [2024-07-04 03:00:02,722: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:00:02.727902619Z [2024-07-04 03:00:02,727: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:02.727970193Z [2024-07-04 03:00:02,727: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:02.728165173Z [2024-07-04 03:00:02,727: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:02.728224456Z [2024-07-04 03:00:02,728: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:00:02.729107521Z [2024-07-04 03:00:02,728: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:00:02.729294639Z [2024-07-04 03:00:02,729: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:02.804095442Z [2024-07-04 03:00:02,803: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:02.838566819Z [2024-07-04 03:00:02,838: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:00:02.841770885Z [2024-07-04 03:00:02,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:02.880101368Z [2024-07-04 03:00:02,879: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:00:02.883054898Z [2024-07-04 03:00:02,882: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:00:02.883600542Z [2024-07-04 03:00:02,883: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:02.885632766Z [2024-07-04 03:00:02,885: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:02.885860910Z [2024-07-04 03:00:02,885: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:02.886078103Z [2024-07-04 03:00:02,885: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:02.887128729Z [2024-07-04 03:00:02,886: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:00:02.887861804Z [2024-07-04 03:00:02,887: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:00:02.888064829Z [2024-07-04 03:00:02,887: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:02.915356796Z [2024-07-04 03:00:02,915: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:00:02.918042136Z [2024-07-04 03:00:02,917: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:02.918135090Z [2024-07-04 03:00:02,917: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:02.918317820Z [2024-07-04 03:00:02,918: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:02.918417707Z [2024-07-04 03:00:02,918: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:00:02.918671470Z [2024-07-04 03:00:02,918: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:00:02.918736342Z [2024-07-04 03:00:02,918: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:02.984305659Z [2024-07-04 03:00:02,984: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:02.999458283Z [2024-07-04 03:00:02,999: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:03.430632031Z [2024-07-04 03:00:03,430: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cfd8384d-5aff-4a9a-a36f-cc79c62e7dba] succeeded in 2.8623616249997212s: None 2024-07-04T03:00:03.522828631Z [2024-07-04 03:00:03,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abf0a9c7-c0bb-4210-a024-1db0ab9ff04c] received 2024-07-04T03:00:03.539746450Z [2024-07-04 03:00:03,539: INFO/ForkPoolWorker-1] [abf0a9c7-c0bb-4210-a024-1db0ab9ff04c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:03.849199205Z [2024-07-04 03:00:03,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:00:04.613834640Z [2024-07-04 03:00:04,613: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d4edb24a-860e-4bdd-9001-3d4f3c3dda50] succeeded in 4.087413419000768s: None 2024-07-04T03:00:04.895913447Z [2024-07-04 03:00:04,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c39002bc-6f14-40fe-8675-0f673152a079] succeeded in 4.37728905899985s: None 2024-07-04T03:00:05.077277182Z [2024-07-04 03:00:05,076: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:00:05.080654224Z [2024-07-04 03:00:05,080: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:05.117102047Z [2024-07-04 03:00:05,116: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:00:05.118448614Z [2024-07-04 03:00:05,118: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:05.118470786Z [2024-07-04 03:00:05,118: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:05.118818560Z [2024-07-04 03:00:05,118: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:05.118966660Z [2024-07-04 03:00:05,118: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:00:05.119271493Z [2024-07-04 03:00:05,119: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:00:05.119284175Z [2024-07-04 03:00:05,119: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:05.222541040Z [2024-07-04 03:00:05,222: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:05.944352188Z [2024-07-04 03:00:05,943: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[abf0a9c7-c0bb-4210-a024-1db0ab9ff04c] succeeded in 2.4103818579997096s: None 2024-07-04T03:00:05.997648126Z [2024-07-04 03:00:05,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de71bedc-ba8e-464c-91fe-37e25ad48546] received 2024-07-04T03:00:06.011547239Z [2024-07-04 03:00:06,011: INFO/ForkPoolWorker-15] [de71bedc-ba8e-464c-91fe-37e25ad48546] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:00:06.285443550Z [2024-07-04 03:00:06,282: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:00:07.396252366Z [2024-07-04 03:00:07,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:00:07.399642332Z [2024-07-04 03:00:07,399: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:07.433975909Z [2024-07-04 03:00:07,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:00:07.436106148Z [2024-07-04 03:00:07,435: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:07.436314327Z [2024-07-04 03:00:07,436: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:07.436548921Z [2024-07-04 03:00:07,436: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:07.436703634Z [2024-07-04 03:00:07,436: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:00:07.437118985Z [2024-07-04 03:00:07,436: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:00:07.437525493Z [2024-07-04 03:00:07,437: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:07.543823566Z [2024-07-04 03:00:07,543: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:08.225742306Z [2024-07-04 03:00:08,225: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de71bedc-ba8e-464c-91fe-37e25ad48546] succeeded in 2.2260333270005503s: None 2024-07-04T03:00:09.011637527Z [2024-07-04 03:00:09,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b12001cf-4fce-477a-8d9c-aeacc5d5bd9a] received 2024-07-04T03:00:09.025535630Z [2024-07-04 03:00:09,025: INFO/ForkPoolWorker-15] [b12001cf-4fce-477a-8d9c-aeacc5d5bd9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:00:09.309647865Z [2024-07-04 03:00:09,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:00:10.573459462Z [2024-07-04 03:00:10,572: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:00:10.576891784Z [2024-07-04 03:00:10,576: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:00:10.607837614Z [2024-07-04 03:00:10,607: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:00:10.609398351Z [2024-07-04 03:00:10,609: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:00:10.609476694Z [2024-07-04 03:00:10,609: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:00:10.609732014Z [2024-07-04 03:00:10,609: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:00:10.609875170Z [2024-07-04 03:00:10,609: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:00:10.610500866Z [2024-07-04 03:00:10,610: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:00:10.610596534Z [2024-07-04 03:00:10,610: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:00:10.685800517Z [2024-07-04 03:00:10,685: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:00:11.312312061Z [2024-07-04 03:00:11,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b12001cf-4fce-477a-8d9c-aeacc5d5bd9a] succeeded in 2.2988442289997693s: None 2024-07-04T03:01:00.651508979Z [2024-07-04 03:01:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75c7a32d-b791-4ee2-8865-f018dfbf4e45] received 2024-07-04T03:01:00.653517943Z [2024-07-04 03:01:00,653: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13df7bcf-5622-4325-85ee-c42d2ccf6710] received 2024-07-04T03:01:00.663515280Z [2024-07-04 03:01:00,663: INFO/ForkPoolWorker-15] [75c7a32d-b791-4ee2-8865-f018dfbf4e45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:01:00.665288610Z [2024-07-04 03:01:00,664: INFO/ForkPoolWorker-16] [13df7bcf-5622-4325-85ee-c42d2ccf6710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:01:01.008089271Z [2024-07-04 03:01:01,004: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:01:01.090137070Z [2024-07-04 03:01:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:01:02.331416918Z [2024-07-04 03:01:02,331: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:01:02.334979531Z [2024-07-04 03:01:02,334: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:01:02.366420738Z [2024-07-04 03:01:02,366: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:01:02.367870925Z [2024-07-04 03:01:02,367: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:01:02.368003537Z [2024-07-04 03:01:02,367: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:01:02.368189572Z [2024-07-04 03:01:02,368: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:01:02.368314448Z [2024-07-04 03:01:02,368: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:01:02.368609816Z [2024-07-04 03:01:02,368: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:01:02.369161488Z [2024-07-04 03:01:02,368: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:01:02.461468753Z [2024-07-04 03:01:02,461: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:01:02.537567413Z [2024-07-04 03:01:02,537: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:01:02.540848180Z [2024-07-04 03:01:02,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:01:02.573779768Z [2024-07-04 03:01:02,573: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:01:02.575821060Z [2024-07-04 03:01:02,575: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:01:02.575999136Z [2024-07-04 03:01:02,575: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:01:02.576270280Z [2024-07-04 03:01:02,576: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:01:02.576844752Z [2024-07-04 03:01:02,576: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:01:02.577322689Z [2024-07-04 03:01:02,577: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:01:02.582710875Z [2024-07-04 03:01:02,582: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:01:02.670106531Z [2024-07-04 03:01:02,669: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:01:04.257498400Z [2024-07-04 03:01:04,257: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75c7a32d-b791-4ee2-8865-f018dfbf4e45] succeeded in 3.6026484669991987s: None 2024-07-04T03:01:05.359666470Z [2024-07-04 03:01:05,359: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13df7bcf-5622-4325-85ee-c42d2ccf6710] succeeded in 4.704258253999797s: None 2024-07-04T03:02:00.992484686Z [2024-07-04 03:02:00,992: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[098856b5-a831-4f1b-81af-cae491750ef9] received 2024-07-04T03:02:00.996289517Z [2024-07-04 03:02:00,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff810fd6-6bde-471c-abe5-92d3ff10d9be] received 2024-07-04T03:02:00.998415464Z [2024-07-04 03:02:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b88b357b-9b2d-47de-8842-3e6e8c75233c] received 2024-07-04T03:02:01.020789971Z [2024-07-04 03:02:01,020: INFO/ForkPoolWorker-15] [098856b5-a831-4f1b-81af-cae491750ef9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:02:01.023240180Z [2024-07-04 03:02:01,022: INFO/ForkPoolWorker-1] [b88b357b-9b2d-47de-8842-3e6e8c75233c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:02:01.024174021Z [2024-07-04 03:02:01,023: INFO/ForkPoolWorker-16] [ff810fd6-6bde-471c-abe5-92d3ff10d9be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:02:01.296157017Z [2024-07-04 03:02:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:02:01.315399471Z [2024-07-04 03:02:01,311: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:02:01.349813995Z [2024-07-04 03:02:01,346: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:02:01.565093273Z [2024-07-04 03:02:01,564: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:02:02.153638625Z [2024-07-04 03:02:02,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[098856b5-a831-4f1b-81af-cae491750ef9] succeeded in 1.1526812349993634s: None 2024-07-04T03:02:02.497013973Z [2024-07-04 03:02:02,496: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:02:02.500320340Z [2024-07-04 03:02:02,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:02:02.525292962Z [2024-07-04 03:02:02,525: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:02:02.526686433Z [2024-07-04 03:02:02,526: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:02:02.526703361Z [2024-07-04 03:02:02,526: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:02:02.526841553Z [2024-07-04 03:02:02,526: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:02:02.526910570Z [2024-07-04 03:02:02,526: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:02:02.527167772Z [2024-07-04 03:02:02,527: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:02:02.527230269Z [2024-07-04 03:02:02,527: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:02:02.612454199Z [2024-07-04 03:02:02,612: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:02:02.679405733Z [2024-07-04 03:02:02,678: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:02:02.682888341Z [2024-07-04 03:02:02,682: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:02:02.719779338Z [2024-07-04 03:02:02,718: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:02:02.722029766Z [2024-07-04 03:02:02,721: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:02:02.722114812Z [2024-07-04 03:02:02,721: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:02:02.722519462Z [2024-07-04 03:02:02,722: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:02:02.722629254Z [2024-07-04 03:02:02,722: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:02:02.723046385Z [2024-07-04 03:02:02,722: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:02:02.726805515Z [2024-07-04 03:02:02,726: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:02:02.835912061Z [2024-07-04 03:02:02,835: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:02:04.199309454Z [2024-07-04 03:02:04,198: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff810fd6-6bde-471c-abe5-92d3ff10d9be] succeeded in 3.1988846619997275s: None 2024-07-04T03:02:06.688486754Z [2024-07-04 03:02:06,687: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b88b357b-9b2d-47de-8842-3e6e8c75233c] succeeded in 5.678223963000164s: None 2024-07-04T03:03:00.317715439Z [2024-07-04 03:03:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86dc3412-a6aa-4833-8f53-39398201d24e] received 2024-07-04T03:03:00.327789209Z [2024-07-04 03:03:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bae39045-e610-45a1-bba7-72b1813e0407] received 2024-07-04T03:03:00.353778553Z [2024-07-04 03:03:00,353: INFO/ForkPoolWorker-15] [86dc3412-a6aa-4833-8f53-39398201d24e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:03:00.362342750Z [2024-07-04 03:03:00,361: INFO/ForkPoolWorker-16] [bae39045-e610-45a1-bba7-72b1813e0407] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:03:00.751922946Z [2024-07-04 03:03:00,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:03:00.795130652Z [2024-07-04 03:03:00,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:03:02.143485810Z [2024-07-04 03:03:02,143: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:03:02.147619987Z [2024-07-04 03:03:02,147: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:03:02.181221590Z [2024-07-04 03:03:02,180: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:03:02.183494372Z [2024-07-04 03:03:02,183: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:03:02.184100405Z [2024-07-04 03:03:02,183: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:03:02.184510893Z [2024-07-04 03:03:02,184: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:03:02.185355401Z [2024-07-04 03:03:02,185: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:03:02.187227163Z [2024-07-04 03:03:02,187: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:03:02.187478189Z [2024-07-04 03:03:02,187: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:03:02.229861607Z [2024-07-04 03:03:02,229: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:03:02.234222588Z [2024-07-04 03:03:02,233: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:03:02.269926268Z [2024-07-04 03:03:02,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:03:02.271670051Z [2024-07-04 03:03:02,271: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:03:02.272242913Z [2024-07-04 03:03:02,271: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:03:02.272508206Z [2024-07-04 03:03:02,272: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:03:02.272666835Z [2024-07-04 03:03:02,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:03:02.273175642Z [2024-07-04 03:03:02,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:03:02.273382639Z [2024-07-04 03:03:02,273: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:03:02.327546569Z [2024-07-04 03:03:02,326: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:03:02.399472490Z [2024-07-04 03:03:02,399: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:03:04.073564312Z [2024-07-04 03:03:04,072: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86dc3412-a6aa-4833-8f53-39398201d24e] succeeded in 3.7464291799997227s: None 2024-07-04T03:03:04.462195752Z [2024-07-04 03:03:04,461: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bae39045-e610-45a1-bba7-72b1813e0407] succeeded in 4.12880766499984s: None 2024-07-04T03:04:00.310303924Z [2024-07-04 03:04:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af29e1b7-ca5c-4b54-ad01-568ebdd437f5] received 2024-07-04T03:04:00.316336361Z [2024-07-04 03:04:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8642609-d5ff-4c5b-81df-9e4c22eff864] received 2024-07-04T03:04:00.319865396Z [2024-07-04 03:04:00,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7b96606-ec27-4735-a5a3-4516e2081b1b] received 2024-07-04T03:04:00.336258024Z [2024-07-04 03:04:00,335: INFO/ForkPoolWorker-15] [af29e1b7-ca5c-4b54-ad01-568ebdd437f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:04:00.342067803Z [2024-07-04 03:04:00,341: INFO/ForkPoolWorker-16] [c8642609-d5ff-4c5b-81df-9e4c22eff864] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:04:00.349703060Z [2024-07-04 03:04:00,349: INFO/ForkPoolWorker-1] [e7b96606-ec27-4735-a5a3-4516e2081b1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:04:00.681727941Z [2024-07-04 03:04:00,676: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:04:00.700921418Z [2024-07-04 03:04:00,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:04:00.978311372Z [2024-07-04 03:04:00,973: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:04:01.409570216Z [2024-07-04 03:04:01,408: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:04:02.151000920Z [2024-07-04 03:04:02,150: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af29e1b7-ca5c-4b54-ad01-568ebdd437f5] succeeded in 1.8356715820000318s: None 2024-07-04T03:04:02.190488136Z [2024-07-04 03:04:02,190: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:04:02.193573309Z [2024-07-04 03:04:02,193: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:04:02.227247934Z [2024-07-04 03:04:02,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:04:02.229103712Z [2024-07-04 03:04:02,228: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:04:02.229209372Z [2024-07-04 03:04:02,229: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:04:02.229352951Z [2024-07-04 03:04:02,229: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:04:02.229383384Z [2024-07-04 03:04:02,229: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:04:02.230449072Z [2024-07-04 03:04:02,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:04:02.230466466Z [2024-07-04 03:04:02,230: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:04:02.276562306Z [2024-07-04 03:04:02,276: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:04:02.280032537Z [2024-07-04 03:04:02,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:04:02.317420203Z [2024-07-04 03:04:02,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:04:02.321176060Z [2024-07-04 03:04:02,320: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:04:02.321327047Z [2024-07-04 03:04:02,321: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:04:02.321567362Z [2024-07-04 03:04:02,321: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:04:02.321601617Z [2024-07-04 03:04:02,321: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:04:02.322003734Z [2024-07-04 03:04:02,321: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:04:02.322092656Z [2024-07-04 03:04:02,321: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:04:02.322981544Z [2024-07-04 03:04:02,322: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:04:02.425249274Z [2024-07-04 03:04:02,424: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:04:03.949273257Z [2024-07-04 03:04:03,948: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8642609-d5ff-4c5b-81df-9e4c22eff864] succeeded in 3.629300751000301s: None 2024-07-04T03:04:04.491699159Z [2024-07-04 03:04:04,491: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e7b96606-ec27-4735-a5a3-4516e2081b1b] succeeded in 4.168570644000283s: None 2024-07-04T03:05:01.317236328Z [2024-07-04 03:05:01,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d063c5d2-46d9-470f-b9c3-3e42de74245b] received 2024-07-04T03:05:01.323241289Z [2024-07-04 03:05:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[766e4c2e-b4a8-445f-b1ce-0318e69cee1a] received 2024-07-04T03:05:01.328913336Z [2024-07-04 03:05:01,328: INFO/ForkPoolWorker-15] [d063c5d2-46d9-470f-b9c3-3e42de74245b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:01.329992524Z [2024-07-04 03:05:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f199e59-5967-4d58-912b-363c145ada46] received 2024-07-04T03:05:01.341571262Z [2024-07-04 03:05:01,341: INFO/ForkPoolWorker-16] [766e4c2e-b4a8-445f-b1ce-0318e69cee1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:05:01.342398665Z [2024-07-04 03:05:01,342: INFO/ForkPoolWorker-1] [0f199e59-5967-4d58-912b-363c145ada46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:05:01.678992415Z [2024-07-04 03:05:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:05:01.701838360Z [2024-07-04 03:05:01,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:05:01.709906406Z [2024-07-04 03:05:01,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:05:02.961379241Z [2024-07-04 03:05:02,960: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:05:02.964699398Z [2024-07-04 03:05:02,964: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:02.997627181Z [2024-07-04 03:05:02,997: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:05:02.997822148Z [2024-07-04 03:05:02,997: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:05:03.000148057Z [2024-07-04 03:05:02,999: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:03.000168814Z [2024-07-04 03:05:03,000: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:03.000331909Z [2024-07-04 03:05:03,000: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:03.000343915Z [2024-07-04 03:05:03,000: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:05:03.000551907Z [2024-07-04 03:05:03,000: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:05:03.000567089Z [2024-07-04 03:05:03,000: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:03.002046767Z [2024-07-04 03:05:03,001: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:03.035995422Z [2024-07-04 03:05:03,035: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:05:03.041526241Z [2024-07-04 03:05:03,041: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:03.043075129Z [2024-07-04 03:05:03,041: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:03.043793000Z [2024-07-04 03:05:03,043: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:03.044033970Z [2024-07-04 03:05:03,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:05:03.045771801Z [2024-07-04 03:05:03,045: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:05:03.046389008Z [2024-07-04 03:05:03,045: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:03.091807352Z [2024-07-04 03:05:03,091: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:03.151062365Z [2024-07-04 03:05:03,150: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:05:03.154498522Z [2024-07-04 03:05:03,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:03.176033756Z [2024-07-04 03:05:03,175: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:03.186406834Z [2024-07-04 03:05:03,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:05:03.187654428Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:03.187667314Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:03.187765137Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:03.187777343Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:05:03.188024248Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:05:03.188035739Z [2024-07-04 03:05:03,187: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:03.273716818Z [2024-07-04 03:05:03,273: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:03.808655114Z [2024-07-04 03:05:03,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d063c5d2-46d9-470f-b9c3-3e42de74245b] succeeded in 2.4883180990000255s: None 2024-07-04T03:05:04.013403199Z [2024-07-04 03:05:04,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7235184f-e1d0-4b61-bc03-b02297b2f8e6] received 2024-07-04T03:05:04.024280132Z [2024-07-04 03:05:04,023: INFO/ForkPoolWorker-15] [7235184f-e1d0-4b61-bc03-b02297b2f8e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:04.332531845Z [2024-07-04 03:05:04,329: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:05:04.759046999Z [2024-07-04 03:05:04,747: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[766e4c2e-b4a8-445f-b1ce-0318e69cee1a] succeeded in 3.417898432000584s: None 2024-07-04T03:05:05.344934037Z [2024-07-04 03:05:05,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f199e59-5967-4d58-912b-363c145ada46] succeeded in 4.011318957000185s: None 2024-07-04T03:05:05.660146830Z [2024-07-04 03:05:05,659: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:05:05.663335824Z [2024-07-04 03:05:05,662: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:05.695752603Z [2024-07-04 03:05:05,695: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:05:05.698160669Z [2024-07-04 03:05:05,697: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:05.698173978Z [2024-07-04 03:05:05,698: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:05.698366427Z [2024-07-04 03:05:05,698: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:05.698374128Z [2024-07-04 03:05:05,698: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:05:05.698738745Z [2024-07-04 03:05:05,698: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:05:05.698846395Z [2024-07-04 03:05:05,698: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:05.801216176Z [2024-07-04 03:05:05,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:06.558799790Z [2024-07-04 03:05:06,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7235184f-e1d0-4b61-bc03-b02297b2f8e6] succeeded in 2.5415450129994497s: None 2024-07-04T03:05:06.659550474Z [2024-07-04 03:05:06,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e2355ad-15b6-49c6-9059-397e909a55c5] received 2024-07-04T03:05:06.668802580Z [2024-07-04 03:05:06,668: INFO/ForkPoolWorker-15] [0e2355ad-15b6-49c6-9059-397e909a55c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:05:06.928177688Z [2024-07-04 03:05:06,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:05:08.041765875Z [2024-07-04 03:05:08,041: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:05:08.045112245Z [2024-07-04 03:05:08,044: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:08.083594253Z [2024-07-04 03:05:08,083: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:05:08.085848988Z [2024-07-04 03:05:08,085: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:08.085867240Z [2024-07-04 03:05:08,085: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:08.085979815Z [2024-07-04 03:05:08,085: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:08.086067894Z [2024-07-04 03:05:08,085: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:05:08.086420268Z [2024-07-04 03:05:08,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:05:08.086453806Z [2024-07-04 03:05:08,086: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:08.172804619Z [2024-07-04 03:05:08,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:09.875102575Z [2024-07-04 03:05:09,871: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0e2355ad-15b6-49c6-9059-397e909a55c5] succeeded in 3.2106805559997156s: None 2024-07-04T03:05:10.110217641Z [2024-07-04 03:05:10,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[512fad52-2756-42eb-a95c-530de7c6c75d] received 2024-07-04T03:05:10.142021069Z [2024-07-04 03:05:10,141: INFO/ForkPoolWorker-15] [512fad52-2756-42eb-a95c-530de7c6c75d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:05:10.484405154Z [2024-07-04 03:05:10,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:05:11.736337530Z [2024-07-04 03:05:11,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:05:11.739452951Z [2024-07-04 03:05:11,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:05:11.774654909Z [2024-07-04 03:05:11,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:05:11.776506179Z [2024-07-04 03:05:11,776: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:05:11.777167053Z [2024-07-04 03:05:11,777: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:05:11.777612853Z [2024-07-04 03:05:11,777: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:05:11.777715186Z [2024-07-04 03:05:11,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:05:11.778007413Z [2024-07-04 03:05:11,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:05:11.779117428Z [2024-07-04 03:05:11,778: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:05:11.894087735Z [2024-07-04 03:05:11,892: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:05:12.669905416Z [2024-07-04 03:05:12,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[512fad52-2756-42eb-a95c-530de7c6c75d] succeeded in 2.556945483999698s: None 2024-07-04T03:06:00.614145411Z [2024-07-04 03:06:00,613: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab7eec7a-f621-4186-80e5-4aa9e36b44ea] received 2024-07-04T03:06:00.643683321Z [2024-07-04 03:06:00,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f64e350-18d5-4c21-80a6-0018f3b725ad] received 2024-07-04T03:06:00.645080101Z [2024-07-04 03:06:00,644: INFO/ForkPoolWorker-15] [ab7eec7a-f621-4186-80e5-4aa9e36b44ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:06:00.686701982Z [2024-07-04 03:06:00,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f03f0f21-0147-4784-ba6f-5ddb5af6664e] received 2024-07-04T03:06:00.712933691Z [2024-07-04 03:06:00,712: INFO/ForkPoolWorker-16] [2f64e350-18d5-4c21-80a6-0018f3b725ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:06:00.723155662Z [2024-07-04 03:06:00,722: INFO/ForkPoolWorker-1] [f03f0f21-0147-4784-ba6f-5ddb5af6664e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:06:01.162530126Z [2024-07-04 03:06:01,136: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:06:01.220059436Z [2024-07-04 03:06:01,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:06:01.335524238Z [2024-07-04 03:06:01,331: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:06:01.869847811Z [2024-07-04 03:06:01,869: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:06:02.612835704Z [2024-07-04 03:06:02,612: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f03f0f21-0147-4784-ba6f-5ddb5af6664e] succeeded in 1.9111029380001128s: None 2024-07-04T03:06:02.891620115Z [2024-07-04 03:06:02,891: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:06:02.894917554Z [2024-07-04 03:06:02,894: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:06:02.921796321Z [2024-07-04 03:06:02,921: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:06:02.923801319Z [2024-07-04 03:06:02,923: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:06:02.923864494Z [2024-07-04 03:06:02,923: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:06:02.923991367Z [2024-07-04 03:06:02,923: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:06:02.924031889Z [2024-07-04 03:06:02,923: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:06:02.924260138Z [2024-07-04 03:06:02,924: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:06:02.924302091Z [2024-07-04 03:06:02,924: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:06:02.940610488Z [2024-07-04 03:06:02,940: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:06:02.944129576Z [2024-07-04 03:06:02,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:06:02.975887440Z [2024-07-04 03:06:02,975: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:06:02.977010692Z [2024-07-04 03:06:02,976: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:06:02.977025625Z [2024-07-04 03:06:02,976: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:06:02.977128391Z [2024-07-04 03:06:02,976: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:06:02.977141324Z [2024-07-04 03:06:02,977: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:06:02.977376483Z [2024-07-04 03:06:02,977: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:06:02.977394233Z [2024-07-04 03:06:02,977: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:06:03.020895426Z [2024-07-04 03:06:03,020: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:06:03.056475211Z [2024-07-04 03:06:03,056: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:06:04.522476271Z [2024-07-04 03:06:04,521: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f64e350-18d5-4c21-80a6-0018f3b725ad] succeeded in 3.873465290999775s: None 2024-07-04T03:06:04.985812031Z [2024-07-04 03:06:04,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab7eec7a-f621-4186-80e5-4aa9e36b44ea] succeeded in 4.366800185000102s: None 2024-07-04T03:07:00.873013930Z [2024-07-04 03:07:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce2c39a6-3b8d-4a2d-96e5-a5c56a5733f5] received 2024-07-04T03:07:00.895921235Z [2024-07-04 03:07:00,895: INFO/ForkPoolWorker-15] [ce2c39a6-3b8d-4a2d-96e5-a5c56a5733f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:07:00.923989432Z [2024-07-04 03:07:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[046ba2d7-4a8e-4e19-a98b-114800be5a1c] received 2024-07-04T03:07:00.967347354Z [2024-07-04 03:07:00,966: INFO/ForkPoolWorker-16] [046ba2d7-4a8e-4e19-a98b-114800be5a1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:07:01.305642098Z [2024-07-04 03:07:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:07:01.378381740Z [2024-07-04 03:07:01,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:07:02.707311611Z [2024-07-04 03:07:02,706: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:07:02.710536628Z [2024-07-04 03:07:02,710: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:07:02.749960318Z [2024-07-04 03:07:02,749: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:07:02.751125872Z [2024-07-04 03:07:02,750: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:07:02.751139889Z [2024-07-04 03:07:02,751: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:07:02.751264323Z [2024-07-04 03:07:02,751: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:07:02.751275469Z [2024-07-04 03:07:02,751: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:07:02.751499415Z [2024-07-04 03:07:02,751: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:07:02.751514584Z [2024-07-04 03:07:02,751: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:07:02.851779481Z [2024-07-04 03:07:02,851: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:07:02.943753787Z [2024-07-04 03:07:02,943: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:07:02.948024283Z [2024-07-04 03:07:02,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:07:02.992898793Z [2024-07-04 03:07:02,992: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:07:02.994100591Z [2024-07-04 03:07:02,993: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:07:02.994117751Z [2024-07-04 03:07:02,993: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:07:02.994282125Z [2024-07-04 03:07:02,994: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:07:02.994318124Z [2024-07-04 03:07:02,994: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:07:02.994567610Z [2024-07-04 03:07:02,994: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:07:02.994597483Z [2024-07-04 03:07:02,994: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:07:03.107757128Z [2024-07-04 03:07:03,107: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:07:04.586815466Z [2024-07-04 03:07:04,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[046ba2d7-4a8e-4e19-a98b-114800be5a1c] succeeded in 3.6588833289997638s: None 2024-07-04T03:07:05.830298380Z [2024-07-04 03:07:05,829: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ce2c39a6-3b8d-4a2d-96e5-a5c56a5733f5] succeeded in 4.9492174550005075s: None 2024-07-04T03:08:00.776010390Z [2024-07-04 03:08:00,775: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[634f609c-7a72-4394-b95d-07eeb09e8dac] received 2024-07-04T03:08:00.788349186Z [2024-07-04 03:08:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1128fbd-0808-4958-a89c-994af913615a] received 2024-07-04T03:08:00.798754542Z [2024-07-04 03:08:00,798: INFO/ForkPoolWorker-15] [634f609c-7a72-4394-b95d-07eeb09e8dac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:08:00.799892485Z [2024-07-04 03:08:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c7a6a69-0fa2-4003-909e-eea5ef1a0eeb] received 2024-07-04T03:08:00.816262864Z [2024-07-04 03:08:00,815: INFO/ForkPoolWorker-16] [d1128fbd-0808-4958-a89c-994af913615a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:08:00.832326982Z [2024-07-04 03:08:00,831: INFO/ForkPoolWorker-1] [1c7a6a69-0fa2-4003-909e-eea5ef1a0eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:08:01.171385721Z [2024-07-04 03:08:01,166: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:08:01.329328757Z [2024-07-04 03:08:01,317: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:08:01.355351818Z [2024-07-04 03:08:01,351: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:08:01.834761983Z [2024-07-04 03:08:01,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:08:02.623594417Z [2024-07-04 03:08:02,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[634f609c-7a72-4394-b95d-07eeb09e8dac] succeeded in 1.844697076000557s: None 2024-07-04T03:08:02.781260994Z [2024-07-04 03:08:02,780: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:08:02.784684748Z [2024-07-04 03:08:02,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:08:02.820127475Z [2024-07-04 03:08:02,819: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:08:02.822296398Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:08:02.822318275Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:08:02.822511886Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:08:02.822533191Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:08:02.822820619Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:08:02.822859313Z [2024-07-04 03:08:02,822: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:08:02.925541255Z [2024-07-04 03:08:02,925: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:08:03.159889206Z [2024-07-04 03:08:03,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:08:03.164936697Z [2024-07-04 03:08:03,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:08:03.197247605Z [2024-07-04 03:08:03,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:08:03.199411020Z [2024-07-04 03:08:03,199: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:08:03.199692972Z [2024-07-04 03:08:03,199: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:08:03.199870253Z [2024-07-04 03:08:03,199: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:08:03.199928064Z [2024-07-04 03:08:03,199: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:08:03.200590178Z [2024-07-04 03:08:03,200: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:08:03.200599447Z [2024-07-04 03:08:03,200: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:08:03.326523534Z [2024-07-04 03:08:03,325: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:08:04.865722179Z [2024-07-04 03:08:04,865: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c7a6a69-0fa2-4003-909e-eea5ef1a0eeb] succeeded in 4.062455923000016s: None 2024-07-04T03:08:05.569773950Z [2024-07-04 03:08:05,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1128fbd-0808-4958-a89c-994af913615a] succeeded in 4.77633951900043s: None 2024-07-04T03:09:00.631003304Z [2024-07-04 03:09:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eca4c258-fff4-4a7e-957f-d4289a59d652] received 2024-07-04T03:09:00.662199963Z [2024-07-04 03:09:00,661: INFO/ForkPoolWorker-15] [eca4c258-fff4-4a7e-957f-d4289a59d652] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:09:00.684090038Z [2024-07-04 03:09:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c91ad221-bd44-4409-b850-925ebe42fb65] received 2024-07-04T03:09:00.711238411Z [2024-07-04 03:09:00,710: INFO/ForkPoolWorker-16] [c91ad221-bd44-4409-b850-925ebe42fb65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:09:01.080971179Z [2024-07-04 03:09:01,074: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:09:01.121629806Z [2024-07-04 03:09:01,117: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:09:02.328529624Z [2024-07-04 03:09:02,328: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:09:02.331777362Z [2024-07-04 03:09:02,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:09:02.377213163Z [2024-07-04 03:09:02,376: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:09:02.378716753Z [2024-07-04 03:09:02,378: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:09:02.378777244Z [2024-07-04 03:09:02,378: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:09:02.378968660Z [2024-07-04 03:09:02,378: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:09:02.378987597Z [2024-07-04 03:09:02,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:09:02.379305410Z [2024-07-04 03:09:02,379: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:09:02.379356767Z [2024-07-04 03:09:02,379: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:09:02.500164593Z [2024-07-04 03:09:02,499: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:09:02.518009930Z [2024-07-04 03:09:02,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:09:02.521269557Z [2024-07-04 03:09:02,520: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:09:02.565370002Z [2024-07-04 03:09:02,565: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:09:02.566553014Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:09:02.566632742Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:09:02.566730830Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:09:02.566743149Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:09:02.567088616Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:09:02.567100390Z [2024-07-04 03:09:02,566: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:09:02.687702741Z [2024-07-04 03:09:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:09:04.561152245Z [2024-07-04 03:09:04,560: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eca4c258-fff4-4a7e-957f-d4289a59d652] succeeded in 3.9226618060001783s: None 2024-07-04T03:09:05.623475960Z [2024-07-04 03:09:05,622: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c91ad221-bd44-4409-b850-925ebe42fb65] succeeded in 4.933990972000174s: None 2024-07-04T03:10:01.250951252Z [2024-07-04 03:10:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b03e8f2-ba2d-4216-b74d-c0604246bf78] received 2024-07-04T03:10:01.255963490Z [2024-07-04 03:10:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68f9118a-67c5-4514-994b-e03fd9d3223e] received 2024-07-04T03:10:01.263496307Z [2024-07-04 03:10:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf5051c3-b199-4282-a1a8-004e3787a1db] received 2024-07-04T03:10:01.266294886Z [2024-07-04 03:10:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09847fea-dad8-4f4f-8b06-06c4e362559e] received 2024-07-04T03:10:01.282442449Z [2024-07-04 03:10:01,281: INFO/ForkPoolWorker-1] [bf5051c3-b199-4282-a1a8-004e3787a1db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:10:01.285971085Z [2024-07-04 03:10:01,285: INFO/ForkPoolWorker-15] [2b03e8f2-ba2d-4216-b74d-c0604246bf78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:01.291874085Z [2024-07-04 03:10:01,290: INFO/ForkPoolWorker-16] [68f9118a-67c5-4514-994b-e03fd9d3223e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:10:01.294180494Z [2024-07-04 03:10:01,293: INFO/ForkPoolWorker-2] [09847fea-dad8-4f4f-8b06-06c4e362559e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:10:01.615090755Z [2024-07-04 03:10:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:10:01.720399154Z [2024-07-04 03:10:01,716: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:10:01.754937132Z [2024-07-04 03:10:01,750: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:10:01.895011993Z [2024-07-04 03:10:01,880: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:10:02.087142909Z [2024-07-04 03:10:02,086: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:02.724184201Z [2024-07-04 03:10:02,723: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bf5051c3-b199-4282-a1a8-004e3787a1db] succeeded in 1.4549504480000905s: None 2024-07-04T03:10:03.092685605Z [2024-07-04 03:10:03,092: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:10:03.096212773Z [2024-07-04 03:10:03,095: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:03.109368191Z [2024-07-04 03:10:03,109: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:10:03.112652514Z [2024-07-04 03:10:03,112: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:03.131712139Z [2024-07-04 03:10:03,131: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:10:03.132870430Z [2024-07-04 03:10:03,132: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:03.132884435Z [2024-07-04 03:10:03,132: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:03.133086741Z [2024-07-04 03:10:03,132: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:03.133102902Z [2024-07-04 03:10:03,133: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:10:03.133365450Z [2024-07-04 03:10:03,133: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:10:03.133479551Z [2024-07-04 03:10:03,133: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:03.153611037Z [2024-07-04 03:10:03,153: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:10:03.155723028Z [2024-07-04 03:10:03,155: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:03.155761400Z [2024-07-04 03:10:03,155: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:03.155871049Z [2024-07-04 03:10:03,155: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:03.155944271Z [2024-07-04 03:10:03,155: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:10:03.156146209Z [2024-07-04 03:10:03,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:10:03.156224819Z [2024-07-04 03:10:03,156: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:03.209512408Z [2024-07-04 03:10:03,209: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T03:10:03.212757776Z [2024-07-04 03:10:03,212: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:03.229251114Z [2024-07-04 03:10:03,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:03.236627819Z [2024-07-04 03:10:03,236: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T03:10:03.240490618Z [2024-07-04 03:10:03,240: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:03.241863499Z [2024-07-04 03:10:03,240: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:03.242077233Z [2024-07-04 03:10:03,241: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:03.242166527Z [2024-07-04 03:10:03,242: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T03:10:03.242492987Z [2024-07-04 03:10:03,242: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:10:03.242685305Z [2024-07-04 03:10:03,242: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:03.260626077Z [2024-07-04 03:10:03,260: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:03.345428110Z [2024-07-04 03:10:03,345: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:03.881702351Z [2024-07-04 03:10:03,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b03e8f2-ba2d-4216-b74d-c0604246bf78] succeeded in 2.6194715929996164s: None 2024-07-04T03:10:04.054206779Z [2024-07-04 03:10:04,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[791a7426-6d9d-4934-af5f-5be269a5dba1] received 2024-07-04T03:10:04.061328095Z [2024-07-04 03:10:04,061: INFO/ForkPoolWorker-15] [791a7426-6d9d-4934-af5f-5be269a5dba1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:04.355970989Z [2024-07-04 03:10:04,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:10:04.689294598Z [2024-07-04 03:10:04,688: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[68f9118a-67c5-4514-994b-e03fd9d3223e] succeeded in 3.4271273960002873s: None 2024-07-04T03:10:05.241542201Z [2024-07-04 03:10:05,240: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[09847fea-dad8-4f4f-8b06-06c4e362559e] succeeded in 3.9706733249995523s: None 2024-07-04T03:10:05.493849749Z [2024-07-04 03:10:05,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:10:05.497028753Z [2024-07-04 03:10:05,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:05.525766478Z [2024-07-04 03:10:05,525: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:10:05.527466965Z [2024-07-04 03:10:05,527: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:05.527645819Z [2024-07-04 03:10:05,527: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:05.527913686Z [2024-07-04 03:10:05,527: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:05.528074152Z [2024-07-04 03:10:05,527: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:10:05.528444031Z [2024-07-04 03:10:05,528: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:10:05.528587780Z [2024-07-04 03:10:05,528: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:05.631557495Z [2024-07-04 03:10:05,631: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:06.420103501Z [2024-07-04 03:10:06,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[791a7426-6d9d-4934-af5f-5be269a5dba1] succeeded in 2.363862999000048s: None 2024-07-04T03:10:06.512332208Z [2024-07-04 03:10:06,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2f8b62f-d8aa-4dc3-a941-13ee0a5a8053] received 2024-07-04T03:10:06.519067024Z [2024-07-04 03:10:06,518: INFO/ForkPoolWorker-15] [a2f8b62f-d8aa-4dc3-a941-13ee0a5a8053] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:10:06.808816698Z [2024-07-04 03:10:06,805: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:10:07.920950826Z [2024-07-04 03:10:07,920: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:10:07.924321791Z [2024-07-04 03:10:07,923: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:07.956887546Z [2024-07-04 03:10:07,956: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:10:07.959452702Z [2024-07-04 03:10:07,959: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:07.959720043Z [2024-07-04 03:10:07,959: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:07.960049763Z [2024-07-04 03:10:07,959: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:07.960251541Z [2024-07-04 03:10:07,960: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:10:07.960695280Z [2024-07-04 03:10:07,960: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:10:07.960951911Z [2024-07-04 03:10:07,960: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:08.046778647Z [2024-07-04 03:10:08,046: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:09.747493023Z [2024-07-04 03:10:09,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2f8b62f-d8aa-4dc3-a941-13ee0a5a8053] succeeded in 3.2327309149995926s: None 2024-07-04T03:10:10.315983251Z [2024-07-04 03:10:10,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8717513a-60dd-41b9-9683-549291a3e6fa] received 2024-07-04T03:10:10.328479735Z [2024-07-04 03:10:10,328: INFO/ForkPoolWorker-15] [8717513a-60dd-41b9-9683-549291a3e6fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:10:10.622038038Z [2024-07-04 03:10:10,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:10:11.809388244Z [2024-07-04 03:10:11,808: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:10:11.812766921Z [2024-07-04 03:10:11,812: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:10:11.854261227Z [2024-07-04 03:10:11,852: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:10:11.871070991Z [2024-07-04 03:10:11,855: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:10:11.871079519Z [2024-07-04 03:10:11,856: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:10:11.871083718Z [2024-07-04 03:10:11,856: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:10:11.871087710Z [2024-07-04 03:10:11,856: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:10:11.871091124Z [2024-07-04 03:10:11,856: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:10:11.871094909Z [2024-07-04 03:10:11,856: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:10:11.987043605Z [2024-07-04 03:10:11,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:10:12.652595889Z [2024-07-04 03:10:12,652: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8717513a-60dd-41b9-9683-549291a3e6fa] succeeded in 2.333271304999471s: None 2024-07-04T03:11:01.024532993Z [2024-07-04 03:11:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7061c5e-b4f7-499c-a604-51b1c5ce6a8a] received 2024-07-04T03:11:01.029658203Z [2024-07-04 03:11:01,029: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7656b582-ecf1-48c5-9ee5-79564c70c4fc] received 2024-07-04T03:11:01.038912626Z [2024-07-04 03:11:01,038: INFO/ForkPoolWorker-15] [d7061c5e-b4f7-499c-a604-51b1c5ce6a8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:11:01.062944853Z [2024-07-04 03:11:01,062: INFO/ForkPoolWorker-16] [7656b582-ecf1-48c5-9ee5-79564c70c4fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:11:01.458103262Z [2024-07-04 03:11:01,454: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:11:01.511374820Z [2024-07-04 03:11:01,501: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:11:02.667704617Z [2024-07-04 03:11:02,667: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:11:02.669985745Z [2024-07-04 03:11:02,669: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:11:02.671032938Z [2024-07-04 03:11:02,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:11:02.673812554Z [2024-07-04 03:11:02,672: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:11:02.706640723Z [2024-07-04 03:11:02,706: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:11:02.707404902Z [2024-07-04 03:11:02,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:11:02.707876698Z [2024-07-04 03:11:02,707: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:11:02.707894050Z [2024-07-04 03:11:02,707: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:11:02.708008920Z [2024-07-04 03:11:02,707: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:11:02.708117835Z [2024-07-04 03:11:02,707: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:11:02.708381185Z [2024-07-04 03:11:02,708: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:11:02.708396609Z [2024-07-04 03:11:02,708: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:11:02.709923152Z [2024-07-04 03:11:02,709: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:11:02.709945073Z [2024-07-04 03:11:02,709: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:11:02.710105117Z [2024-07-04 03:11:02,709: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:11:02.710186656Z [2024-07-04 03:11:02,710: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:11:02.710459734Z [2024-07-04 03:11:02,710: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:11:02.710473807Z [2024-07-04 03:11:02,710: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:11:02.787091957Z [2024-07-04 03:11:02,786: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:11:02.823327465Z [2024-07-04 03:11:02,823: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:11:04.657282631Z [2024-07-04 03:11:04,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7656b582-ecf1-48c5-9ee5-79564c70c4fc] succeeded in 3.6212670040004014s: None 2024-07-04T03:11:04.976171458Z [2024-07-04 03:11:04,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7061c5e-b4f7-499c-a604-51b1c5ce6a8a] succeeded in 3.949199991999194s: None 2024-07-04T03:12:00.868201961Z [2024-07-04 03:12:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b29ddf01-7955-4ed4-a8e4-8adce834d5b9] received 2024-07-04T03:12:00.871273154Z [2024-07-04 03:12:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37cac3b0-7c5d-465f-a944-67053c11f615] received 2024-07-04T03:12:00.882184286Z [2024-07-04 03:12:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61e476cb-bbe0-483e-8c19-f3bbd119378b] received 2024-07-04T03:12:00.886955034Z [2024-07-04 03:12:00,886: INFO/ForkPoolWorker-16] [37cac3b0-7c5d-465f-a944-67053c11f615] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:12:00.893215750Z [2024-07-04 03:12:00,892: INFO/ForkPoolWorker-15] [b29ddf01-7955-4ed4-a8e4-8adce834d5b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:12:00.917586198Z [2024-07-04 03:12:00,917: INFO/ForkPoolWorker-1] [61e476cb-bbe0-483e-8c19-f3bbd119378b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:12:01.279020419Z [2024-07-04 03:12:01,274: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:12:01.296449128Z [2024-07-04 03:12:01,292: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:12:01.338518510Z [2024-07-04 03:12:01,334: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:12:01.620738293Z [2024-07-04 03:12:01,620: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:12:02.267222976Z [2024-07-04 03:12:02,266: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[61e476cb-bbe0-483e-8c19-f3bbd119378b] succeeded in 1.377976600000693s: None 2024-07-04T03:12:02.615498692Z [2024-07-04 03:12:02,615: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:12:02.618791060Z [2024-07-04 03:12:02,618: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:12:02.652265418Z [2024-07-04 03:12:02,652: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:12:02.655849623Z [2024-07-04 03:12:02,655: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:12:02.655870531Z [2024-07-04 03:12:02,655: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:12:02.655963206Z [2024-07-04 03:12:02,655: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:12:02.656002116Z [2024-07-04 03:12:02,655: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:12:02.656343983Z [2024-07-04 03:12:02,656: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:12:02.656356739Z [2024-07-04 03:12:02,656: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:12:02.665603136Z [2024-07-04 03:12:02,665: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:12:02.669245442Z [2024-07-04 03:12:02,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:12:02.699021036Z [2024-07-04 03:12:02,698: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:12:02.700373069Z [2024-07-04 03:12:02,700: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:12:02.700494374Z [2024-07-04 03:12:02,700: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:12:02.700695107Z [2024-07-04 03:12:02,700: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:12:02.700859638Z [2024-07-04 03:12:02,700: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:12:02.701132999Z [2024-07-04 03:12:02,700: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:12:02.701244764Z [2024-07-04 03:12:02,701: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:12:02.739846727Z [2024-07-04 03:12:02,739: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:12:02.783207651Z [2024-07-04 03:12:02,782: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:12:04.515585314Z [2024-07-04 03:12:04,515: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[37cac3b0-7c5d-465f-a944-67053c11f615] succeeded in 3.641396526999415s: None 2024-07-04T03:12:05.221983737Z [2024-07-04 03:12:05,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b29ddf01-7955-4ed4-a8e4-8adce834d5b9] succeeded in 4.347592912999971s: None 2024-07-04T03:13:00.603687323Z [2024-07-04 03:13:00,602: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbc0a6d9-0830-40d1-8249-004c7d9ed9e8] received 2024-07-04T03:13:00.611202311Z [2024-07-04 03:13:00,610: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[987ba472-3544-49c1-b577-647e21981505] received 2024-07-04T03:13:00.624635482Z [2024-07-04 03:13:00,623: INFO/ForkPoolWorker-15] [cbc0a6d9-0830-40d1-8249-004c7d9ed9e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:13:00.635484931Z [2024-07-04 03:13:00,635: INFO/ForkPoolWorker-16] [987ba472-3544-49c1-b577-647e21981505] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:13:00.971091176Z [2024-07-04 03:13:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:13:01.037765931Z [2024-07-04 03:13:01,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:13:02.164346102Z [2024-07-04 03:13:02,163: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:13:02.167569495Z [2024-07-04 03:13:02,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:13:02.199954678Z [2024-07-04 03:13:02,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:13:02.201749255Z [2024-07-04 03:13:02,201: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:13:02.201761684Z [2024-07-04 03:13:02,201: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:13:02.201886352Z [2024-07-04 03:13:02,201: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:13:02.201948167Z [2024-07-04 03:13:02,201: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:13:02.202225205Z [2024-07-04 03:13:02,202: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:13:02.202239015Z [2024-07-04 03:13:02,202: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:13:02.207215724Z [2024-07-04 03:13:02,206: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:13:02.210817384Z [2024-07-04 03:13:02,210: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:13:02.244807381Z [2024-07-04 03:13:02,244: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:13:02.246559733Z [2024-07-04 03:13:02,246: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:13:02.247699221Z [2024-07-04 03:13:02,247: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:13:02.248137493Z [2024-07-04 03:13:02,247: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:13:02.248311540Z [2024-07-04 03:13:02,248: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:13:02.249226117Z [2024-07-04 03:13:02,248: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:13:02.249397954Z [2024-07-04 03:13:02,249: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:13:02.309037408Z [2024-07-04 03:13:02,308: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:13:02.375741443Z [2024-07-04 03:13:02,375: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:13:03.956101062Z [2024-07-04 03:13:03,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[987ba472-3544-49c1-b577-647e21981505] succeeded in 3.3425684730000285s: None 2024-07-04T03:13:04.619685184Z [2024-07-04 03:13:04,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbc0a6d9-0830-40d1-8249-004c7d9ed9e8] succeeded in 4.0101234269995985s: None 2024-07-04T03:14:00.636032278Z [2024-07-04 03:14:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[926fac7a-1931-475c-96d1-c1b3e48910eb] received 2024-07-04T03:14:00.639768279Z [2024-07-04 03:14:00,639: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfb1ce38-b133-4884-8c3e-0ca160b4c51b] received 2024-07-04T03:14:00.643175478Z [2024-07-04 03:14:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ded154df-7445-406c-83a6-6cf350e1d83e] received 2024-07-04T03:14:00.662622226Z [2024-07-04 03:14:00,662: INFO/ForkPoolWorker-15] [926fac7a-1931-475c-96d1-c1b3e48910eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:14:00.671377689Z [2024-07-04 03:14:00,670: INFO/ForkPoolWorker-1] [ded154df-7445-406c-83a6-6cf350e1d83e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:14:00.672228505Z [2024-07-04 03:14:00,671: INFO/ForkPoolWorker-16] [bfb1ce38-b133-4884-8c3e-0ca160b4c51b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:14:01.088719154Z [2024-07-04 03:14:01,082: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:14:01.140083120Z [2024-07-04 03:14:01,135: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:14:01.265307777Z [2024-07-04 03:14:01,260: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:14:01.384767083Z [2024-07-04 03:14:01,384: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:14:02.082990728Z [2024-07-04 03:14:02,082: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfb1ce38-b133-4884-8c3e-0ca160b4c51b] succeeded in 1.438499462999971s: None 2024-07-04T03:14:02.481946143Z [2024-07-04 03:14:02,481: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:14:02.485244449Z [2024-07-04 03:14:02,484: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:14:02.516547283Z [2024-07-04 03:14:02,516: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:14:02.519232258Z [2024-07-04 03:14:02,518: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:14:02.520605399Z [2024-07-04 03:14:02,520: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:14:02.521240991Z [2024-07-04 03:14:02,520: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:14:02.522065266Z [2024-07-04 03:14:02,521: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:14:02.523258791Z [2024-07-04 03:14:02,522: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:14:02.524096889Z [2024-07-04 03:14:02,523: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:14:02.559487589Z [2024-07-04 03:14:02,559: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:14:02.562722049Z [2024-07-04 03:14:02,562: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:14:02.586897677Z [2024-07-04 03:14:02,584: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:14:02.586919091Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:14:02.586924086Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:14:02.586932532Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:14:02.586937225Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:14:02.586941013Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:14:02.586944884Z [2024-07-04 03:14:02,586: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:14:02.638346666Z [2024-07-04 03:14:02,638: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:14:02.696478433Z [2024-07-04 03:14:02,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:14:04.686032874Z [2024-07-04 03:14:04,685: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[926fac7a-1931-475c-96d1-c1b3e48910eb] succeeded in 4.045196815000054s: None 2024-07-04T03:14:04.743238276Z [2024-07-04 03:14:04,733: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ded154df-7445-406c-83a6-6cf350e1d83e] succeeded in 4.0848549430002095s: None 2024-07-04T03:15:01.131109936Z [2024-07-04 03:15:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bc35a45-158d-499d-b205-607efb8be3af] received 2024-07-04T03:15:01.135707843Z [2024-07-04 03:15:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d17674c-d1dc-4b00-9ff7-512042ecc799] received 2024-07-04T03:15:01.139144022Z [2024-07-04 03:15:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dd5c179-48ef-4548-a0ab-add47ac51db3] received 2024-07-04T03:15:01.162654012Z [2024-07-04 03:15:01,162: INFO/ForkPoolWorker-16] [2d17674c-d1dc-4b00-9ff7-512042ecc799] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:15:01.163598551Z [2024-07-04 03:15:01,163: INFO/ForkPoolWorker-1] [1dd5c179-48ef-4548-a0ab-add47ac51db3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:15:01.168047712Z [2024-07-04 03:15:01,167: INFO/ForkPoolWorker-15] [0bc35a45-158d-499d-b205-607efb8be3af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:01.554613755Z [2024-07-04 03:15:01,549: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:15:01.593402805Z [2024-07-04 03:15:01,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:15:01.613528548Z [2024-07-04 03:15:01,608: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:15:02.905934038Z [2024-07-04 03:15:02,905: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:15:02.909932522Z [2024-07-04 03:15:02,909: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:02.930976977Z [2024-07-04 03:15:02,930: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:15:02.933262174Z [2024-07-04 03:15:02,932: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:15:02.934588472Z [2024-07-04 03:15:02,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:02.937593285Z [2024-07-04 03:15:02,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:02.948994278Z [2024-07-04 03:15:02,948: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:15:02.951215670Z [2024-07-04 03:15:02,950: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:02.951357179Z [2024-07-04 03:15:02,951: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:02.951551730Z [2024-07-04 03:15:02,951: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:02.952978038Z [2024-07-04 03:15:02,952: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:15:02.954256195Z [2024-07-04 03:15:02,953: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:15:02.955645979Z [2024-07-04 03:15:02,955: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:02.974921740Z [2024-07-04 03:15:02,974: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:15:02.977678213Z [2024-07-04 03:15:02,977: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:02.977839419Z [2024-07-04 03:15:02,977: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:02.978069885Z [2024-07-04 03:15:02,977: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:02.983871623Z [2024-07-04 03:15:02,983: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:15:02.986046926Z [2024-07-04 03:15:02,985: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:15:02.986067845Z [2024-07-04 03:15:02,985: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:15:02.986197865Z [2024-07-04 03:15:02,986: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:02.989231039Z [2024-07-04 03:15:02,988: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:02.989270460Z [2024-07-04 03:15:02,989: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:02.989420198Z [2024-07-04 03:15:02,989: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:02.989464175Z [2024-07-04 03:15:02,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:15:02.989687847Z [2024-07-04 03:15:02,989: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:15:02.989715084Z [2024-07-04 03:15:02,989: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:03.085617387Z [2024-07-04 03:15:03,085: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:03.102070509Z [2024-07-04 03:15:03,101: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:03.122654073Z [2024-07-04 03:15:03,122: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:03.839217288Z [2024-07-04 03:15:03,838: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0bc35a45-158d-499d-b205-607efb8be3af] succeeded in 2.701982481000414s: None 2024-07-04T03:15:04.273543353Z [2024-07-04 03:15:04,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6e6649a-4e7d-4684-bf57-d4050c95193b] received 2024-07-04T03:15:04.285789578Z [2024-07-04 03:15:04,285: INFO/ForkPoolWorker-15] [f6e6649a-4e7d-4684-bf57-d4050c95193b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:04.554423759Z [2024-07-04 03:15:04,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:15:04.809040474Z [2024-07-04 03:15:04,808: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d17674c-d1dc-4b00-9ff7-512042ecc799] succeeded in 3.6679200239996135s: None 2024-07-04T03:15:05.293776416Z [2024-07-04 03:15:05,293: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1dd5c179-48ef-4548-a0ab-add47ac51db3] succeeded in 4.144667917999868s: None 2024-07-04T03:15:05.752433076Z [2024-07-04 03:15:05,752: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:15:05.755597959Z [2024-07-04 03:15:05,755: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:05.784586660Z [2024-07-04 03:15:05,784: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:15:05.789080480Z [2024-07-04 03:15:05,786: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:05.789309504Z [2024-07-04 03:15:05,786: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:05.789819441Z [2024-07-04 03:15:05,789: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:05.789941371Z [2024-07-04 03:15:05,789: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:15:05.790785503Z [2024-07-04 03:15:05,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:15:05.791034031Z [2024-07-04 03:15:05,790: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:05.890396451Z [2024-07-04 03:15:05,888: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:06.595720408Z [2024-07-04 03:15:06,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f6e6649a-4e7d-4684-bf57-d4050c95193b] succeeded in 2.318024336000235s: None 2024-07-04T03:15:07.110327076Z [2024-07-04 03:15:07,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[812cb2e8-940d-4619-a289-c55572364f65] received 2024-07-04T03:15:07.122832826Z [2024-07-04 03:15:07,122: INFO/ForkPoolWorker-15] [812cb2e8-940d-4619-a289-c55572364f65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:15:07.443810025Z [2024-07-04 03:15:07,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:15:08.570708025Z [2024-07-04 03:15:08,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:15:08.573973055Z [2024-07-04 03:15:08,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:08.607225667Z [2024-07-04 03:15:08,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:15:08.611057123Z [2024-07-04 03:15:08,610: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:08.611383202Z [2024-07-04 03:15:08,610: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:08.623999860Z [2024-07-04 03:15:08,611: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:08.624024504Z [2024-07-04 03:15:08,623: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:15:08.624520624Z [2024-07-04 03:15:08,623: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:15:08.624532503Z [2024-07-04 03:15:08,624: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:08.751653504Z [2024-07-04 03:15:08,751: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:10.547698983Z [2024-07-04 03:15:10,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[812cb2e8-940d-4619-a289-c55572364f65] succeeded in 3.434654923999915s: None 2024-07-04T03:15:11.516923704Z [2024-07-04 03:15:11,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f32ced7a-7583-439b-a824-08d3a1b3c365] received 2024-07-04T03:15:11.528396085Z [2024-07-04 03:15:11,528: INFO/ForkPoolWorker-15] [f32ced7a-7583-439b-a824-08d3a1b3c365] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:15:11.822642942Z [2024-07-04 03:15:11,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:15:13.026211783Z [2024-07-04 03:15:13,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:15:13.029328533Z [2024-07-04 03:15:13,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:15:13.050731070Z [2024-07-04 03:15:13,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:15:13.053472679Z [2024-07-04 03:15:13,053: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:15:13.053620582Z [2024-07-04 03:15:13,053: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:15:13.053808547Z [2024-07-04 03:15:13,053: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:15:13.053911201Z [2024-07-04 03:15:13,053: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:15:13.054952556Z [2024-07-04 03:15:13,054: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:15:13.055095292Z [2024-07-04 03:15:13,054: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:15:13.165119300Z [2024-07-04 03:15:13,164: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:15:13.831298263Z [2024-07-04 03:15:13,830: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f32ced7a-7583-439b-a824-08d3a1b3c365] succeeded in 2.3122798129998046s: None 2024-07-04T03:16:01.211962831Z [2024-07-04 03:16:01,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d146f276-42ec-4893-8bcb-6ac695021f65] received 2024-07-04T03:16:01.214558384Z [2024-07-04 03:16:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43e70f6d-934f-4e66-8966-7af98a15772a] received 2024-07-04T03:16:01.228760058Z [2024-07-04 03:16:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f45b005-3264-4568-8eeb-e396a6aa8c2f] received 2024-07-04T03:16:01.236091935Z [2024-07-04 03:16:01,235: INFO/ForkPoolWorker-16] [43e70f6d-934f-4e66-8966-7af98a15772a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:16:01.238747330Z [2024-07-04 03:16:01,238: INFO/ForkPoolWorker-15] [d146f276-42ec-4893-8bcb-6ac695021f65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:16:01.242162818Z [2024-07-04 03:16:01,241: INFO/ForkPoolWorker-1] [0f45b005-3264-4568-8eeb-e396a6aa8c2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:16:01.523069753Z [2024-07-04 03:16:01,512: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:16:01.645744086Z [2024-07-04 03:16:01,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:16:01.788434765Z [2024-07-04 03:16:01,788: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:16:01.817989703Z [2024-07-04 03:16:01,807: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:16:02.552937600Z [2024-07-04 03:16:02,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[43e70f6d-934f-4e66-8966-7af98a15772a] succeeded in 1.336449114000061s: None 2024-07-04T03:16:03.171796822Z [2024-07-04 03:16:03,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:16:03.175556241Z [2024-07-04 03:16:03,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:16:03.193932778Z [2024-07-04 03:16:03,193: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:16:03.197150593Z [2024-07-04 03:16:03,196: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:16:03.219396149Z [2024-07-04 03:16:03,219: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:16:03.223009048Z [2024-07-04 03:16:03,220: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:16:03.223257599Z [2024-07-04 03:16:03,223: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:16:03.223404799Z [2024-07-04 03:16:03,223: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:16:03.223456977Z [2024-07-04 03:16:03,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:16:03.223760917Z [2024-07-04 03:16:03,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:16:03.223821879Z [2024-07-04 03:16:03,223: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:16:03.241300509Z [2024-07-04 03:16:03,241: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:16:03.242781484Z [2024-07-04 03:16:03,242: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:16:03.242949166Z [2024-07-04 03:16:03,242: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:16:03.243713112Z [2024-07-04 03:16:03,242: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:16:03.244862030Z [2024-07-04 03:16:03,244: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:16:03.245589339Z [2024-07-04 03:16:03,245: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:16:03.246412130Z [2024-07-04 03:16:03,246: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:16:03.314110541Z [2024-07-04 03:16:03,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:16:03.330316708Z [2024-07-04 03:16:03,330: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:16:05.116747092Z [2024-07-04 03:16:05,116: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0f45b005-3264-4568-8eeb-e396a6aa8c2f] succeeded in 3.884666253999967s: None 2024-07-04T03:16:05.600031818Z [2024-07-04 03:16:05,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d146f276-42ec-4893-8bcb-6ac695021f65] succeeded in 4.385089186999721s: None 2024-07-04T03:17:01.055864589Z [2024-07-04 03:17:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e934f59c-0839-4e7b-9a95-2605b42e356d] received 2024-07-04T03:17:01.061517447Z [2024-07-04 03:17:01,061: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d791630f-8143-4765-9b7a-167329413ad2] received 2024-07-04T03:17:01.070511066Z [2024-07-04 03:17:01,070: INFO/ForkPoolWorker-15] [e934f59c-0839-4e7b-9a95-2605b42e356d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:17:01.086291425Z [2024-07-04 03:17:01,085: INFO/ForkPoolWorker-16] [d791630f-8143-4765-9b7a-167329413ad2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:17:01.381156202Z [2024-07-04 03:17:01,377: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:17:01.414207359Z [2024-07-04 03:17:01,410: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:17:02.727353615Z [2024-07-04 03:17:02,726: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:17:02.730543847Z [2024-07-04 03:17:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:17:02.744437539Z [2024-07-04 03:17:02,744: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:17:02.747694595Z [2024-07-04 03:17:02,747: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:17:02.762583754Z [2024-07-04 03:17:02,762: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:17:02.763789796Z [2024-07-04 03:17:02,763: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:17:02.763944661Z [2024-07-04 03:17:02,763: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:17:02.764176503Z [2024-07-04 03:17:02,763: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:17:02.764308106Z [2024-07-04 03:17:02,764: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:17:02.764725302Z [2024-07-04 03:17:02,764: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:17:02.764863354Z [2024-07-04 03:17:02,764: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:17:02.774909605Z [2024-07-04 03:17:02,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:17:02.777550506Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:17:02.777587764Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:17:02.777722484Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:17:02.777795907Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:17:02.778001037Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:17:02.778019851Z [2024-07-04 03:17:02,777: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:17:02.841921508Z [2024-07-04 03:17:02,841: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:17:02.878484160Z [2024-07-04 03:17:02,878: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:17:04.657473674Z [2024-07-04 03:17:04,653: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e934f59c-0839-4e7b-9a95-2605b42e356d] succeeded in 3.595193363999897s: None 2024-07-04T03:17:05.546964507Z [2024-07-04 03:17:05,546: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d791630f-8143-4765-9b7a-167329413ad2] succeeded in 4.481776909000473s: None 2024-07-04T03:18:01.021459277Z [2024-07-04 03:18:01,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67dee14d-1250-41bd-bf19-e90a81751805] received 2024-07-04T03:18:01.027722455Z [2024-07-04 03:18:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6267c0a2-6e87-427f-a780-74346ddd0399] received 2024-07-04T03:18:01.040811859Z [2024-07-04 03:18:01,040: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3de8f48-f7de-4e4f-bcdc-a00e190a87e1] received 2024-07-04T03:18:01.043783683Z [2024-07-04 03:18:01,043: INFO/ForkPoolWorker-15] [67dee14d-1250-41bd-bf19-e90a81751805] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:18:01.043822591Z [2024-07-04 03:18:01,043: INFO/ForkPoolWorker-16] [6267c0a2-6e87-427f-a780-74346ddd0399] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:18:01.069353222Z [2024-07-04 03:18:01,068: INFO/ForkPoolWorker-1] [a3de8f48-f7de-4e4f-bcdc-a00e190a87e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:18:01.366461153Z [2024-07-04 03:18:01,361: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:18:01.451668949Z [2024-07-04 03:18:01,447: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:18:01.483731174Z [2024-07-04 03:18:01,477: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:18:01.665408345Z [2024-07-04 03:18:01,665: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:18:02.285341205Z [2024-07-04 03:18:02,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67dee14d-1250-41bd-bf19-e90a81751805] succeeded in 1.2591840880004384s: None 2024-07-04T03:18:02.737098064Z [2024-07-04 03:18:02,736: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:18:02.740359712Z [2024-07-04 03:18:02,739: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:18:02.771991435Z [2024-07-04 03:18:02,771: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:18:02.773371145Z [2024-07-04 03:18:02,773: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:18:02.773493458Z [2024-07-04 03:18:02,773: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:18:02.773692016Z [2024-07-04 03:18:02,773: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:18:02.773797230Z [2024-07-04 03:18:02,773: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:18:02.774097839Z [2024-07-04 03:18:02,773: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:18:02.774231498Z [2024-07-04 03:18:02,774: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:18:02.839941836Z [2024-07-04 03:18:02,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:18:02.843356579Z [2024-07-04 03:18:02,842: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:18:02.856900400Z [2024-07-04 03:18:02,856: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:18:02.875566349Z [2024-07-04 03:18:02,875: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:18:02.878497303Z [2024-07-04 03:18:02,878: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:18:02.878706006Z [2024-07-04 03:18:02,878: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:18:02.878995860Z [2024-07-04 03:18:02,878: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:18:02.879013623Z [2024-07-04 03:18:02,878: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:18:02.879849816Z [2024-07-04 03:18:02,879: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:18:02.879895725Z [2024-07-04 03:18:02,879: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:18:02.970524411Z [2024-07-04 03:18:02,970: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:18:04.965854119Z [2024-07-04 03:18:04,965: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a3de8f48-f7de-4e4f-bcdc-a00e190a87e1] succeeded in 3.9190660559997923s: None 2024-07-04T03:18:05.019771591Z [2024-07-04 03:18:05,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6267c0a2-6e87-427f-a780-74346ddd0399] succeeded in 3.987880912000037s: None 2024-07-04T03:19:00.317817549Z [2024-07-04 03:19:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77cb8daf-7044-4038-aac8-c6ce0a2f2ba6] received 2024-07-04T03:19:00.322517320Z [2024-07-04 03:19:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[817128c1-1e5c-46b7-90de-d3b0d5d0b9d4] received 2024-07-04T03:19:00.335630441Z [2024-07-04 03:19:00,335: INFO/ForkPoolWorker-15] [77cb8daf-7044-4038-aac8-c6ce0a2f2ba6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:19:00.342037603Z [2024-07-04 03:19:00,341: INFO/ForkPoolWorker-16] [817128c1-1e5c-46b7-90de-d3b0d5d0b9d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:19:00.683832957Z [2024-07-04 03:19:00,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:19:00.763200443Z [2024-07-04 03:19:00,759: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:19:01.983683462Z [2024-07-04 03:19:01,983: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:19:01.987145621Z [2024-07-04 03:19:01,986: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:19:02.041248151Z [2024-07-04 03:19:02,040: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:19:02.042683846Z [2024-07-04 03:19:02,042: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:19:02.042839459Z [2024-07-04 03:19:02,042: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:19:02.043144540Z [2024-07-04 03:19:02,042: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:19:02.043295031Z [2024-07-04 03:19:02,043: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:19:02.043627599Z [2024-07-04 03:19:02,043: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:19:02.043788209Z [2024-07-04 03:19:02,043: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:19:02.122271587Z [2024-07-04 03:19:02,121: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:19:02.270434573Z [2024-07-04 03:19:02,269: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:19:02.273581291Z [2024-07-04 03:19:02,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:19:02.296154198Z [2024-07-04 03:19:02,295: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:19:02.298957133Z [2024-07-04 03:19:02,298: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:19:02.299110722Z [2024-07-04 03:19:02,298: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:19:02.299176208Z [2024-07-04 03:19:02,299: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:19:02.299259800Z [2024-07-04 03:19:02,299: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:19:02.299528445Z [2024-07-04 03:19:02,299: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:19:02.299597979Z [2024-07-04 03:19:02,299: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:19:02.373755955Z [2024-07-04 03:19:02,373: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:19:03.645052550Z [2024-07-04 03:19:03,644: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77cb8daf-7044-4038-aac8-c6ce0a2f2ba6] succeeded in 3.324299570999756s: None 2024-07-04T03:19:04.257066916Z [2024-07-04 03:19:04,256: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[817128c1-1e5c-46b7-90de-d3b0d5d0b9d4] succeeded in 3.928749300000163s: None 2024-07-04T03:20:00.875707048Z [2024-07-04 03:20:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd1beb25-d88f-4de1-9199-ec18f03a58eb] received 2024-07-04T03:20:00.889424268Z [2024-07-04 03:20:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13008b32-1726-4f11-a20c-85ddf58daf02] received 2024-07-04T03:20:00.897870504Z [2024-07-04 03:20:00,897: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66f34780-7291-4560-bae7-fbd95b9def2e] received 2024-07-04T03:20:00.899964195Z [2024-07-04 03:20:00,899: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da56d930-ed9f-401c-b950-6b7616e5f6ec] received 2024-07-04T03:20:00.908585232Z [2024-07-04 03:20:00,907: INFO/ForkPoolWorker-15] [cd1beb25-d88f-4de1-9199-ec18f03a58eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:00.919487332Z [2024-07-04 03:20:00,919: INFO/ForkPoolWorker-1] [66f34780-7291-4560-bae7-fbd95b9def2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:20:00.922153050Z [2024-07-04 03:20:00,921: INFO/ForkPoolWorker-2] [da56d930-ed9f-401c-b950-6b7616e5f6ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:20:00.941292675Z [2024-07-04 03:20:00,940: INFO/ForkPoolWorker-16] [13008b32-1726-4f11-a20c-85ddf58daf02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:20:01.252031443Z [2024-07-04 03:20:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:20:01.330399852Z [2024-07-04 03:20:01,325: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:20:01.515725162Z [2024-07-04 03:20:01,511: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:20:01.581347118Z [2024-07-04 03:20:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:20:02.002573772Z [2024-07-04 03:20:02,002: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:02.753012943Z [2024-07-04 03:20:02,752: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:20:02.756536262Z [2024-07-04 03:20:02,756: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:02.797113799Z [2024-07-04 03:20:02,796: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66f34780-7291-4560-bae7-fbd95b9def2e] succeeded in 1.893920156000604s: None 2024-07-04T03:20:02.805995538Z [2024-07-04 03:20:02,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:20:02.807221864Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:02.807263225Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:02.807407850Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:02.807514764Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:20:02.807813119Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:20:02.807827686Z [2024-07-04 03:20:02,807: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:02.889561211Z [2024-07-04 03:20:02,889: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:03.172018338Z [2024-07-04 03:20:03,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:20:03.176106840Z [2024-07-04 03:20:03,175: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:03.206486687Z [2024-07-04 03:20:03,206: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T03:20:03.210144610Z [2024-07-04 03:20:03,209: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:03.214945535Z [2024-07-04 03:20:03,214: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:20:03.218102703Z [2024-07-04 03:20:03,216: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:03.218474427Z [2024-07-04 03:20:03,218: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:03.218992825Z [2024-07-04 03:20:03,218: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:03.219297331Z [2024-07-04 03:20:03,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:20:03.220611477Z [2024-07-04 03:20:03,220: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:20:03.221437378Z [2024-07-04 03:20:03,221: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:03.267276665Z [2024-07-04 03:20:03,267: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T03:20:03.275863533Z [2024-07-04 03:20:03,275: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:03.277239207Z [2024-07-04 03:20:03,276: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:03.277374296Z [2024-07-04 03:20:03,277: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:03.277444665Z [2024-07-04 03:20:03,277: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T03:20:03.277822934Z [2024-07-04 03:20:03,277: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:20:03.277862563Z [2024-07-04 03:20:03,277: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:03.355020962Z [2024-07-04 03:20:03,354: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:03.395147692Z [2024-07-04 03:20:03,394: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:03.999294626Z [2024-07-04 03:20:03,998: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd1beb25-d88f-4de1-9199-ec18f03a58eb] succeeded in 3.1189058689997182s: None 2024-07-04T03:20:04.518071799Z [2024-07-04 03:20:04,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8cdfb0f-10d2-4e82-b79d-31181b6d8269] received 2024-07-04T03:20:04.528296958Z [2024-07-04 03:20:04,527: INFO/ForkPoolWorker-15] [f8cdfb0f-10d2-4e82-b79d-31181b6d8269] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:04.868357130Z [2024-07-04 03:20:04,867: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[13008b32-1726-4f11-a20c-85ddf58daf02] succeeded in 3.968239181000172s: None 2024-07-04T03:20:04.918062477Z [2024-07-04 03:20:04,914: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:20:05.091676299Z [2024-07-04 03:20:05,091: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da56d930-ed9f-401c-b950-6b7616e5f6ec] succeeded in 4.184415128999717s: None 2024-07-04T03:20:06.091061974Z [2024-07-04 03:20:06,090: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:20:06.094426203Z [2024-07-04 03:20:06,093: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:06.119034569Z [2024-07-04 03:20:06,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:20:06.120568606Z [2024-07-04 03:20:06,120: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:06.120590408Z [2024-07-04 03:20:06,120: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:06.120609582Z [2024-07-04 03:20:06,120: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:06.120676483Z [2024-07-04 03:20:06,120: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:20:06.121538409Z [2024-07-04 03:20:06,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:20:06.121566457Z [2024-07-04 03:20:06,121: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:06.211694642Z [2024-07-04 03:20:06,211: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:07.016999086Z [2024-07-04 03:20:07,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8cdfb0f-10d2-4e82-b79d-31181b6d8269] succeeded in 2.496931558000142s: None 2024-07-04T03:20:07.282645830Z [2024-07-04 03:20:07,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[822248b0-22bc-44f3-90ee-dba733799830] received 2024-07-04T03:20:07.295714507Z [2024-07-04 03:20:07,295: INFO/ForkPoolWorker-15] [822248b0-22bc-44f3-90ee-dba733799830] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:20:07.640468605Z [2024-07-04 03:20:07,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:20:08.856860849Z [2024-07-04 03:20:08,856: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:20:08.862273656Z [2024-07-04 03:20:08,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:08.904718043Z [2024-07-04 03:20:08,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:20:08.906133188Z [2024-07-04 03:20:08,905: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:08.906230471Z [2024-07-04 03:20:08,906: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:08.906494251Z [2024-07-04 03:20:08,906: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:08.906594288Z [2024-07-04 03:20:08,906: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:20:08.907083409Z [2024-07-04 03:20:08,906: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:20:08.907277995Z [2024-07-04 03:20:08,906: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:08.994367323Z [2024-07-04 03:20:08,994: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:10.584937849Z [2024-07-04 03:20:10,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d887c24-7aa8-4af3-91aa-9d5f32765ff4] received 2024-07-04T03:20:10.608964502Z [2024-07-04 03:20:10,608: INFO/ForkPoolWorker-16] [3d887c24-7aa8-4af3-91aa-9d5f32765ff4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:20:10.650206184Z [2024-07-04 03:20:10,649: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[822248b0-22bc-44f3-90ee-dba733799830] succeeded in 3.3638260759998957s: None 2024-07-04T03:20:10.943255362Z [2024-07-04 03:20:10,939: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:20:12.095616854Z [2024-07-04 03:20:12,095: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:20:12.098924834Z [2024-07-04 03:20:12,098: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:20:12.134352515Z [2024-07-04 03:20:12,134: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:20:12.136158191Z [2024-07-04 03:20:12,135: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:20:12.136174910Z [2024-07-04 03:20:12,136: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:20:12.136326782Z [2024-07-04 03:20:12,136: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:20:12.136343933Z [2024-07-04 03:20:12,136: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:20:12.137835531Z [2024-07-04 03:20:12,137: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:20:12.137854351Z [2024-07-04 03:20:12,137: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:20:12.239456752Z [2024-07-04 03:20:12,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:20:12.924906387Z [2024-07-04 03:20:12,924: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3d887c24-7aa8-4af3-91aa-9d5f32765ff4] succeeded in 2.333584671000608s: None 2024-07-04T03:21:00.322989580Z [2024-07-04 03:21:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a225b9ef-5f0a-41c3-8f1c-46061fab48e0] received 2024-07-04T03:21:00.339359843Z [2024-07-04 03:21:00,338: INFO/ForkPoolWorker-15] [a225b9ef-5f0a-41c3-8f1c-46061fab48e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:21:00.345565923Z [2024-07-04 03:21:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[947cd3f5-2130-4589-9964-6491cb879f0c] received 2024-07-04T03:21:00.383302493Z [2024-07-04 03:21:00,380: INFO/ForkPoolWorker-16] [947cd3f5-2130-4589-9964-6491cb879f0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:21:00.660334598Z [2024-07-04 03:21:00,656: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:21:00.788295830Z [2024-07-04 03:21:00,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:21:01.829356705Z [2024-07-04 03:21:01,828: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:21:01.832654671Z [2024-07-04 03:21:01,832: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:21:01.923115493Z [2024-07-04 03:21:01,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:21:01.924524711Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:21:01.924562140Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:21:01.924663216Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:21:01.924719469Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:21:01.924946366Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:21:01.924975366Z [2024-07-04 03:21:01,924: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:21:02.021350651Z [2024-07-04 03:21:02,020: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:21:02.218188726Z [2024-07-04 03:21:02,217: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:21:02.221324229Z [2024-07-04 03:21:02,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:21:02.253045693Z [2024-07-04 03:21:02,252: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:21:02.254353458Z [2024-07-04 03:21:02,254: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:21:02.254425741Z [2024-07-04 03:21:02,254: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:21:02.254579605Z [2024-07-04 03:21:02,254: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:21:02.254730983Z [2024-07-04 03:21:02,254: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:21:02.255359361Z [2024-07-04 03:21:02,255: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:21:02.255414209Z [2024-07-04 03:21:02,255: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:21:02.372531999Z [2024-07-04 03:21:02,372: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:21:03.517012620Z [2024-07-04 03:21:03,516: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a225b9ef-5f0a-41c3-8f1c-46061fab48e0] succeeded in 3.1905675669995617s: None 2024-07-04T03:21:04.530299188Z [2024-07-04 03:21:04,529: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[947cd3f5-2130-4589-9964-6491cb879f0c] succeeded in 4.180661330000476s: None 2024-07-04T03:22:00.231823728Z [2024-07-04 03:22:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6de94269-f649-46ed-9878-d9587eba4f53] received 2024-07-04T03:22:00.246129827Z [2024-07-04 03:22:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f944da5d-0de6-4e7d-9c27-1c7b8a0698c7] received 2024-07-04T03:22:00.253057323Z [2024-07-04 03:22:00,252: INFO/ForkPoolWorker-15] [6de94269-f649-46ed-9878-d9587eba4f53] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:22:00.264441272Z [2024-07-04 03:22:00,264: INFO/ForkPoolWorker-16] [f944da5d-0de6-4e7d-9c27-1c7b8a0698c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:22:00.303377425Z [2024-07-04 03:22:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[448b2916-4e33-4082-8b79-7ff30f0c92ee] received 2024-07-04T03:22:00.340025836Z [2024-07-04 03:22:00,339: INFO/ForkPoolWorker-1] [448b2916-4e33-4082-8b79-7ff30f0c92ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:22:00.748641303Z [2024-07-04 03:22:00,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:22:00.829193032Z [2024-07-04 03:22:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:22:00.980757961Z [2024-07-04 03:22:00,968: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:22:01.311138337Z [2024-07-04 03:22:01,310: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:22:02.003161689Z [2024-07-04 03:22:01,999: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6de94269-f649-46ed-9878-d9587eba4f53] succeeded in 1.76623557899984s: None 2024-07-04T03:22:02.137301934Z [2024-07-04 03:22:02,136: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:22:02.143013059Z [2024-07-04 03:22:02,140: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:22:02.170447422Z [2024-07-04 03:22:02,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:22:02.172220106Z [2024-07-04 03:22:02,171: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:22:02.172289069Z [2024-07-04 03:22:02,172: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:22:02.172492945Z [2024-07-04 03:22:02,172: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:22:02.172699368Z [2024-07-04 03:22:02,172: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:22:02.173049128Z [2024-07-04 03:22:02,172: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:22:02.173180627Z [2024-07-04 03:22:02,173: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:22:02.260983339Z [2024-07-04 03:22:02,260: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:22:02.468374907Z [2024-07-04 03:22:02,467: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:22:02.471613713Z [2024-07-04 03:22:02,471: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:22:02.513975772Z [2024-07-04 03:22:02,513: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:22:02.517008595Z [2024-07-04 03:22:02,516: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:22:02.517040795Z [2024-07-04 03:22:02,516: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:22:02.517210035Z [2024-07-04 03:22:02,517: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:22:02.517257737Z [2024-07-04 03:22:02,517: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:22:02.517570606Z [2024-07-04 03:22:02,517: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:22:02.518153180Z [2024-07-04 03:22:02,517: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:22:02.630734118Z [2024-07-04 03:22:02,630: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:22:04.269620068Z [2024-07-04 03:22:04,268: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f944da5d-0de6-4e7d-9c27-1c7b8a0698c7] succeeded in 4.021245203000035s: None 2024-07-04T03:22:04.570406117Z [2024-07-04 03:22:04,569: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[448b2916-4e33-4082-8b79-7ff30f0c92ee] succeeded in 4.258404330999838s: None 2024-07-04T03:23:01.211373956Z [2024-07-04 03:23:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93f40fb9-47c4-4878-b68e-e32ff8d42723] received 2024-07-04T03:23:01.219034527Z [2024-07-04 03:23:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d64262a-4c49-4d1f-9877-5cf1939f782d] received 2024-07-04T03:23:01.240223592Z [2024-07-04 03:23:01,239: INFO/ForkPoolWorker-15] [93f40fb9-47c4-4878-b68e-e32ff8d42723] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:23:01.240635471Z [2024-07-04 03:23:01,240: INFO/ForkPoolWorker-16] [4d64262a-4c49-4d1f-9877-5cf1939f782d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:23:01.553645923Z [2024-07-04 03:23:01,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:23:01.588970848Z [2024-07-04 03:23:01,585: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:23:02.832610305Z [2024-07-04 03:23:02,831: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:23:02.835465730Z [2024-07-04 03:23:02,834: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:23:02.837731339Z [2024-07-04 03:23:02,837: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:23:02.841047471Z [2024-07-04 03:23:02,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:23:02.869381947Z [2024-07-04 03:23:02,869: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:23:02.871770460Z [2024-07-04 03:23:02,871: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:23:02.871994028Z [2024-07-04 03:23:02,871: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:23:02.872174350Z [2024-07-04 03:23:02,871: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:23:02.872310154Z [2024-07-04 03:23:02,872: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:23:02.872775032Z [2024-07-04 03:23:02,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:23:02.872790746Z [2024-07-04 03:23:02,872: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:23:02.881067129Z [2024-07-04 03:23:02,880: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:23:02.883299263Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:23:02.883314372Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:23:02.883520940Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:23:02.883675152Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:23:02.883966125Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:23:02.884158692Z [2024-07-04 03:23:02,883: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:23:02.958943322Z [2024-07-04 03:23:02,958: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:23:02.980244731Z [2024-07-04 03:23:02,979: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:23:04.552814848Z [2024-07-04 03:23:04,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d64262a-4c49-4d1f-9877-5cf1939f782d] succeeded in 3.3272763119994124s: None 2024-07-04T03:23:05.292407855Z [2024-07-04 03:23:05,291: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93f40fb9-47c4-4878-b68e-e32ff8d42723] succeeded in 4.0723263280005995s: None 2024-07-04T03:24:00.410965275Z [2024-07-04 03:24:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25cf65ee-d3d9-4ce3-8611-ecf0835452c7] received 2024-07-04T03:24:00.427834561Z [2024-07-04 03:24:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99d9cfe8-1261-4b07-a028-80591c80a4e9] received 2024-07-04T03:24:00.431366418Z [2024-07-04 03:24:00,431: INFO/ForkPoolWorker-15] [25cf65ee-d3d9-4ce3-8611-ecf0835452c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:24:00.438965865Z [2024-07-04 03:24:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44db49fb-5947-46e6-b832-3dddd7dbf8b8] received 2024-07-04T03:24:00.447890725Z [2024-07-04 03:24:00,447: INFO/ForkPoolWorker-16] [99d9cfe8-1261-4b07-a028-80591c80a4e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:24:00.455980071Z [2024-07-04 03:24:00,455: INFO/ForkPoolWorker-1] [44db49fb-5947-46e6-b832-3dddd7dbf8b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:24:00.805234282Z [2024-07-04 03:24:00,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:24:00.874023245Z [2024-07-04 03:24:00,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:24:01.115742352Z [2024-07-04 03:24:01,115: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:24:01.339228364Z [2024-07-04 03:24:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:24:02.008403874Z [2024-07-04 03:24:02,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25cf65ee-d3d9-4ce3-8611-ecf0835452c7] succeeded in 1.5957902870004546s: None 2024-07-04T03:24:02.401627223Z [2024-07-04 03:24:02,401: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:24:02.405096297Z [2024-07-04 03:24:02,404: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:24:02.435682309Z [2024-07-04 03:24:02,435: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:24:02.438686926Z [2024-07-04 03:24:02,438: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:24:02.440376731Z [2024-07-04 03:24:02,439: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:24:02.440517552Z [2024-07-04 03:24:02,440: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:24:02.440551661Z [2024-07-04 03:24:02,440: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:24:02.442715843Z [2024-07-04 03:24:02,442: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:24:02.442731964Z [2024-07-04 03:24:02,442: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:24:02.553443966Z [2024-07-04 03:24:02,553: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:24:02.920046041Z [2024-07-04 03:24:02,919: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:24:02.923278999Z [2024-07-04 03:24:02,922: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:24:02.955179656Z [2024-07-04 03:24:02,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:24:02.956589916Z [2024-07-04 03:24:02,956: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:24:02.956936678Z [2024-07-04 03:24:02,956: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:24:02.957174571Z [2024-07-04 03:24:02,956: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:24:02.957405889Z [2024-07-04 03:24:02,957: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:24:02.958557368Z [2024-07-04 03:24:02,958: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:24:02.958646067Z [2024-07-04 03:24:02,958: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:24:03.031895273Z [2024-07-04 03:24:03,031: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:24:04.117762507Z [2024-07-04 03:24:04,117: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[44db49fb-5947-46e6-b832-3dddd7dbf8b8] succeeded in 3.6756397500003004s: None 2024-07-04T03:24:04.935440011Z [2024-07-04 03:24:04,934: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99d9cfe8-1261-4b07-a028-80591c80a4e9] succeeded in 4.505018537000069s: None 2024-07-04T03:25:01.108662755Z [2024-07-04 03:25:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99156226-b84a-4ce1-ba53-dfbe4cb54979] received 2024-07-04T03:25:01.117181168Z [2024-07-04 03:25:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ad3fd85-12ce-409d-96b4-4b4351ba63d4] received 2024-07-04T03:25:01.120943267Z [2024-07-04 03:25:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49d3e535-d0d5-4ae5-9253-a882cb9b8182] received 2024-07-04T03:25:01.132607454Z [2024-07-04 03:25:01,132: INFO/ForkPoolWorker-15] [99156226-b84a-4ce1-ba53-dfbe4cb54979] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:01.134606129Z [2024-07-04 03:25:01,134: INFO/ForkPoolWorker-16] [2ad3fd85-12ce-409d-96b4-4b4351ba63d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:25:01.135588674Z [2024-07-04 03:25:01,135: INFO/ForkPoolWorker-1] [49d3e535-d0d5-4ae5-9253-a882cb9b8182] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:25:01.408116320Z [2024-07-04 03:25:01,404: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:25:01.452443626Z [2024-07-04 03:25:01,448: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:25:01.486095798Z [2024-07-04 03:25:01,482: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:25:02.718697722Z [2024-07-04 03:25:02,718: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:25:02.722265326Z [2024-07-04 03:25:02,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:02.735950907Z [2024-07-04 03:25:02,735: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:25:02.739450287Z [2024-07-04 03:25:02,738: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:02.754398521Z [2024-07-04 03:25:02,754: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:25:02.756915314Z [2024-07-04 03:25:02,756: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:02.757353825Z [2024-07-04 03:25:02,757: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:02.758774135Z [2024-07-04 03:25:02,757: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:02.759457395Z [2024-07-04 03:25:02,759: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:25:02.760189596Z [2024-07-04 03:25:02,759: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:25:02.760390429Z [2024-07-04 03:25:02,760: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:02.779605922Z [2024-07-04 03:25:02,779: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:25:02.782897287Z [2024-07-04 03:25:02,782: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:02.782924592Z [2024-07-04 03:25:02,782: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:02.783236911Z [2024-07-04 03:25:02,783: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:02.783311257Z [2024-07-04 03:25:02,783: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:25:02.784272805Z [2024-07-04 03:25:02,784: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:25:02.784306579Z [2024-07-04 03:25:02,784: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:02.890216769Z [2024-07-04 03:25:02,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:02.900090555Z [2024-07-04 03:25:02,899: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:02.959351341Z [2024-07-04 03:25:02,958: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:25:02.963074352Z [2024-07-04 03:25:02,962: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:03.013557379Z [2024-07-04 03:25:03,013: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:25:03.016059545Z [2024-07-04 03:25:03,015: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:03.016295850Z [2024-07-04 03:25:03,016: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:03.016639279Z [2024-07-04 03:25:03,016: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:03.016841758Z [2024-07-04 03:25:03,016: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:25:03.017302067Z [2024-07-04 03:25:03,017: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:25:03.017548143Z [2024-07-04 03:25:03,017: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:03.162791295Z [2024-07-04 03:25:03,162: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:03.686787312Z [2024-07-04 03:25:03,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99156226-b84a-4ce1-ba53-dfbe4cb54979] succeeded in 2.5743374430003314s: None 2024-07-04T03:25:04.336225871Z [2024-07-04 03:25:04,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d511c029-2a49-40e4-9929-a1ccfd4129bc] received 2024-07-04T03:25:04.348918074Z [2024-07-04 03:25:04,348: INFO/ForkPoolWorker-15] [d511c029-2a49-40e4-9929-a1ccfd4129bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:04.662112341Z [2024-07-04 03:25:04,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:25:04.850109148Z [2024-07-04 03:25:04,849: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2ad3fd85-12ce-409d-96b4-4b4351ba63d4] succeeded in 3.72695747599937s: None 2024-07-04T03:25:04.961240103Z [2024-07-04 03:25:04,960: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49d3e535-d0d5-4ae5-9253-a882cb9b8182] succeeded in 3.838395054999637s: None 2024-07-04T03:25:05.832512507Z [2024-07-04 03:25:05,832: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:25:05.836328458Z [2024-07-04 03:25:05,835: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:05.865588896Z [2024-07-04 03:25:05,865: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:25:05.867393115Z [2024-07-04 03:25:05,867: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:05.867410006Z [2024-07-04 03:25:05,867: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:05.867532468Z [2024-07-04 03:25:05,867: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:05.867619315Z [2024-07-04 03:25:05,867: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:25:05.868499835Z [2024-07-04 03:25:05,868: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:25:05.868514991Z [2024-07-04 03:25:05,868: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:05.959958580Z [2024-07-04 03:25:05,959: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:06.612403104Z [2024-07-04 03:25:06,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d511c029-2a49-40e4-9929-a1ccfd4129bc] succeeded in 2.273674043000028s: None 2024-07-04T03:25:06.756181207Z [2024-07-04 03:25:06,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d89eb5af-6ec6-4cd8-bffe-988f1eab3787] received 2024-07-04T03:25:06.763936102Z [2024-07-04 03:25:06,763: INFO/ForkPoolWorker-15] [d89eb5af-6ec6-4cd8-bffe-988f1eab3787] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:25:07.045932595Z [2024-07-04 03:25:07,042: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:25:08.124656976Z [2024-07-04 03:25:08,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:25:08.127861313Z [2024-07-04 03:25:08,127: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:08.161318793Z [2024-07-04 03:25:08,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:25:08.162933114Z [2024-07-04 03:25:08,162: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:08.163181126Z [2024-07-04 03:25:08,162: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:08.163450497Z [2024-07-04 03:25:08,163: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:08.163652198Z [2024-07-04 03:25:08,163: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:25:08.164103721Z [2024-07-04 03:25:08,163: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:25:08.164262344Z [2024-07-04 03:25:08,164: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:08.263061127Z [2024-07-04 03:25:08,262: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:09.810424764Z [2024-07-04 03:25:09,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d89eb5af-6ec6-4cd8-bffe-988f1eab3787] succeeded in 3.0498774190000404s: None 2024-07-04T03:25:09.923712121Z [2024-07-04 03:25:09,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06c70198-3c3e-4ba6-8056-0b7e65c49b1d] received 2024-07-04T03:25:09.934323284Z [2024-07-04 03:25:09,934: INFO/ForkPoolWorker-15] [06c70198-3c3e-4ba6-8056-0b7e65c49b1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:25:10.275536482Z [2024-07-04 03:25:10,272: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:25:11.460945275Z [2024-07-04 03:25:11,460: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:25:11.464232218Z [2024-07-04 03:25:11,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:25:11.498389309Z [2024-07-04 03:25:11,498: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:25:11.502698428Z [2024-07-04 03:25:11,502: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:25:11.503020651Z [2024-07-04 03:25:11,502: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:25:11.503464092Z [2024-07-04 03:25:11,503: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:25:11.503616979Z [2024-07-04 03:25:11,503: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:25:11.503949297Z [2024-07-04 03:25:11,503: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:25:11.504058387Z [2024-07-04 03:25:11,503: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:25:11.582788212Z [2024-07-04 03:25:11,582: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:25:12.247431683Z [2024-07-04 03:25:12,247: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[06c70198-3c3e-4ba6-8056-0b7e65c49b1d] succeeded in 2.320609811000395s: None 2024-07-04T03:26:00.226662671Z [2024-07-04 03:26:00,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2935b8e2-fef5-4265-8f71-c5965c193c9c] received 2024-07-04T03:26:00.259996571Z [2024-07-04 03:26:00,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9b65f70-a7c3-4357-a8aa-df67d1535640] received 2024-07-04T03:26:00.288841052Z [2024-07-04 03:26:00,288: INFO/ForkPoolWorker-16] [e9b65f70-a7c3-4357-a8aa-df67d1535640] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:26:00.295196960Z [2024-07-04 03:26:00,290: INFO/ForkPoolWorker-15] [2935b8e2-fef5-4265-8f71-c5965c193c9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:26:00.326395577Z [2024-07-04 03:26:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3abb20ac-d726-4fd2-b175-490c578ecc7f] received 2024-07-04T03:26:00.367779819Z [2024-07-04 03:26:00,367: INFO/ForkPoolWorker-1] [3abb20ac-d726-4fd2-b175-490c578ecc7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:26:00.717050896Z [2024-07-04 03:26:00,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:26:00.934913773Z [2024-07-04 03:26:00,930: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:26:00.965980477Z [2024-07-04 03:26:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:26:01.095151553Z [2024-07-04 03:26:01,093: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:26:02.206461676Z [2024-07-04 03:26:02,205: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2935b8e2-fef5-4265-8f71-c5965c193c9c] succeeded in 1.9701862780002557s: None 2024-07-04T03:26:02.361035639Z [2024-07-04 03:26:02,360: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:26:02.365193549Z [2024-07-04 03:26:02,364: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:26:02.396230053Z [2024-07-04 03:26:02,396: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:26:02.397485495Z [2024-07-04 03:26:02,397: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:26:02.397592830Z [2024-07-04 03:26:02,397: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:26:02.397770263Z [2024-07-04 03:26:02,397: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:26:02.397879424Z [2024-07-04 03:26:02,397: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:26:02.398490697Z [2024-07-04 03:26:02,398: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:26:02.398640265Z [2024-07-04 03:26:02,398: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:26:02.419083772Z [2024-07-04 03:26:02,418: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:26:02.422708118Z [2024-07-04 03:26:02,422: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:26:02.460676492Z [2024-07-04 03:26:02,460: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:26:02.463566203Z [2024-07-04 03:26:02,463: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:26:02.463935438Z [2024-07-04 03:26:02,463: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:26:02.468596049Z [2024-07-04 03:26:02,468: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:26:02.468869979Z [2024-07-04 03:26:02,468: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:26:02.469269155Z [2024-07-04 03:26:02,469: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:26:02.469458721Z [2024-07-04 03:26:02,469: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:26:02.479532738Z [2024-07-04 03:26:02,479: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:26:02.564622161Z [2024-07-04 03:26:02,564: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:26:04.089890506Z [2024-07-04 03:26:04,089: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3abb20ac-d726-4fd2-b175-490c578ecc7f] succeeded in 3.760783380000248s: None 2024-07-04T03:26:04.389919328Z [2024-07-04 03:26:04,389: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9b65f70-a7c3-4357-a8aa-df67d1535640] succeeded in 4.116930482000498s: None 2024-07-04T03:26:36.735534107Z [2024-07-04 03:26:36,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66e06dfd-fc17-4cc3-ba84-3271092f825d] received 2024-07-04T03:26:36.748516868Z [2024-07-04 03:26:36,748: INFO/ForkPoolWorker-15] [66e06dfd-fc17-4cc3-ba84-3271092f825d] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704032636_200085', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:26:37.018320848Z [2024-07-04 03:26:37,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-07-04T03:26:37.346689954Z [2024-07-04 03:26:37,346: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:26:38.052390087Z [2024-07-04 03:26:38,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66e06dfd-fc17-4cc3-ba84-3271092f825d] succeeded in 1.313759387000573s: None 2024-07-04T03:27:00.231862608Z [2024-07-04 03:27:00,231: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d06a5a8-64d4-4046-a89f-0eaf6aaab71e] received 2024-07-04T03:27:00.243611110Z [2024-07-04 03:27:00,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5eea59aa-3cc1-48dd-901b-846445d83646] received 2024-07-04T03:27:00.247061254Z [2024-07-04 03:27:00,246: INFO/ForkPoolWorker-15] [2d06a5a8-64d4-4046-a89f-0eaf6aaab71e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:27:00.255412978Z [2024-07-04 03:27:00,255: INFO/ForkPoolWorker-16] [5eea59aa-3cc1-48dd-901b-846445d83646] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:27:00.637664414Z [2024-07-04 03:27:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:27:00.715487591Z [2024-07-04 03:27:00,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:27:02.091678946Z [2024-07-04 03:27:02,091: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:27:02.095975965Z [2024-07-04 03:27:02,094: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:27:02.125352921Z [2024-07-04 03:27:02,124: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:27:02.127217454Z [2024-07-04 03:27:02,126: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:27:02.127333703Z [2024-07-04 03:27:02,127: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:27:02.127518720Z [2024-07-04 03:27:02,127: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:27:02.127621796Z [2024-07-04 03:27:02,127: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:27:02.127946798Z [2024-07-04 03:27:02,127: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:27:02.128053754Z [2024-07-04 03:27:02,127: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:27:02.161354433Z [2024-07-04 03:27:02,160: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:27:02.167816035Z [2024-07-04 03:27:02,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:27:02.230934928Z [2024-07-04 03:27:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:27:02.232185496Z [2024-07-04 03:27:02,231: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:27:02.232306484Z [2024-07-04 03:27:02,232: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:27:02.232514258Z [2024-07-04 03:27:02,232: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:27:02.232689838Z [2024-07-04 03:27:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:27:02.233036034Z [2024-07-04 03:27:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:27:02.233611554Z [2024-07-04 03:27:02,232: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:27:02.249964916Z [2024-07-04 03:27:02,249: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:27:02.369034749Z [2024-07-04 03:27:02,368: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:27:03.888466170Z [2024-07-04 03:27:03,887: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d06a5a8-64d4-4046-a89f-0eaf6aaab71e] succeeded in 3.651484557999538s: None 2024-07-04T03:27:04.223502121Z [2024-07-04 03:27:04,222: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5eea59aa-3cc1-48dd-901b-846445d83646] succeeded in 3.9775440290004553s: None 2024-07-04T03:28:01.253431999Z [2024-07-04 03:28:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fcf9ac6-48c2-410f-9e0e-a01cc2205b53] received 2024-07-04T03:28:01.260286400Z [2024-07-04 03:28:01,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83118b8f-0646-4f86-b63f-04e041b09fda] received 2024-07-04T03:28:01.268137951Z [2024-07-04 03:28:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28618fab-5703-449d-bda4-e5f6ad1b1486] received 2024-07-04T03:28:01.285815478Z [2024-07-04 03:28:01,284: INFO/ForkPoolWorker-16] [83118b8f-0646-4f86-b63f-04e041b09fda] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:28:01.289107737Z [2024-07-04 03:28:01,287: INFO/ForkPoolWorker-15] [5fcf9ac6-48c2-410f-9e0e-a01cc2205b53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:28:01.307014402Z [2024-07-04 03:28:01,306: INFO/ForkPoolWorker-1] [28618fab-5703-449d-bda4-e5f6ad1b1486] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:28:01.621819686Z [2024-07-04 03:28:01,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:28:01.716936277Z [2024-07-04 03:28:01,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:28:01.743934937Z [2024-07-04 03:28:01,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:28:01.931612149Z [2024-07-04 03:28:01,931: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:28:02.537325954Z [2024-07-04 03:28:02,536: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83118b8f-0646-4f86-b63f-04e041b09fda] succeeded in 1.2739590110004428s: None 2024-07-04T03:28:03.043210778Z [2024-07-04 03:28:03,042: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:28:03.046812476Z [2024-07-04 03:28:03,046: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:28:03.083355983Z [2024-07-04 03:28:03,083: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:28:03.086922582Z [2024-07-04 03:28:03,086: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:28:03.087434111Z [2024-07-04 03:28:03,087: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:28:03.087868560Z [2024-07-04 03:28:03,087: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:28:03.087912800Z [2024-07-04 03:28:03,087: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:28:03.088383163Z [2024-07-04 03:28:03,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:28:03.088581753Z [2024-07-04 03:28:03,088: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:28:03.156575362Z [2024-07-04 03:28:03,156: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:28:03.169884191Z [2024-07-04 03:28:03,169: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:28:03.200131191Z [2024-07-04 03:28:03,199: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:28:03.208780278Z [2024-07-04 03:28:03,208: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:28:03.210200866Z [2024-07-04 03:28:03,209: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:28:03.210403970Z [2024-07-04 03:28:03,210: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:28:03.210744664Z [2024-07-04 03:28:03,210: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:28:03.210933590Z [2024-07-04 03:28:03,210: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:28:03.211232730Z [2024-07-04 03:28:03,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:28:03.211452413Z [2024-07-04 03:28:03,211: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:28:03.303062836Z [2024-07-04 03:28:03,302: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:28:05.646844659Z [2024-07-04 03:28:05,646: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28618fab-5703-449d-bda4-e5f6ad1b1486] succeeded in 4.372134874999574s: None 2024-07-04T03:28:06.128329492Z [2024-07-04 03:28:06,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fcf9ac6-48c2-410f-9e0e-a01cc2205b53] succeeded in 4.868348100999356s: None 2024-07-04T03:29:01.162329259Z [2024-07-04 03:29:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fc437a9-84d4-4369-ad33-8d8e93a42294] received 2024-07-04T03:29:01.175532121Z [2024-07-04 03:29:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fe4122f-85b9-47ca-8385-a3e4864237d8] received 2024-07-04T03:29:01.188874271Z [2024-07-04 03:29:01,188: INFO/ForkPoolWorker-15] [7fc437a9-84d4-4369-ad33-8d8e93a42294] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:29:01.199320477Z [2024-07-04 03:29:01,198: INFO/ForkPoolWorker-16] [4fe4122f-85b9-47ca-8385-a3e4864237d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:29:01.533587560Z [2024-07-04 03:29:01,530: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:29:01.550039079Z [2024-07-04 03:29:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:29:02.744594208Z [2024-07-04 03:29:02,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:29:02.748014696Z [2024-07-04 03:29:02,747: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:29:02.756038615Z [2024-07-04 03:29:02,755: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:29:02.759334903Z [2024-07-04 03:29:02,758: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:29:02.777171277Z [2024-07-04 03:29:02,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:29:02.778415759Z [2024-07-04 03:29:02,778: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:29:02.778540684Z [2024-07-04 03:29:02,778: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:29:02.778683260Z [2024-07-04 03:29:02,778: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:29:02.778806011Z [2024-07-04 03:29:02,778: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:29:02.779153401Z [2024-07-04 03:29:02,778: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:29:02.779168640Z [2024-07-04 03:29:02,779: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:29:02.804526979Z [2024-07-04 03:29:02,804: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:29:02.806291003Z [2024-07-04 03:29:02,805: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:29:02.806410616Z [2024-07-04 03:29:02,806: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:29:02.806600946Z [2024-07-04 03:29:02,806: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:29:02.806715475Z [2024-07-04 03:29:02,806: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:29:02.807713614Z [2024-07-04 03:29:02,807: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:29:02.807771186Z [2024-07-04 03:29:02,807: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:29:02.864384592Z [2024-07-04 03:29:02,864: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:29:02.911932426Z [2024-07-04 03:29:02,911: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:29:04.896535708Z [2024-07-04 03:29:04,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7fc437a9-84d4-4369-ad33-8d8e93a42294] succeeded in 3.7294836239998403s: None 2024-07-04T03:29:05.406766181Z [2024-07-04 03:29:05,406: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4fe4122f-85b9-47ca-8385-a3e4864237d8] succeeded in 4.228839995000271s: None 2024-07-04T03:30:00.491308840Z [2024-07-04 03:30:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9fbd846-8cc1-47e6-b967-335f096a72ee] received 2024-07-04T03:30:00.504688821Z [2024-07-04 03:30:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd0bafbb-d5ea-45d9-9fe7-d1fbdd3667e0] received 2024-07-04T03:30:00.508427448Z [2024-07-04 03:30:00,508: INFO/ForkPoolWorker-15] [e9fbd846-8cc1-47e6-b967-335f096a72ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:00.531643712Z [2024-07-04 03:30:00,531: INFO/ForkPoolWorker-16] [dd0bafbb-d5ea-45d9-9fe7-d1fbdd3667e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:30:00.556504670Z [2024-07-04 03:30:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[121e57dc-9d92-4c2f-b69a-75bf31e61412] received 2024-07-04T03:30:00.565760017Z [2024-07-04 03:30:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7341958d-6559-447c-b216-13f9daa54d04] received 2024-07-04T03:30:00.602060090Z [2024-07-04 03:30:00,594: INFO/ForkPoolWorker-1] [121e57dc-9d92-4c2f-b69a-75bf31e61412] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:30:00.619546745Z [2024-07-04 03:30:00,618: INFO/ForkPoolWorker-2] [7341958d-6559-447c-b216-13f9daa54d04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:30:00.979947269Z [2024-07-04 03:30:00,976: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:30:01.086808072Z [2024-07-04 03:30:01,083: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:30:01.299344971Z [2024-07-04 03:30:01,299: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:01.585341776Z [2024-07-04 03:30:01,579: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:30:01.834659834Z [2024-07-04 03:30:01,830: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:30:02.255286042Z [2024-07-04 03:30:02,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd0bafbb-d5ea-45d9-9fe7-d1fbdd3667e0] succeeded in 1.7469588109997858s: None 2024-07-04T03:30:02.738211126Z [2024-07-04 03:30:02,737: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:30:02.741738750Z [2024-07-04 03:30:02,741: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:02.766788421Z [2024-07-04 03:30:02,764: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:30:02.766803808Z [2024-07-04 03:30:02,765: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:02.766807925Z [2024-07-04 03:30:02,766: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:02.766811797Z [2024-07-04 03:30:02,766: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:02.766815333Z [2024-07-04 03:30:02,766: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:30:02.766818568Z [2024-07-04 03:30:02,766: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:30:02.767132367Z [2024-07-04 03:30:02,766: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:02.855206979Z [2024-07-04 03:30:02,854: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:03.223668487Z [2024-07-04 03:30:03,223: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T03:30:03.227817838Z [2024-07-04 03:30:03,226: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:03.264111506Z [2024-07-04 03:30:03,263: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T03:30:03.265426814Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:03.265491738Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:03.265673925Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:03.265727872Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T03:30:03.265985734Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:30:03.266040937Z [2024-07-04 03:30:03,265: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:03.367521788Z [2024-07-04 03:30:03,367: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:03.436872168Z [2024-07-04 03:30:03,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:30:03.440748310Z [2024-07-04 03:30:03,440: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:03.477765997Z [2024-07-04 03:30:03,477: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:30:03.479589803Z [2024-07-04 03:30:03,479: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:03.479608671Z [2024-07-04 03:30:03,479: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:03.479786686Z [2024-07-04 03:30:03,479: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:03.479901309Z [2024-07-04 03:30:03,479: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:30:03.480961415Z [2024-07-04 03:30:03,480: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:30:03.481146722Z [2024-07-04 03:30:03,480: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:03.601330847Z [2024-07-04 03:30:03,600: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e9fbd846-8cc1-47e6-b967-335f096a72ee] succeeded in 3.1078691849997995s: None 2024-07-04T03:30:03.618500041Z [2024-07-04 03:30:03,618: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:03.626758975Z [2024-07-04 03:30:03,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cef7d72-6439-46e5-9ea8-0a16f388cf22] received 2024-07-04T03:30:03.638779820Z [2024-07-04 03:30:03,638: INFO/ForkPoolWorker-15] [1cef7d72-6439-46e5-9ea8-0a16f388cf22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:04.037878013Z [2024-07-04 03:30:04,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:30:05.388540249Z [2024-07-04 03:30:05,388: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:30:05.409846268Z [2024-07-04 03:30:05,409: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:05.440116845Z [2024-07-04 03:30:05,439: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[121e57dc-9d92-4c2f-b69a-75bf31e61412] succeeded in 4.869611172000077s: None 2024-07-04T03:30:05.462907632Z [2024-07-04 03:30:05,462: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:30:05.467824098Z [2024-07-04 03:30:05,467: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:05.467932765Z [2024-07-04 03:30:05,467: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:05.468075636Z [2024-07-04 03:30:05,467: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:05.468151360Z [2024-07-04 03:30:05,468: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:30:05.468414933Z [2024-07-04 03:30:05,468: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:30:05.468527494Z [2024-07-04 03:30:05,468: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:05.499528886Z [2024-07-04 03:30:05,499: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7341958d-6559-447c-b216-13f9daa54d04] succeeded in 4.918096665000121s: None 2024-07-04T03:30:05.573525947Z [2024-07-04 03:30:05,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:06.210367010Z [2024-07-04 03:30:06,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20816f8b-cbab-4b63-a934-25c8e56d4cb6] received 2024-07-04T03:30:06.225810887Z [2024-07-04 03:30:06,225: INFO/ForkPoolWorker-16] [20816f8b-cbab-4b63-a934-25c8e56d4cb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:30:06.268919982Z [2024-07-04 03:30:06,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1cef7d72-6439-46e5-9ea8-0a16f388cf22] succeeded in 2.637081248000868s: None 2024-07-04T03:30:06.524062088Z [2024-07-04 03:30:06,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:30:07.622764393Z [2024-07-04 03:30:07,622: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:30:07.625879975Z [2024-07-04 03:30:07,625: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:07.655326912Z [2024-07-04 03:30:07,654: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:30:07.658169612Z [2024-07-04 03:30:07,657: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:07.658341162Z [2024-07-04 03:30:07,658: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:07.658633874Z [2024-07-04 03:30:07,658: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:07.659424924Z [2024-07-04 03:30:07,659: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:30:07.660328236Z [2024-07-04 03:30:07,659: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:30:07.660348049Z [2024-07-04 03:30:07,659: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:07.759666946Z [2024-07-04 03:30:07,759: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:09.740870967Z [2024-07-04 03:30:09,740: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41bfdb4c-d4ff-469e-adab-f5f717e856a7] received 2024-07-04T03:30:09.767972947Z [2024-07-04 03:30:09,767: INFO/ForkPoolWorker-15] [41bfdb4c-d4ff-469e-adab-f5f717e856a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:30:09.891024613Z [2024-07-04 03:30:09,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[20816f8b-cbab-4b63-a934-25c8e56d4cb6] succeeded in 3.675927920000504s: None 2024-07-04T03:30:10.089192070Z [2024-07-04 03:30:10,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:30:11.188804030Z [2024-07-04 03:30:11,188: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:30:11.191988390Z [2024-07-04 03:30:11,191: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:30:11.220362355Z [2024-07-04 03:30:11,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:30:11.224455043Z [2024-07-04 03:30:11,224: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:30:11.224954308Z [2024-07-04 03:30:11,224: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:30:11.225358396Z [2024-07-04 03:30:11,224: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:30:11.225817071Z [2024-07-04 03:30:11,225: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:30:11.226607111Z [2024-07-04 03:30:11,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:30:11.227058347Z [2024-07-04 03:30:11,226: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:30:11.349533659Z [2024-07-04 03:30:11,349: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:30:12.059701888Z [2024-07-04 03:30:12,059: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41bfdb4c-d4ff-469e-adab-f5f717e856a7] succeeded in 2.311692108999523s: None 2024-07-04T03:31:00.584974066Z [2024-07-04 03:31:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[affdf8a8-92ad-4a17-9e66-5ff520c823f2] received 2024-07-04T03:31:00.592955823Z [2024-07-04 03:31:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8c5382b-42e8-4bdf-98a3-a9f3445680e7] received 2024-07-04T03:31:00.618337305Z [2024-07-04 03:31:00,617: INFO/ForkPoolWorker-16] [b8c5382b-42e8-4bdf-98a3-a9f3445680e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:31:00.619790723Z [2024-07-04 03:31:00,619: INFO/ForkPoolWorker-15] [affdf8a8-92ad-4a17-9e66-5ff520c823f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:31:00.968745488Z [2024-07-04 03:31:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:31:00.997321102Z [2024-07-04 03:31:00,991: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:31:02.362005946Z [2024-07-04 03:31:02,360: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:31:02.366664693Z [2024-07-04 03:31:02,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:31:02.415333751Z [2024-07-04 03:31:02,413: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:31:02.419649382Z [2024-07-04 03:31:02,418: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:31:02.420008121Z [2024-07-04 03:31:02,419: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:31:02.420199510Z [2024-07-04 03:31:02,419: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:31:02.420568911Z [2024-07-04 03:31:02,420: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:31:02.423080405Z [2024-07-04 03:31:02,421: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:31:02.423236417Z [2024-07-04 03:31:02,423: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:31:02.444733737Z [2024-07-04 03:31:02,444: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:31:02.449002696Z [2024-07-04 03:31:02,448: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:31:02.500388269Z [2024-07-04 03:31:02,500: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:31:02.503151208Z [2024-07-04 03:31:02,502: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:31:02.503260329Z [2024-07-04 03:31:02,503: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:31:02.503440671Z [2024-07-04 03:31:02,503: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:31:02.503541266Z [2024-07-04 03:31:02,503: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:31:02.504316781Z [2024-07-04 03:31:02,504: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:31:02.504389265Z [2024-07-04 03:31:02,504: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:31:02.529951207Z [2024-07-04 03:31:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:31:02.620183659Z [2024-07-04 03:31:02,619: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:31:05.189203590Z [2024-07-04 03:31:05,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[affdf8a8-92ad-4a17-9e66-5ff520c823f2] succeeded in 4.5999079980001625s: None 2024-07-04T03:31:05.910985606Z [2024-07-04 03:31:05,910: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8c5382b-42e8-4bdf-98a3-a9f3445680e7] succeeded in 5.311447099999896s: None 2024-07-04T03:32:00.708757313Z [2024-07-04 03:32:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90177e1f-d31f-4e2c-9954-84cb67b19559] received 2024-07-04T03:32:00.719349139Z [2024-07-04 03:32:00,719: INFO/ForkPoolWorker-15] [90177e1f-d31f-4e2c-9954-84cb67b19559] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:32:00.728222902Z [2024-07-04 03:32:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a1ce925-111d-45f4-96de-77f3c2a4d3b5] received 2024-07-04T03:32:00.729857234Z [2024-07-04 03:32:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18a7909b-1284-4500-81e7-57834b89c3d3] received 2024-07-04T03:32:00.751438432Z [2024-07-04 03:32:00,751: INFO/ForkPoolWorker-16] [4a1ce925-111d-45f4-96de-77f3c2a4d3b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:32:00.756683188Z [2024-07-04 03:32:00,756: INFO/ForkPoolWorker-1] [18a7909b-1284-4500-81e7-57834b89c3d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:32:01.120597711Z [2024-07-04 03:32:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:32:01.240302132Z [2024-07-04 03:32:01,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:32:01.251973486Z [2024-07-04 03:32:01,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:32:01.374381371Z [2024-07-04 03:32:01,374: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:32:02.054050468Z [2024-07-04 03:32:02,053: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90177e1f-d31f-4e2c-9954-84cb67b19559] succeeded in 1.3416601890003221s: None 2024-07-04T03:32:02.544472704Z [2024-07-04 03:32:02,544: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:32:02.545820061Z [2024-07-04 03:32:02,545: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:32:02.547807356Z [2024-07-04 03:32:02,547: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:32:02.549257309Z [2024-07-04 03:32:02,548: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:32:02.577146828Z [2024-07-04 03:32:02,576: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:32:02.579468522Z [2024-07-04 03:32:02,579: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:32:02.579634784Z [2024-07-04 03:32:02,579: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:32:02.579896957Z [2024-07-04 03:32:02,579: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:32:02.580070494Z [2024-07-04 03:32:02,579: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:32:02.580484170Z [2024-07-04 03:32:02,580: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:32:02.580711835Z [2024-07-04 03:32:02,580: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:32:02.591131779Z [2024-07-04 03:32:02,590: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:32:02.592731059Z [2024-07-04 03:32:02,592: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:32:02.593075298Z [2024-07-04 03:32:02,592: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:32:02.593303072Z [2024-07-04 03:32:02,593: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:32:02.593425451Z [2024-07-04 03:32:02,593: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:32:02.593760911Z [2024-07-04 03:32:02,593: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:32:02.593892596Z [2024-07-04 03:32:02,593: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:32:02.674171053Z [2024-07-04 03:32:02,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:32:02.697704340Z [2024-07-04 03:32:02,697: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:32:04.277873273Z [2024-07-04 03:32:04,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a1ce925-111d-45f4-96de-77f3c2a4d3b5] succeeded in 3.5479236830005902s: None 2024-07-04T03:32:05.144439761Z [2024-07-04 03:32:05,143: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18a7909b-1284-4500-81e7-57834b89c3d3] succeeded in 4.4101010639997185s: None 2024-07-04T03:32:37.267044579Z [2024-07-04 03:32:37,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5dff997-6889-4976-846e-8a0052fba713] received 2024-07-04T03:32:37.281293389Z [2024-07-04 03:32:37,280: INFO/ForkPoolWorker-15] [f5dff997-6889-4976-846e-8a0052fba713] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704033236_572398', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:32:37.580055511Z [2024-07-04 03:32:37,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-07-04T03:32:37.931743979Z [2024-07-04 03:32:37,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:32:38.589213491Z [2024-07-04 03:32:38,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f5dff997-6889-4976-846e-8a0052fba713] succeeded in 1.3188999209996837s: None 2024-07-04T03:33:00.772799207Z [2024-07-04 03:33:00,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b8860bc-861b-4f89-9df8-354acaff9105] received 2024-07-04T03:33:00.783986520Z [2024-07-04 03:33:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a2d89f7-79d9-4df0-9988-36195e0fa754] received 2024-07-04T03:33:00.793013274Z [2024-07-04 03:33:00,792: INFO/ForkPoolWorker-15] [6b8860bc-861b-4f89-9df8-354acaff9105] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:33:00.818164810Z [2024-07-04 03:33:00,817: INFO/ForkPoolWorker-16] [4a2d89f7-79d9-4df0-9988-36195e0fa754] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:33:01.279884208Z [2024-07-04 03:33:01,275: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:33:01.304054703Z [2024-07-04 03:33:01,300: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:33:02.559683771Z [2024-07-04 03:33:02,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:33:02.563034239Z [2024-07-04 03:33:02,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:33:02.605966995Z [2024-07-04 03:33:02,605: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:33:02.608555379Z [2024-07-04 03:33:02,608: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:33:02.608742170Z [2024-07-04 03:33:02,608: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:33:02.609076515Z [2024-07-04 03:33:02,608: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:33:02.609240810Z [2024-07-04 03:33:02,609: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:33:02.611631533Z [2024-07-04 03:33:02,611: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:33:02.611783492Z [2024-07-04 03:33:02,611: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:33:02.620209380Z [2024-07-04 03:33:02,619: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:33:02.623563344Z [2024-07-04 03:33:02,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:33:02.682073317Z [2024-07-04 03:33:02,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:33:02.687191336Z [2024-07-04 03:33:02,686: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:33:02.687601033Z [2024-07-04 03:33:02,687: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:33:02.688067464Z [2024-07-04 03:33:02,687: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:33:02.688423731Z [2024-07-04 03:33:02,688: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:33:02.689076830Z [2024-07-04 03:33:02,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:33:02.689426688Z [2024-07-04 03:33:02,689: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:33:02.706297176Z [2024-07-04 03:33:02,706: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:33:02.794611447Z [2024-07-04 03:33:02,794: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:33:04.294145804Z [2024-07-04 03:33:04,293: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a2d89f7-79d9-4df0-9988-36195e0fa754] succeeded in 3.5044306019999567s: None 2024-07-04T03:33:04.682859972Z [2024-07-04 03:33:04,682: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6b8860bc-861b-4f89-9df8-354acaff9105] succeeded in 3.9064527999998973s: None 2024-07-04T03:34:00.504116727Z [2024-07-04 03:34:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f58a84-eca8-44d7-ad89-6a989770c2b8] received 2024-07-04T03:34:00.507249008Z [2024-07-04 03:34:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ff2af3-039d-48ac-b7e1-d2fecee779e6] received 2024-07-04T03:34:00.517716792Z [2024-07-04 03:34:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79d392e0-a70d-49a0-bdbe-4e3b25ad45e2] received 2024-07-04T03:34:00.538276936Z [2024-07-04 03:34:00,537: INFO/ForkPoolWorker-15] [83f58a84-eca8-44d7-ad89-6a989770c2b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:34:00.546931994Z [2024-07-04 03:34:00,546: INFO/ForkPoolWorker-1] [79d392e0-a70d-49a0-bdbe-4e3b25ad45e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:34:00.550043888Z [2024-07-04 03:34:00,549: INFO/ForkPoolWorker-16] [c5ff2af3-039d-48ac-b7e1-d2fecee779e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:34:00.936330677Z [2024-07-04 03:34:00,929: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:34:01.078322109Z [2024-07-04 03:34:01,073: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:34:01.189633370Z [2024-07-04 03:34:01,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:34:01.402799624Z [2024-07-04 03:34:01,402: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:34:02.044362400Z [2024-07-04 03:34:02,043: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79d392e0-a70d-49a0-bdbe-4e3b25ad45e2] succeeded in 1.5232254929996998s: None 2024-07-04T03:34:02.170864713Z [2024-07-04 03:34:02,170: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:34:02.174150039Z [2024-07-04 03:34:02,173: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:34:02.200197244Z [2024-07-04 03:34:02,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:34:02.201537205Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:34:02.201550303Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:34:02.201682767Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:34:02.201693550Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:34:02.201943403Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:34:02.201949599Z [2024-07-04 03:34:02,201: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:34:02.277936908Z [2024-07-04 03:34:02,277: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:34:02.337102831Z [2024-07-04 03:34:02,336: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:34:02.340101805Z [2024-07-04 03:34:02,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:34:02.376534693Z [2024-07-04 03:34:02,376: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:34:02.378695892Z [2024-07-04 03:34:02,378: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:34:02.379023468Z [2024-07-04 03:34:02,378: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:34:02.379160008Z [2024-07-04 03:34:02,378: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:34:02.379219044Z [2024-07-04 03:34:02,379: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:34:02.379739628Z [2024-07-04 03:34:02,379: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:34:02.379750079Z [2024-07-04 03:34:02,379: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:34:02.471108859Z [2024-07-04 03:34:02,470: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:34:04.283455768Z [2024-07-04 03:34:04,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83f58a84-eca8-44d7-ad89-6a989770c2b8] succeeded in 3.773325105999902s: None 2024-07-04T03:34:04.456362974Z [2024-07-04 03:34:04,455: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5ff2af3-039d-48ac-b7e1-d2fecee779e6] succeeded in 3.9381380679997164s: None 2024-07-04T03:34:36.677976192Z [2024-07-04 03:34:36,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4b01509-fdfb-44d4-99cf-fd63656e027c] received 2024-07-04T03:34:36.696529641Z [2024-07-04 03:34:36,696: INFO/ForkPoolWorker-15] [e4b01509-fdfb-44d4-99cf-fd63656e027c] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240704033436_543838', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-07-04T03:34:37.066709330Z [2024-07-04 03:34:37,062: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-07-04T03:34:37.446684235Z [2024-07-04 03:34:37,446: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:34:38.149918809Z [2024-07-04 03:34:38,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4b01509-fdfb-44d4-99cf-fd63656e027c] succeeded in 1.468469665000157s: None 2024-07-04T03:35:00.803767955Z [2024-07-04 03:35:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0e99e74-6ed8-40ab-b72b-4ba2bce72c35] received 2024-07-04T03:35:00.810140847Z [2024-07-04 03:35:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[466c7cde-3ab2-427a-957d-9c303d5bee21] received 2024-07-04T03:35:00.825804945Z [2024-07-04 03:35:00,825: INFO/ForkPoolWorker-15] [e0e99e74-6ed8-40ab-b72b-4ba2bce72c35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:35:00.834067346Z [2024-07-04 03:35:00,833: INFO/ForkPoolWorker-16] [466c7cde-3ab2-427a-957d-9c303d5bee21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:00.845663528Z [2024-07-04 03:35:00,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed6c4f0-8df1-4720-a824-12a9538bb95e] received 2024-07-04T03:35:00.883820481Z [2024-07-04 03:35:00,883: INFO/ForkPoolWorker-1] [8ed6c4f0-8df1-4720-a824-12a9538bb95e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:35:01.311764195Z [2024-07-04 03:35:01,308: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:35:01.335463144Z [2024-07-04 03:35:01,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:35:01.439701556Z [2024-07-04 03:35:01,434: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:35:02.632405774Z [2024-07-04 03:35:02,630: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:35:02.636784242Z [2024-07-04 03:35:02,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:02.697638055Z [2024-07-04 03:35:02,697: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:35:02.701194674Z [2024-07-04 03:35:02,700: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:02.701211760Z [2024-07-04 03:35:02,701: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:02.701280002Z [2024-07-04 03:35:02,701: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:02.701338799Z [2024-07-04 03:35:02,701: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:35:02.701548606Z [2024-07-04 03:35:02,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:35:02.701584186Z [2024-07-04 03:35:02,701: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:02.797001440Z [2024-07-04 03:35:02,796: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:02.818798334Z [2024-07-04 03:35:02,818: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:35:02.822740195Z [2024-07-04 03:35:02,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:02.862425266Z [2024-07-04 03:35:02,862: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:35:02.864293831Z [2024-07-04 03:35:02,864: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:02.864407029Z [2024-07-04 03:35:02,864: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:02.864566101Z [2024-07-04 03:35:02,864: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:02.864675504Z [2024-07-04 03:35:02,864: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:35:02.864955588Z [2024-07-04 03:35:02,864: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:35:02.865406103Z [2024-07-04 03:35:02,865: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:02.964794362Z [2024-07-04 03:35:02,964: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:02.996806843Z [2024-07-04 03:35:02,996: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:35:03.000302117Z [2024-07-04 03:35:02,999: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:03.028470173Z [2024-07-04 03:35:03,028: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:35:03.030311126Z [2024-07-04 03:35:03,030: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:03.030751559Z [2024-07-04 03:35:03,030: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:03.031267096Z [2024-07-04 03:35:03,030: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:03.031453566Z [2024-07-04 03:35:03,031: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:35:03.032349750Z [2024-07-04 03:35:03,032: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:35:03.032651075Z [2024-07-04 03:35:03,032: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:03.111549049Z [2024-07-04 03:35:03,111: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:03.812579292Z [2024-07-04 03:35:03,812: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[466c7cde-3ab2-427a-957d-9c303d5bee21] succeeded in 2.9972007159994973s: None 2024-07-04T03:35:04.170328531Z [2024-07-04 03:35:04,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba80a29-1112-43f2-8b27-59a363ff3fe7] received 2024-07-04T03:35:04.178786503Z [2024-07-04 03:35:04,178: INFO/ForkPoolWorker-16] [9ba80a29-1112-43f2-8b27-59a363ff3fe7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:04.582304712Z [2024-07-04 03:35:04,581: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8ed6c4f0-8df1-4720-a824-12a9538bb95e] succeeded in 3.734586467000554s: None 2024-07-04T03:35:04.588452569Z [2024-07-04 03:35:04,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0e99e74-6ed8-40ab-b72b-4ba2bce72c35] succeeded in 3.780821773999378s: None 2024-07-04T03:35:04.597455608Z [2024-07-04 03:35:04,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:35:05.678940390Z [2024-07-04 03:35:05,678: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:35:05.682124475Z [2024-07-04 03:35:05,681: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:05.724235296Z [2024-07-04 03:35:05,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:35:05.726031987Z [2024-07-04 03:35:05,725: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:05.726286626Z [2024-07-04 03:35:05,726: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:05.726558546Z [2024-07-04 03:35:05,726: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:05.726823073Z [2024-07-04 03:35:05,726: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:35:05.727255522Z [2024-07-04 03:35:05,727: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:35:05.728010574Z [2024-07-04 03:35:05,727: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:05.823282281Z [2024-07-04 03:35:05,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:06.575404583Z [2024-07-04 03:35:06,574: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ba80a29-1112-43f2-8b27-59a363ff3fe7] succeeded in 2.4027104679998956s: None 2024-07-04T03:35:07.065427386Z [2024-07-04 03:35:07,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef87e8ff-2c94-452d-a3e9-190e5f46e306] received 2024-07-04T03:35:07.074574302Z [2024-07-04 03:35:07,074: INFO/ForkPoolWorker-15] [ef87e8ff-2c94-452d-a3e9-190e5f46e306] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:35:07.355219917Z [2024-07-04 03:35:07,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:35:08.464895699Z [2024-07-04 03:35:08,464: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:35:08.468439248Z [2024-07-04 03:35:08,467: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:08.503910876Z [2024-07-04 03:35:08,503: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:35:08.505300070Z [2024-07-04 03:35:08,505: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:08.505443858Z [2024-07-04 03:35:08,505: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:08.505660041Z [2024-07-04 03:35:08,505: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:08.505854603Z [2024-07-04 03:35:08,505: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:35:08.506160518Z [2024-07-04 03:35:08,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:35:08.506312822Z [2024-07-04 03:35:08,506: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:08.611014429Z [2024-07-04 03:35:08,610: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:10.217814391Z [2024-07-04 03:35:10,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ef87e8ff-2c94-452d-a3e9-190e5f46e306] succeeded in 3.149734040000112s: None 2024-07-04T03:35:10.359859319Z [2024-07-04 03:35:10,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bcde89a-e4ab-4744-9d8c-5841b4f18b4f] received 2024-07-04T03:35:10.372605788Z [2024-07-04 03:35:10,372: INFO/ForkPoolWorker-15] [9bcde89a-e4ab-4744-9d8c-5841b4f18b4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:35:10.698951446Z [2024-07-04 03:35:10,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:35:11.812245457Z [2024-07-04 03:35:11,811: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:35:11.815590897Z [2024-07-04 03:35:11,815: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:35:11.861958367Z [2024-07-04 03:35:11,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:35:11.862966907Z [2024-07-04 03:35:11,862: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:35:11.862978853Z [2024-07-04 03:35:11,862: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:35:11.862986599Z [2024-07-04 03:35:11,862: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:35:11.862991847Z [2024-07-04 03:35:11,862: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:35:11.867022809Z [2024-07-04 03:35:11,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:35:11.867043377Z [2024-07-04 03:35:11,863: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:35:12.018708854Z [2024-07-04 03:35:12,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:35:12.708534758Z [2024-07-04 03:35:12,708: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bcde89a-e4ab-4744-9d8c-5841b4f18b4f] succeeded in 2.346223409999766s: None 2024-07-04T03:36:01.065675554Z [2024-07-04 03:36:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab073146-a035-4308-8680-92ef4225be4b] received 2024-07-04T03:36:01.073653856Z [2024-07-04 03:36:01,073: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0a20040-0631-4b10-bd08-b423decf01c0] received 2024-07-04T03:36:01.079514456Z [2024-07-04 03:36:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0e049f-6be4-4092-a8da-cfcdeac9da64] received 2024-07-04T03:36:01.091677741Z [2024-07-04 03:36:01,091: INFO/ForkPoolWorker-15] [ab073146-a035-4308-8680-92ef4225be4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:36:01.096575607Z [2024-07-04 03:36:01,096: INFO/ForkPoolWorker-16] [f0a20040-0631-4b10-bd08-b423decf01c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:36:01.102960232Z [2024-07-04 03:36:01,102: INFO/ForkPoolWorker-1] [8f0e049f-6be4-4092-a8da-cfcdeac9da64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:36:01.428629060Z [2024-07-04 03:36:01,423: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:36:01.444251542Z [2024-07-04 03:36:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:36:01.471484649Z [2024-07-04 03:36:01,467: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:36:01.729300301Z [2024-07-04 03:36:01,728: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:36:02.348829159Z [2024-07-04 03:36:02,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0a20040-0631-4b10-bd08-b423decf01c0] succeeded in 1.2721619900003134s: None 2024-07-04T03:36:02.686201501Z [2024-07-04 03:36:02,685: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:36:02.689746015Z [2024-07-04 03:36:02,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:36:02.733439511Z [2024-07-04 03:36:02,733: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:36:02.735779936Z [2024-07-04 03:36:02,735: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:36:02.736119555Z [2024-07-04 03:36:02,735: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:36:02.736541080Z [2024-07-04 03:36:02,736: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:36:02.736918673Z [2024-07-04 03:36:02,736: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:36:02.737442894Z [2024-07-04 03:36:02,737: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:36:02.737708859Z [2024-07-04 03:36:02,737: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:36:02.758939036Z [2024-07-04 03:36:02,758: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:36:02.762130833Z [2024-07-04 03:36:02,761: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:36:02.782004563Z [2024-07-04 03:36:02,781: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:36:02.783064295Z [2024-07-04 03:36:02,782: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:36:02.783186357Z [2024-07-04 03:36:02,783: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:36:02.783388507Z [2024-07-04 03:36:02,783: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:36:02.783507582Z [2024-07-04 03:36:02,783: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:36:02.784121022Z [2024-07-04 03:36:02,783: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:36:02.784314381Z [2024-07-04 03:36:02,784: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:36:02.867617278Z [2024-07-04 03:36:02,867: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:36:02.892070545Z [2024-07-04 03:36:02,891: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:36:04.523740448Z [2024-07-04 03:36:04,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8f0e049f-6be4-4092-a8da-cfcdeac9da64] succeeded in 3.4412791290014866s: None 2024-07-04T03:36:04.902939646Z [2024-07-04 03:36:04,902: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab073146-a035-4308-8680-92ef4225be4b] succeeded in 3.8316967410009966s: None 2024-07-04T03:36:29.545033464Z [2024-07-04 03:36:29,544: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12365642-ca96-47b8-bbbf-dc72dac83da6] received 2024-07-04T03:36:29.552651127Z [2024-07-04 03:36:29,552: INFO/ForkPoolWorker-15] [12365642-ca96-47b8-bbbf-dc72dac83da6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240704033628_330906', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-07-04T03:36:29.880003364Z [2024-07-04 03:36:29,876: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-07-04T03:36:30.137798251Z [2024-07-04 03:36:30,137: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:36:30.845541924Z [2024-07-04 03:36:30,845: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12365642-ca96-47b8-bbbf-dc72dac83da6] succeeded in 1.297728150999319s: None 2024-07-04T03:37:00.219997125Z [2024-07-04 03:37:00,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f3d2d6e-1e94-41c9-be27-47b03bdfd243] received 2024-07-04T03:37:00.227455445Z [2024-07-04 03:37:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ec957b4-0f40-4d5b-b04f-2cae5ce0c4d7] received 2024-07-04T03:37:00.236721629Z [2024-07-04 03:37:00,236: INFO/ForkPoolWorker-15] [9f3d2d6e-1e94-41c9-be27-47b03bdfd243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:37:00.258294445Z [2024-07-04 03:37:00,257: INFO/ForkPoolWorker-16] [9ec957b4-0f40-4d5b-b04f-2cae5ce0c4d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:37:00.573343819Z [2024-07-04 03:37:00,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:37:00.733283237Z [2024-07-04 03:37:00,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:37:02.256211374Z [2024-07-04 03:37:02,255: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:37:02.259899388Z [2024-07-04 03:37:02,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:37:02.302639968Z [2024-07-04 03:37:02,302: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:37:02.308251707Z [2024-07-04 03:37:02,307: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:37:02.308268238Z [2024-07-04 03:37:02,308: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:37:02.308437189Z [2024-07-04 03:37:02,308: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:37:02.308488629Z [2024-07-04 03:37:02,308: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:37:02.309289065Z [2024-07-04 03:37:02,309: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:37:02.309441095Z [2024-07-04 03:37:02,309: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:37:02.344951317Z [2024-07-04 03:37:02,344: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:37:02.348408089Z [2024-07-04 03:37:02,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:37:02.396471051Z [2024-07-04 03:37:02,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:37:02.398176705Z [2024-07-04 03:37:02,397: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:37:02.398319812Z [2024-07-04 03:37:02,398: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:37:02.398628366Z [2024-07-04 03:37:02,398: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:37:02.398929230Z [2024-07-04 03:37:02,398: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:37:02.400206767Z [2024-07-04 03:37:02,400: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:37:02.400387544Z [2024-07-04 03:37:02,400: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:37:02.412415404Z [2024-07-04 03:37:02,412: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:37:02.493159968Z [2024-07-04 03:37:02,492: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:37:04.073990314Z [2024-07-04 03:37:04,073: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ec957b4-0f40-4d5b-b04f-2cae5ce0c4d7] succeeded in 3.841037997000967s: None 2024-07-04T03:37:04.669737164Z [2024-07-04 03:37:04,669: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f3d2d6e-1e94-41c9-be27-47b03bdfd243] succeeded in 4.4468850969988125s: None 2024-07-04T03:38:00.895172766Z [2024-07-04 03:38:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8141d2a0-5f60-4be3-aa4e-84298ca49094] received 2024-07-04T03:38:00.900772145Z [2024-07-04 03:38:00,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08f75ca1-431d-47e2-9820-0261fa02bc74] received 2024-07-04T03:38:00.914323102Z [2024-07-04 03:38:00,913: INFO/ForkPoolWorker-15] [8141d2a0-5f60-4be3-aa4e-84298ca49094] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:38:00.917343795Z [2024-07-04 03:38:00,916: INFO/ForkPoolWorker-16] [08f75ca1-431d-47e2-9820-0261fa02bc74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:38:00.923897214Z [2024-07-04 03:38:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d4c5338-f48f-4862-bfe0-bd809fea6c56] received 2024-07-04T03:38:00.966917183Z [2024-07-04 03:38:00,966: INFO/ForkPoolWorker-1] [6d4c5338-f48f-4862-bfe0-bd809fea6c56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:38:01.355794172Z [2024-07-04 03:38:01,350: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:38:01.489732375Z [2024-07-04 03:38:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:38:01.637407880Z [2024-07-04 03:38:01,633: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:38:02.100699641Z [2024-07-04 03:38:02,100: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:38:02.949781012Z [2024-07-04 03:38:02,949: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8141d2a0-5f60-4be3-aa4e-84298ca49094] succeeded in 2.051206080001066s: None 2024-07-04T03:38:03.191462862Z [2024-07-04 03:38:03,190: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:38:03.197134552Z [2024-07-04 03:38:03,196: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:38:03.230853998Z [2024-07-04 03:38:03,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:38:03.232561059Z [2024-07-04 03:38:03,232: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:38:03.233066713Z [2024-07-04 03:38:03,232: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:38:03.233229058Z [2024-07-04 03:38:03,233: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:38:03.233310640Z [2024-07-04 03:38:03,233: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:38:03.233632753Z [2024-07-04 03:38:03,233: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:38:03.233972451Z [2024-07-04 03:38:03,233: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:38:03.315913605Z [2024-07-04 03:38:03,315: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:38:03.320161619Z [2024-07-04 03:38:03,319: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:38:03.323969535Z [2024-07-04 03:38:03,323: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:38:03.355972731Z [2024-07-04 03:38:03,355: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:38:03.357163896Z [2024-07-04 03:38:03,356: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:38:03.357273073Z [2024-07-04 03:38:03,357: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:38:03.357430023Z [2024-07-04 03:38:03,357: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:38:03.357542385Z [2024-07-04 03:38:03,357: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:38:03.357912878Z [2024-07-04 03:38:03,357: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:38:03.358098357Z [2024-07-04 03:38:03,357: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:38:03.502693136Z [2024-07-04 03:38:03,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:38:05.487499603Z [2024-07-04 03:38:05,487: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d4c5338-f48f-4862-bfe0-bd809fea6c56] succeeded in 4.560677617000692s: None 2024-07-04T03:38:05.657692665Z [2024-07-04 03:38:05,656: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08f75ca1-431d-47e2-9820-0261fa02bc74] succeeded in 4.752446630000122s: None 2024-07-04T03:39:00.790539912Z [2024-07-04 03:39:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46a52a68-ee94-419d-80fd-ce1afb0cd8e8] received 2024-07-04T03:39:00.809928311Z [2024-07-04 03:39:00,809: INFO/ForkPoolWorker-15] [46a52a68-ee94-419d-80fd-ce1afb0cd8e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:39:00.817064540Z [2024-07-04 03:39:00,816: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[378b15a1-3647-479b-a250-24baa1f1ca97] received 2024-07-04T03:39:00.841693047Z [2024-07-04 03:39:00,841: INFO/ForkPoolWorker-16] [378b15a1-3647-479b-a250-24baa1f1ca97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:39:01.141145432Z [2024-07-04 03:39:01,136: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:39:01.166004911Z [2024-07-04 03:39:01,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:39:02.377017849Z [2024-07-04 03:39:02,376: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:39:02.380513965Z [2024-07-04 03:39:02,380: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:39:02.385996851Z [2024-07-04 03:39:02,385: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:39:02.389329267Z [2024-07-04 03:39:02,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:39:02.409394167Z [2024-07-04 03:39:02,409: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:39:02.410821936Z [2024-07-04 03:39:02,410: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:39:02.410843385Z [2024-07-04 03:39:02,410: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:39:02.411005751Z [2024-07-04 03:39:02,410: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:39:02.411023992Z [2024-07-04 03:39:02,410: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:39:02.412132563Z [2024-07-04 03:39:02,411: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:39:02.412151081Z [2024-07-04 03:39:02,412: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:39:02.420866710Z [2024-07-04 03:39:02,420: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:39:02.421971928Z [2024-07-04 03:39:02,421: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:39:02.422050817Z [2024-07-04 03:39:02,421: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:39:02.422201484Z [2024-07-04 03:39:02,422: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:39:02.422270836Z [2024-07-04 03:39:02,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:39:02.422538237Z [2024-07-04 03:39:02,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:39:02.422710231Z [2024-07-04 03:39:02,422: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:39:02.493678552Z [2024-07-04 03:39:02,493: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:39:02.520594665Z [2024-07-04 03:39:02,520: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:39:04.167663860Z [2024-07-04 03:39:04,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[378b15a1-3647-479b-a250-24baa1f1ca97] succeeded in 3.346359985998788s: None 2024-07-04T03:39:04.604898674Z [2024-07-04 03:39:04,604: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46a52a68-ee94-419d-80fd-ce1afb0cd8e8] succeeded in 3.809538383000472s: None 2024-07-04T03:40:00.810020803Z [2024-07-04 03:40:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[331cbd7f-64b6-47ca-8c55-6e5a1e888711] received 2024-07-04T03:40:00.822046132Z [2024-07-04 03:40:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e4eb8c1-5987-4ec0-a953-8d9fdd3c6fb7] received 2024-07-04T03:40:00.839363275Z [2024-07-04 03:40:00,839: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb10cabb-b47b-4188-81d8-2004d7df9147] received 2024-07-04T03:40:00.846388236Z [2024-07-04 03:40:00,845: INFO/ForkPoolWorker-16] [1e4eb8c1-5987-4ec0-a953-8d9fdd3c6fb7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:40:00.847855361Z [2024-07-04 03:40:00,846: INFO/ForkPoolWorker-15] [331cbd7f-64b6-47ca-8c55-6e5a1e888711] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:40:00.856849551Z [2024-07-04 03:40:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0522e69e-e1c2-4b46-9421-836481d4de1d] received 2024-07-04T03:40:00.881438751Z [2024-07-04 03:40:00,880: INFO/ForkPoolWorker-1] [fb10cabb-b47b-4188-81d8-2004d7df9147] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:00.882559672Z [2024-07-04 03:40:00,882: INFO/ForkPoolWorker-2] [0522e69e-e1c2-4b46-9421-836481d4de1d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:40:01.301831387Z [2024-07-04 03:40:01,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:40:01.334158251Z [2024-07-04 03:40:01,330: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:40:01.466112860Z [2024-07-04 03:40:01,461: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:40:01.473510050Z [2024-07-04 03:40:01,468: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:40:01.945053882Z [2024-07-04 03:40:01,944: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:02.722932498Z [2024-07-04 03:40:02,722: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0522e69e-e1c2-4b46-9421-836481d4de1d] succeeded in 1.862862136998956s: None 2024-07-04T03:40:02.904279679Z [2024-07-04 03:40:02,903: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:40:02.907765161Z [2024-07-04 03:40:02,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:02.946510025Z [2024-07-04 03:40:02,946: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:40:02.948132559Z [2024-07-04 03:40:02,947: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:02.948148828Z [2024-07-04 03:40:02,947: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:02.948436980Z [2024-07-04 03:40:02,948: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:02.948622551Z [2024-07-04 03:40:02,948: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:40:02.948990558Z [2024-07-04 03:40:02,948: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:40:02.949100285Z [2024-07-04 03:40:02,948: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:03.059362408Z [2024-07-04 03:40:03,059: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:03.188915369Z [2024-07-04 03:40:03,188: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:40:03.192406955Z [2024-07-04 03:40:03,191: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:03.193373267Z [2024-07-04 03:40:03,193: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:40:03.196972016Z [2024-07-04 03:40:03,196: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:03.226488889Z [2024-07-04 03:40:03,226: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:40:03.228885309Z [2024-07-04 03:40:03,228: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:03.228899180Z [2024-07-04 03:40:03,228: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:03.229180458Z [2024-07-04 03:40:03,228: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:03.229243086Z [2024-07-04 03:40:03,229: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:40:03.229534196Z [2024-07-04 03:40:03,229: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:40:03.229567561Z [2024-07-04 03:40:03,229: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:03.250839105Z [2024-07-04 03:40:03,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:40:03.258214807Z [2024-07-04 03:40:03,257: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:03.258377059Z [2024-07-04 03:40:03,258: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:03.258539006Z [2024-07-04 03:40:03,258: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:03.260973407Z [2024-07-04 03:40:03,258: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:40:03.261846257Z [2024-07-04 03:40:03,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:40:03.262420808Z [2024-07-04 03:40:03,261: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:03.350076014Z [2024-07-04 03:40:03,349: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:03.417897430Z [2024-07-04 03:40:03,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:04.141490796Z [2024-07-04 03:40:04,140: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fb10cabb-b47b-4188-81d8-2004d7df9147] succeeded in 3.286731096000949s: None 2024-07-04T03:40:04.758015735Z [2024-07-04 03:40:04,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d829a490-e09f-40c8-85df-363b5e1310b4] received 2024-07-04T03:40:04.785169008Z [2024-07-04 03:40:04,784: INFO/ForkPoolWorker-1] [d829a490-e09f-40c8-85df-363b5e1310b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:04.865971314Z [2024-07-04 03:40:04,865: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e4eb8c1-5987-4ec0-a953-8d9fdd3c6fb7] succeeded in 4.032309644999259s: None 2024-07-04T03:40:05.093438769Z [2024-07-04 03:40:05,089: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:40:05.461397744Z [2024-07-04 03:40:05,460: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[331cbd7f-64b6-47ca-8c55-6e5a1e888711] succeeded in 4.64103188000081s: None 2024-07-04T03:40:06.313595273Z [2024-07-04 03:40:06,313: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:40:06.316815981Z [2024-07-04 03:40:06,316: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:06.351584129Z [2024-07-04 03:40:06,351: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:40:06.353243279Z [2024-07-04 03:40:06,352: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:06.353404720Z [2024-07-04 03:40:06,353: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:06.353689636Z [2024-07-04 03:40:06,353: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:06.353900465Z [2024-07-04 03:40:06,353: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:40:06.354322173Z [2024-07-04 03:40:06,354: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:40:06.355044738Z [2024-07-04 03:40:06,354: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:06.486564507Z [2024-07-04 03:40:06,486: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:07.329100846Z [2024-07-04 03:40:07,328: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d829a490-e09f-40c8-85df-363b5e1310b4] succeeded in 2.569386740000482s: None 2024-07-04T03:40:08.182760313Z [2024-07-04 03:40:08,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f209259a-d793-4758-9259-94d315c152d6] received 2024-07-04T03:40:08.196211723Z [2024-07-04 03:40:08,195: INFO/ForkPoolWorker-15] [f209259a-d793-4758-9259-94d315c152d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:40:08.496882298Z [2024-07-04 03:40:08,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:40:09.769636905Z [2024-07-04 03:40:09,769: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:40:09.774518780Z [2024-07-04 03:40:09,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:09.814350713Z [2024-07-04 03:40:09,814: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:40:09.818126276Z [2024-07-04 03:40:09,817: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:09.818160459Z [2024-07-04 03:40:09,818: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:09.818269980Z [2024-07-04 03:40:09,818: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:09.818332105Z [2024-07-04 03:40:09,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:40:09.820881351Z [2024-07-04 03:40:09,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:40:09.820929233Z [2024-07-04 03:40:09,820: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:09.945641738Z [2024-07-04 03:40:09,945: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:10.632180055Z [2024-07-04 03:40:10,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f209259a-d793-4758-9259-94d315c152d6] succeeded in 2.4452653680000367s: None 2024-07-04T03:40:10.992636523Z [2024-07-04 03:40:10,991: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f77388d5-afcf-4f9e-9d95-59b71cf3142b] received 2024-07-04T03:40:11.005907546Z [2024-07-04 03:40:11,005: INFO/ForkPoolWorker-15] [f77388d5-afcf-4f9e-9d95-59b71cf3142b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:40:11.356781350Z [2024-07-04 03:40:11,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:40:12.676238685Z [2024-07-04 03:40:12,675: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:40:12.687068265Z [2024-07-04 03:40:12,679: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:40:12.727239926Z [2024-07-04 03:40:12,726: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:40:12.729881371Z [2024-07-04 03:40:12,729: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:40:12.730305729Z [2024-07-04 03:40:12,730: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:40:12.730530402Z [2024-07-04 03:40:12,730: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:40:12.730767936Z [2024-07-04 03:40:12,730: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:40:12.731391497Z [2024-07-04 03:40:12,731: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:40:12.731565551Z [2024-07-04 03:40:12,731: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:40:12.849151166Z [2024-07-04 03:40:12,848: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:13.556246088Z [2024-07-04 03:40:13,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f77388d5-afcf-4f9e-9d95-59b71cf3142b] succeeded in 2.560708846000125s: None 2024-07-04T03:40:29.124312993Z [2024-07-04 03:40:29,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33494055-a013-4cc0-b2e6-9cbc515bdb6f] received 2024-07-04T03:40:29.142434006Z [2024-07-04 03:40:29,142: INFO/ForkPoolWorker-15] [33494055-a013-4cc0-b2e6-9cbc515bdb6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240704034028_745144', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-07-04T03:40:29.461323336Z [2024-07-04 03:40:29,457: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-07-04T03:40:29.760026672Z [2024-07-04 03:40:29,758: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:40:30.411514901Z [2024-07-04 03:40:30,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33494055-a013-4cc0-b2e6-9cbc515bdb6f] succeeded in 1.2817296869998245s: None 2024-07-04T03:41:00.915450938Z [2024-07-04 03:41:00,915: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88205ed1-aa82-4da7-b508-724025d3d57c] received 2024-07-04T03:41:00.928374726Z [2024-07-04 03:41:00,928: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d984a69-68f7-4982-8081-3896971e7126] received 2024-07-04T03:41:00.949533646Z [2024-07-04 03:41:00,949: INFO/ForkPoolWorker-15] [88205ed1-aa82-4da7-b508-724025d3d57c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:41:00.964274285Z [2024-07-04 03:41:00,963: INFO/ForkPoolWorker-16] [5d984a69-68f7-4982-8081-3896971e7126] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:41:01.291281092Z [2024-07-04 03:41:01,287: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:41:01.347100727Z [2024-07-04 03:41:01,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:41:02.499627790Z [2024-07-04 03:41:02,499: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:41:02.503122395Z [2024-07-04 03:41:02,502: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:41:02.514449111Z [2024-07-04 03:41:02,514: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:41:02.517849442Z [2024-07-04 03:41:02,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:41:02.539869584Z [2024-07-04 03:41:02,539: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:41:02.541372919Z [2024-07-04 03:41:02,541: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:41:02.541546665Z [2024-07-04 03:41:02,541: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:41:02.541732320Z [2024-07-04 03:41:02,541: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:41:02.541846275Z [2024-07-04 03:41:02,541: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:41:02.542231140Z [2024-07-04 03:41:02,542: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:41:02.542257278Z [2024-07-04 03:41:02,542: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:41:02.554490797Z [2024-07-04 03:41:02,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:41:02.556824638Z [2024-07-04 03:41:02,556: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:41:02.557855522Z [2024-07-04 03:41:02,556: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:41:02.558197389Z [2024-07-04 03:41:02,557: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:41:02.558208390Z [2024-07-04 03:41:02,558: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:41:02.558576491Z [2024-07-04 03:41:02,558: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:41:02.558951397Z [2024-07-04 03:41:02,558: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:41:02.629062149Z [2024-07-04 03:41:02,628: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:41:02.672567018Z [2024-07-04 03:41:02,672: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:41:04.243892703Z [2024-07-04 03:41:04,243: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d984a69-68f7-4982-8081-3896971e7126] succeeded in 3.3107288559986046s: None 2024-07-04T03:41:04.526846457Z [2024-07-04 03:41:04,526: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[88205ed1-aa82-4da7-b508-724025d3d57c] succeeded in 3.606506343001456s: None 2024-07-04T03:42:00.709247449Z [2024-07-04 03:42:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d11ab43-ce08-436c-bb62-aa6bcd588916] received 2024-07-04T03:42:00.717787065Z [2024-07-04 03:42:00,717: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80847c98-139d-49a3-9cb3-db5696196a9a] received 2024-07-04T03:42:00.736743299Z [2024-07-04 03:42:00,736: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9970ad37-4bec-4317-b047-728ca3821db5] received 2024-07-04T03:42:00.740498469Z [2024-07-04 03:42:00,739: INFO/ForkPoolWorker-16] [80847c98-139d-49a3-9cb3-db5696196a9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:42:00.742747914Z [2024-07-04 03:42:00,742: INFO/ForkPoolWorker-15] [2d11ab43-ce08-436c-bb62-aa6bcd588916] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:42:00.776715195Z [2024-07-04 03:42:00,776: INFO/ForkPoolWorker-1] [9970ad37-4bec-4317-b047-728ca3821db5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:42:01.170717045Z [2024-07-04 03:42:01,165: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:42:01.361934194Z [2024-07-04 03:42:01,357: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:42:01.437296604Z [2024-07-04 03:42:01,433: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:42:01.741866830Z [2024-07-04 03:42:01,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:42:02.945299634Z [2024-07-04 03:42:02,944: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80847c98-139d-49a3-9cb3-db5696196a9a] succeeded in 2.2240680859995337s: None 2024-07-04T03:42:02.984886157Z [2024-07-04 03:42:02,984: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:42:02.988433634Z [2024-07-04 03:42:02,987: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:42:03.012901213Z [2024-07-04 03:42:03,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:42:03.017059786Z [2024-07-04 03:42:03,016: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:42:03.029902028Z [2024-07-04 03:42:03,029: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:42:03.031828039Z [2024-07-04 03:42:03,031: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:42:03.032927742Z [2024-07-04 03:42:03,031: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:42:03.033193298Z [2024-07-04 03:42:03,032: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:42:03.035935780Z [2024-07-04 03:42:03,034: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:42:03.036775486Z [2024-07-04 03:42:03,036: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:42:03.037208354Z [2024-07-04 03:42:03,036: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:42:03.058918742Z [2024-07-04 03:42:03,058: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:42:03.060328067Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:42:03.060384356Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:42:03.060510713Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:42:03.060558005Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:42:03.060821032Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:42:03.060902843Z [2024-07-04 03:42:03,060: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:42:03.180945979Z [2024-07-04 03:42:03,180: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:42:03.192180125Z [2024-07-04 03:42:03,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:42:05.595201243Z [2024-07-04 03:42:05,594: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d11ab43-ce08-436c-bb62-aa6bcd588916] succeeded in 4.874590801000522s: None 2024-07-04T03:42:06.215982147Z [2024-07-04 03:42:06,215: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9970ad37-4bec-4317-b047-728ca3821db5] succeeded in 5.476168257999234s: None 2024-07-04T03:43:00.539590406Z [2024-07-04 03:43:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61b4c79f-8d7b-43ff-b4ca-a474aaa56503] received 2024-07-04T03:43:00.547515634Z [2024-07-04 03:43:00,547: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6fa54f0-a517-433c-afe3-9296e1bca9f1] received 2024-07-04T03:43:00.553357154Z [2024-07-04 03:43:00,553: INFO/ForkPoolWorker-15] [61b4c79f-8d7b-43ff-b4ca-a474aaa56503] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:43:00.569102493Z [2024-07-04 03:43:00,568: INFO/ForkPoolWorker-16] [e6fa54f0-a517-433c-afe3-9296e1bca9f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:43:00.871565726Z [2024-07-04 03:43:00,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:43:00.982627367Z [2024-07-04 03:43:00,979: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:43:02.096961626Z [2024-07-04 03:43:02,096: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:43:02.100210633Z [2024-07-04 03:43:02,099: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:43:02.129778336Z [2024-07-04 03:43:02,129: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:43:02.131037703Z [2024-07-04 03:43:02,130: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:43:02.131092928Z [2024-07-04 03:43:02,130: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:43:02.131228314Z [2024-07-04 03:43:02,131: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:43:02.131258419Z [2024-07-04 03:43:02,131: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:43:02.131538695Z [2024-07-04 03:43:02,131: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:43:02.131584378Z [2024-07-04 03:43:02,131: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:43:02.218632592Z [2024-07-04 03:43:02,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:43:02.240997886Z [2024-07-04 03:43:02,240: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:43:02.245150287Z [2024-07-04 03:43:02,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:43:02.273415908Z [2024-07-04 03:43:02,273: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:43:02.274461108Z [2024-07-04 03:43:02,274: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:43:02.274595250Z [2024-07-04 03:43:02,274: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:43:02.274759834Z [2024-07-04 03:43:02,274: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:43:02.274904230Z [2024-07-04 03:43:02,274: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:43:02.275244717Z [2024-07-04 03:43:02,275: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:43:02.275412996Z [2024-07-04 03:43:02,275: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:43:02.352290051Z [2024-07-04 03:43:02,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:43:04.058034399Z [2024-07-04 03:43:04,057: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61b4c79f-8d7b-43ff-b4ca-a474aaa56503] succeeded in 3.5167563570012135s: None 2024-07-04T03:43:05.221080064Z [2024-07-04 03:43:05,220: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6fa54f0-a517-433c-afe3-9296e1bca9f1] succeeded in 4.670345189999352s: None 2024-07-04T03:44:01.036721656Z [2024-07-04 03:44:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05c7dad3-b2dc-41aa-bbd5-e9b17a74837d] received 2024-07-04T03:44:01.050616096Z [2024-07-04 03:44:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97cf2b88-5818-4b04-82a8-1e1f490bc921] received 2024-07-04T03:44:01.059859867Z [2024-07-04 03:44:01,059: INFO/ForkPoolWorker-15] [05c7dad3-b2dc-41aa-bbd5-e9b17a74837d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:44:01.072392766Z [2024-07-04 03:44:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[045fa271-b869-4b07-8af1-75aa9bcdf443] received 2024-07-04T03:44:01.092547543Z [2024-07-04 03:44:01,091: INFO/ForkPoolWorker-16] [97cf2b88-5818-4b04-82a8-1e1f490bc921] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:44:01.114827145Z [2024-07-04 03:44:01,114: INFO/ForkPoolWorker-1] [045fa271-b869-4b07-8af1-75aa9bcdf443] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:44:01.508063825Z [2024-07-04 03:44:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:44:01.535299422Z [2024-07-04 03:44:01,528: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:44:01.542359908Z [2024-07-04 03:44:01,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:44:01.796422874Z [2024-07-04 03:44:01,795: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:44:02.477090782Z [2024-07-04 03:44:02,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05c7dad3-b2dc-41aa-bbd5-e9b17a74837d] succeeded in 1.4349106879999454s: None 2024-07-04T03:44:02.871539772Z [2024-07-04 03:44:02,871: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:44:02.874813522Z [2024-07-04 03:44:02,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:44:02.900499844Z [2024-07-04 03:44:02,900: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:44:02.902496469Z [2024-07-04 03:44:02,902: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:44:02.902699960Z [2024-07-04 03:44:02,902: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:44:02.902921317Z [2024-07-04 03:44:02,902: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:44:02.903088206Z [2024-07-04 03:44:02,902: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:44:02.903493161Z [2024-07-04 03:44:02,903: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:44:02.903624775Z [2024-07-04 03:44:02,903: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:44:02.993230069Z [2024-07-04 03:44:02,992: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:44:03.034307811Z [2024-07-04 03:44:03,033: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:44:03.045059330Z [2024-07-04 03:44:03,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:44:03.079934815Z [2024-07-04 03:44:03,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:44:03.082197135Z [2024-07-04 03:44:03,081: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:44:03.082305001Z [2024-07-04 03:44:03,082: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:44:03.082534778Z [2024-07-04 03:44:03,082: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:44:03.082643266Z [2024-07-04 03:44:03,082: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:44:03.083015153Z [2024-07-04 03:44:03,082: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:44:03.083185350Z [2024-07-04 03:44:03,082: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:44:03.224616493Z [2024-07-04 03:44:03,224: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:44:05.101187817Z [2024-07-04 03:44:05,100: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[97cf2b88-5818-4b04-82a8-1e1f490bc921] succeeded in 4.044748741000149s: None 2024-07-04T03:44:05.696906238Z [2024-07-04 03:44:05,696: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[045fa271-b869-4b07-8af1-75aa9bcdf443] succeeded in 4.610812949000319s: None 2024-07-04T03:45:00.351984074Z [2024-07-04 03:45:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afa95787-915b-4225-94cf-b00a59abcf98] received 2024-07-04T03:45:00.362443392Z [2024-07-04 03:45:00,362: INFO/ForkPoolWorker-15] [afa95787-915b-4225-94cf-b00a59abcf98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:45:00.366395525Z [2024-07-04 03:45:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed759c7-3c0c-4c2d-8412-ab6b5de143cb] received 2024-07-04T03:45:00.370454687Z [2024-07-04 03:45:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d247c03b-52be-417b-a113-bc0280645fa3] received 2024-07-04T03:45:00.397325900Z [2024-07-04 03:45:00,397: INFO/ForkPoolWorker-16] [8ed759c7-3c0c-4c2d-8412-ab6b5de143cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:45:00.414572157Z [2024-07-04 03:45:00,414: INFO/ForkPoolWorker-1] [d247c03b-52be-417b-a113-bc0280645fa3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:00.825479423Z [2024-07-04 03:45:00,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:45:00.850487925Z [2024-07-04 03:45:00,846: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:45:00.878329183Z [2024-07-04 03:45:00,865: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:45:02.537494062Z [2024-07-04 03:45:02,537: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:45:02.540896888Z [2024-07-04 03:45:02,540: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:02.602734431Z [2024-07-04 03:45:02,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:45:02.605692480Z [2024-07-04 03:45:02,605: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:02.605713722Z [2024-07-04 03:45:02,605: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:02.605993696Z [2024-07-04 03:45:02,605: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:02.606095754Z [2024-07-04 03:45:02,605: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:45:02.606534476Z [2024-07-04 03:45:02,606: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:45:02.606691919Z [2024-07-04 03:45:02,606: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:02.704348774Z [2024-07-04 03:45:02,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:02.745916552Z [2024-07-04 03:45:02,744: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:45:02.749275395Z [2024-07-04 03:45:02,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:02.789515147Z [2024-07-04 03:45:02,789: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:45:02.791178488Z [2024-07-04 03:45:02,790: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:02.791201593Z [2024-07-04 03:45:02,791: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:02.791396338Z [2024-07-04 03:45:02,791: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:02.791462619Z [2024-07-04 03:45:02,791: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:45:02.795044706Z [2024-07-04 03:45:02,792: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:45:02.795152141Z [2024-07-04 03:45:02,795: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:02.805421353Z [2024-07-04 03:45:02,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:45:02.812369563Z [2024-07-04 03:45:02,810: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:02.847493187Z [2024-07-04 03:45:02,847: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:45:02.850755671Z [2024-07-04 03:45:02,850: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:02.851035110Z [2024-07-04 03:45:02,850: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:02.851322422Z [2024-07-04 03:45:02,851: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:02.851485063Z [2024-07-04 03:45:02,851: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:45:02.851813511Z [2024-07-04 03:45:02,851: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:45:02.852437918Z [2024-07-04 03:45:02,852: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:02.890537864Z [2024-07-04 03:45:02,890: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:02.972800450Z [2024-07-04 03:45:02,972: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:03.409677392Z [2024-07-04 03:45:03,409: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d247c03b-52be-417b-a113-bc0280645fa3] succeeded in 3.0378502819985442s: None 2024-07-04T03:45:03.446348867Z [2024-07-04 03:45:03,446: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eacafeec-b225-4718-88dd-8bf975e8d1b9] received 2024-07-04T03:45:03.452546660Z [2024-07-04 03:45:03,452: INFO/ForkPoolWorker-1] [eacafeec-b225-4718-88dd-8bf975e8d1b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:03.758143360Z [2024-07-04 03:45:03,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:45:04.576247969Z [2024-07-04 03:45:04,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afa95787-915b-4225-94cf-b00a59abcf98] succeeded in 4.220928961998652s: None 2024-07-04T03:45:04.879441098Z [2024-07-04 03:45:04,879: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ed759c7-3c0c-4c2d-8412-ab6b5de143cb] succeeded in 4.507405958000163s: None 2024-07-04T03:45:05.079516210Z [2024-07-04 03:45:05,079: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:45:05.082751584Z [2024-07-04 03:45:05,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:05.117196291Z [2024-07-04 03:45:05,116: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:45:05.118785055Z [2024-07-04 03:45:05,118: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:05.119547715Z [2024-07-04 03:45:05,119: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:05.119733543Z [2024-07-04 03:45:05,119: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:05.119767434Z [2024-07-04 03:45:05,119: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:45:05.120168777Z [2024-07-04 03:45:05,119: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:45:05.120287791Z [2024-07-04 03:45:05,120: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:05.225605022Z [2024-07-04 03:45:05,225: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:05.994498999Z [2024-07-04 03:45:05,993: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eacafeec-b225-4718-88dd-8bf975e8d1b9] succeeded in 2.546328614998856s: None 2024-07-04T03:45:06.347262749Z [2024-07-04 03:45:06,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad6508a8-0ac7-469c-9cbf-6d720afc9c5a] received 2024-07-04T03:45:06.359507275Z [2024-07-04 03:45:06,359: INFO/ForkPoolWorker-15] [ad6508a8-0ac7-469c-9cbf-6d720afc9c5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:45:06.710711892Z [2024-07-04 03:45:06,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:45:07.828778026Z [2024-07-04 03:45:07,828: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:45:07.832103772Z [2024-07-04 03:45:07,831: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:07.875778774Z [2024-07-04 03:45:07,875: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:45:07.878019843Z [2024-07-04 03:45:07,877: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:07.878066611Z [2024-07-04 03:45:07,877: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:07.878314565Z [2024-07-04 03:45:07,877: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:07.878378481Z [2024-07-04 03:45:07,878: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:45:07.878704414Z [2024-07-04 03:45:07,878: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:45:07.878770663Z [2024-07-04 03:45:07,878: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:08.009546768Z [2024-07-04 03:45:08,009: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:08.748767098Z [2024-07-04 03:45:08,748: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad6508a8-0ac7-469c-9cbf-6d720afc9c5a] succeeded in 2.3992228330007492s: None 2024-07-04T03:45:08.756539369Z [2024-07-04 03:45:08,756: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a32d72b-8348-4703-b8d2-3146daad8aea] received 2024-07-04T03:45:08.765139561Z [2024-07-04 03:45:08,764: INFO/ForkPoolWorker-15] [5a32d72b-8348-4703-b8d2-3146daad8aea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:45:09.090468337Z [2024-07-04 03:45:09,087: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:45:10.223863732Z [2024-07-04 03:45:10,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:45:10.228066947Z [2024-07-04 03:45:10,227: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:45:10.270143488Z [2024-07-04 03:45:10,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:45:10.271684737Z [2024-07-04 03:45:10,271: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:45:10.271823544Z [2024-07-04 03:45:10,271: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:45:10.272052682Z [2024-07-04 03:45:10,271: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:45:10.272202152Z [2024-07-04 03:45:10,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:45:10.272597266Z [2024-07-04 03:45:10,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:45:10.272758443Z [2024-07-04 03:45:10,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:45:10.414485626Z [2024-07-04 03:45:10,413: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:45:11.009895769Z [2024-07-04 03:45:11,009: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a32d72b-8348-4703-b8d2-3146daad8aea] succeeded in 2.251079667999875s: None 2024-07-04T03:46:01.243860620Z [2024-07-04 03:46:01,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[632b2e1e-8a7e-4a58-b073-9045ac83b172] received 2024-07-04T03:46:01.248192693Z [2024-07-04 03:46:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c401f804-5ca0-4e2e-b3f6-83737a24ec86] received 2024-07-04T03:46:01.251664182Z [2024-07-04 03:46:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[885e42c4-89db-4588-8c12-afccf310d806] received 2024-07-04T03:46:01.268902499Z [2024-07-04 03:46:01,268: INFO/ForkPoolWorker-15] [632b2e1e-8a7e-4a58-b073-9045ac83b172] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:46:01.272440990Z [2024-07-04 03:46:01,271: INFO/ForkPoolWorker-16] [c401f804-5ca0-4e2e-b3f6-83737a24ec86] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:46:01.278698765Z [2024-07-04 03:46:01,278: INFO/ForkPoolWorker-1] [885e42c4-89db-4588-8c12-afccf310d806] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:46:01.579166463Z [2024-07-04 03:46:01,575: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:46:01.580885276Z [2024-07-04 03:46:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:46:01.585733417Z [2024-07-04 03:46:01,581: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:46:01.924952538Z [2024-07-04 03:46:01,922: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:46:02.463314644Z [2024-07-04 03:46:02,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[632b2e1e-8a7e-4a58-b073-9045ac83b172] succeeded in 1.2154554019998614s: None 2024-07-04T03:46:02.844501649Z [2024-07-04 03:46:02,843: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:46:02.847650256Z [2024-07-04 03:46:02,847: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:46:02.868098685Z [2024-07-04 03:46:02,867: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:46:02.869935018Z [2024-07-04 03:46:02,869: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:46:02.869969843Z [2024-07-04 03:46:02,869: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:46:02.870051624Z [2024-07-04 03:46:02,869: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:46:02.870283652Z [2024-07-04 03:46:02,869: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:46:02.871073705Z [2024-07-04 03:46:02,870: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:46:02.871151407Z [2024-07-04 03:46:02,870: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:46:02.903289748Z [2024-07-04 03:46:02,902: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:46:02.906519917Z [2024-07-04 03:46:02,906: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:46:02.937653829Z [2024-07-04 03:46:02,937: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:46:02.939042447Z [2024-07-04 03:46:02,938: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:46:02.939068634Z [2024-07-04 03:46:02,938: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:46:02.939185244Z [2024-07-04 03:46:02,939: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:46:02.939194765Z [2024-07-04 03:46:02,939: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:46:02.939434572Z [2024-07-04 03:46:02,939: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:46:02.939467769Z [2024-07-04 03:46:02,939: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:46:02.965234871Z [2024-07-04 03:46:02,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:46:03.024066099Z [2024-07-04 03:46:03,023: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:46:05.032364470Z [2024-07-04 03:46:05,031: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c401f804-5ca0-4e2e-b3f6-83737a24ec86] succeeded in 3.777382969001337s: None 2024-07-04T03:46:05.995233311Z [2024-07-04 03:46:05,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[885e42c4-89db-4588-8c12-afccf310d806] succeeded in 4.738459574000444s: None 2024-07-04T03:47:00.245126079Z [2024-07-04 03:47:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b51fcedf-09dd-4e92-bf7d-55c8d35fe809] received 2024-07-04T03:47:00.260626028Z [2024-07-04 03:47:00,260: INFO/ForkPoolWorker-15] [b51fcedf-09dd-4e92-bf7d-55c8d35fe809] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:47:00.266970743Z [2024-07-04 03:47:00,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e2714cf-3e7e-47d7-a374-74844d6e1a9c] received 2024-07-04T03:47:00.303800002Z [2024-07-04 03:47:00,303: INFO/ForkPoolWorker-16] [6e2714cf-3e7e-47d7-a374-74844d6e1a9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:47:00.590582326Z [2024-07-04 03:47:00,586: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:47:00.614068303Z [2024-07-04 03:47:00,610: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:47:01.975059825Z [2024-07-04 03:47:01,974: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:47:01.978306854Z [2024-07-04 03:47:01,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:47:02.013235449Z [2024-07-04 03:47:02,012: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:47:02.017917086Z [2024-07-04 03:47:02,017: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:47:02.018325575Z [2024-07-04 03:47:02,018: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:47:02.019122851Z [2024-07-04 03:47:02,018: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:47:02.019429062Z [2024-07-04 03:47:02,019: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:47:02.019839548Z [2024-07-04 03:47:02,019: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:47:02.019969240Z [2024-07-04 03:47:02,019: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:47:02.024160925Z [2024-07-04 03:47:02,023: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:47:02.027631895Z [2024-07-04 03:47:02,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:47:02.086662770Z [2024-07-04 03:47:02,086: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:47:02.089119206Z [2024-07-04 03:47:02,088: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:47:02.089150315Z [2024-07-04 03:47:02,089: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:47:02.089243823Z [2024-07-04 03:47:02,089: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:47:02.089268659Z [2024-07-04 03:47:02,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:47:02.089494767Z [2024-07-04 03:47:02,089: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:47:02.089525913Z [2024-07-04 03:47:02,089: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:47:02.121601873Z [2024-07-04 03:47:02,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:47:02.189826896Z [2024-07-04 03:47:02,189: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:47:03.597809730Z [2024-07-04 03:47:03,597: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e2714cf-3e7e-47d7-a374-74844d6e1a9c] succeeded in 3.3285568920000514s: None 2024-07-04T03:47:04.189520696Z [2024-07-04 03:47:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b51fcedf-09dd-4e92-bf7d-55c8d35fe809] succeeded in 3.941260482000871s: None 2024-07-04T03:48:01.147700647Z [2024-07-04 03:48:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d87311ce-a279-441e-a523-73f8692c8f15] received 2024-07-04T03:48:01.150487893Z [2024-07-04 03:48:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b283af6-ce35-4667-b6de-bd1f270929df] received 2024-07-04T03:48:01.170469366Z [2024-07-04 03:48:01,170: INFO/ForkPoolWorker-15] [d87311ce-a279-441e-a523-73f8692c8f15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:48:01.172445820Z [2024-07-04 03:48:01,172: INFO/ForkPoolWorker-16] [0b283af6-ce35-4667-b6de-bd1f270929df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:48:01.179391665Z [2024-07-04 03:48:01,179: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[770780fc-d00e-4dbe-b720-e289bf8380f6] received 2024-07-04T03:48:01.199171207Z [2024-07-04 03:48:01,198: INFO/ForkPoolWorker-1] [770780fc-d00e-4dbe-b720-e289bf8380f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:48:01.539977895Z [2024-07-04 03:48:01,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:48:01.555272176Z [2024-07-04 03:48:01,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:48:01.594279490Z [2024-07-04 03:48:01,590: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:48:01.897032334Z [2024-07-04 03:48:01,896: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:48:02.597212244Z [2024-07-04 03:48:02,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b283af6-ce35-4667-b6de-bd1f270929df] succeeded in 1.44294207799976s: None 2024-07-04T03:48:02.837123037Z [2024-07-04 03:48:02,836: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:48:02.842692590Z [2024-07-04 03:48:02,841: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:48:02.872737647Z [2024-07-04 03:48:02,872: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:48:02.874259231Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:48:02.874273278Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:48:02.874538469Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:48:02.874570905Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:48:02.874991595Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:48:02.875030434Z [2024-07-04 03:48:02,874: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:48:02.968032241Z [2024-07-04 03:48:02,967: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:48:03.159489775Z [2024-07-04 03:48:03,159: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:48:03.162943071Z [2024-07-04 03:48:03,162: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:48:03.200285470Z [2024-07-04 03:48:03,199: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:48:03.203724466Z [2024-07-04 03:48:03,203: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:48:03.203809810Z [2024-07-04 03:48:03,203: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:48:03.203855647Z [2024-07-04 03:48:03,203: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:48:03.203868930Z [2024-07-04 03:48:03,203: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:48:03.204118461Z [2024-07-04 03:48:03,203: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:48:03.204134308Z [2024-07-04 03:48:03,204: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:48:03.313227306Z [2024-07-04 03:48:03,312: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:48:05.128556483Z [2024-07-04 03:48:05,128: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d87311ce-a279-441e-a523-73f8692c8f15] succeeded in 3.9749373469985585s: None 2024-07-04T03:48:05.253253070Z [2024-07-04 03:48:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[770780fc-d00e-4dbe-b720-e289bf8380f6] succeeded in 4.069485058000282s: None 2024-07-04T03:49:01.017768070Z [2024-07-04 03:49:01,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[213555fc-a5ad-4be1-9c54-ce10ef256890] received 2024-07-04T03:49:01.027529494Z [2024-07-04 03:49:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af4d6a0d-df7d-4639-b080-8b44781d6f8a] received 2024-07-04T03:49:01.048759781Z [2024-07-04 03:49:01,048: INFO/ForkPoolWorker-16] [af4d6a0d-df7d-4639-b080-8b44781d6f8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:49:01.049071750Z [2024-07-04 03:49:01,048: INFO/ForkPoolWorker-15] [213555fc-a5ad-4be1-9c54-ce10ef256890] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:49:01.354420248Z [2024-07-04 03:49:01,350: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:49:01.378726095Z [2024-07-04 03:49:01,374: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:49:02.604701253Z [2024-07-04 03:49:02,604: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:49:02.607872151Z [2024-07-04 03:49:02,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:49:02.617921514Z [2024-07-04 03:49:02,617: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:49:02.621675411Z [2024-07-04 03:49:02,621: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:49:02.637915743Z [2024-07-04 03:49:02,637: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:49:02.641066927Z [2024-07-04 03:49:02,640: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:49:02.641264150Z [2024-07-04 03:49:02,641: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:49:02.641460441Z [2024-07-04 03:49:02,641: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:49:02.641561290Z [2024-07-04 03:49:02,641: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:49:02.642125370Z [2024-07-04 03:49:02,641: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:49:02.642499275Z [2024-07-04 03:49:02,642: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:49:02.651557228Z [2024-07-04 03:49:02,651: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:49:02.655985002Z [2024-07-04 03:49:02,655: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:49:02.657407990Z [2024-07-04 03:49:02,657: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:49:02.657606083Z [2024-07-04 03:49:02,657: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:49:02.657665697Z [2024-07-04 03:49:02,657: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:49:02.658137315Z [2024-07-04 03:49:02,657: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:49:02.658234094Z [2024-07-04 03:49:02,658: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:49:02.755979881Z [2024-07-04 03:49:02,755: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:49:02.757266347Z [2024-07-04 03:49:02,756: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:49:04.412919054Z [2024-07-04 03:49:04,412: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[213555fc-a5ad-4be1-9c54-ce10ef256890] succeeded in 3.3913493110012496s: None 2024-07-04T03:49:04.616178990Z [2024-07-04 03:49:04,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af4d6a0d-df7d-4639-b080-8b44781d6f8a] succeeded in 3.581920167000135s: None 2024-07-04T03:50:01.014033779Z [2024-07-04 03:50:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c651ed4f-9480-41b6-bfd8-6eee6806717a] received 2024-07-04T03:50:01.022709889Z [2024-07-04 03:50:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[377decb1-7488-40d2-ab89-520e0a9f3c63] received 2024-07-04T03:50:01.024951821Z [2024-07-04 03:50:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1d42b2c-c0a1-4b1e-bebf-eb7cf4981b5d] received 2024-07-04T03:50:01.035435321Z [2024-07-04 03:50:01,035: INFO/ForkPoolWorker-15] [c651ed4f-9480-41b6-bfd8-6eee6806717a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:50:01.038047365Z [2024-07-04 03:50:01,037: INFO/ForkPoolWorker-16] [377decb1-7488-40d2-ab89-520e0a9f3c63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:50:01.049332278Z [2024-07-04 03:50:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b51c17-6d73-4df3-9117-72ce2cef84af] received 2024-07-04T03:50:01.060846469Z [2024-07-04 03:50:01,060: INFO/ForkPoolWorker-1] [e1d42b2c-c0a1-4b1e-bebf-eb7cf4981b5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:01.088607215Z [2024-07-04 03:50:01,088: INFO/ForkPoolWorker-2] [34b51c17-6d73-4df3-9117-72ce2cef84af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:50:01.406157729Z [2024-07-04 03:50:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:50:01.627865021Z [2024-07-04 03:50:01,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:50:01.716700908Z [2024-07-04 03:50:01,711: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:50:01.780861869Z [2024-07-04 03:50:01,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:50:02.129070525Z [2024-07-04 03:50:02,128: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:02.881636466Z [2024-07-04 03:50:02,881: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[34b51c17-6d73-4df3-9117-72ce2cef84af] succeeded in 1.819837267999901s: None 2024-07-04T03:50:03.265999701Z [2024-07-04 03:50:03,265: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:50:03.269197593Z [2024-07-04 03:50:03,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:03.309258221Z [2024-07-04 03:50:03,308: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:50:03.313705332Z [2024-07-04 03:50:03,313: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:03.314409208Z [2024-07-04 03:50:03,313: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:03.315164261Z [2024-07-04 03:50:03,314: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:03.315554488Z [2024-07-04 03:50:03,315: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:50:03.316648664Z [2024-07-04 03:50:03,316: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:50:03.317308487Z [2024-07-04 03:50:03,316: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:03.406689970Z [2024-07-04 03:50:03,406: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:50:03.409878837Z [2024-07-04 03:50:03,409: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:03.426165659Z [2024-07-04 03:50:03,425: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:03.445502614Z [2024-07-04 03:50:03,445: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:50:03.447004933Z [2024-07-04 03:50:03,446: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:03.447342682Z [2024-07-04 03:50:03,447: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:03.447558956Z [2024-07-04 03:50:03,447: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:03.447664339Z [2024-07-04 03:50:03,447: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:50:03.447976127Z [2024-07-04 03:50:03,447: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:50:03.448531925Z [2024-07-04 03:50:03,448: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:03.491905906Z [2024-07-04 03:50:03,491: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:50:03.495566808Z [2024-07-04 03:50:03,495: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:03.546738936Z [2024-07-04 03:50:03,546: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:50:03.548179238Z [2024-07-04 03:50:03,547: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:03.548190308Z [2024-07-04 03:50:03,547: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:03.548195449Z [2024-07-04 03:50:03,548: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:03.548199089Z [2024-07-04 03:50:03,548: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:50:03.548426564Z [2024-07-04 03:50:03,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:50:03.548825046Z [2024-07-04 03:50:03,548: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:03.565009007Z [2024-07-04 03:50:03,564: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:03.646530486Z [2024-07-04 03:50:03,646: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:04.352603180Z [2024-07-04 03:50:04,351: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e1d42b2c-c0a1-4b1e-bebf-eb7cf4981b5d] succeeded in 3.3224894190007035s: None 2024-07-04T03:50:04.798756211Z [2024-07-04 03:50:04,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c115671-f132-481b-a48e-12f526b2c6fb] received 2024-07-04T03:50:04.819012792Z [2024-07-04 03:50:04,818: INFO/ForkPoolWorker-1] [3c115671-f132-481b-a48e-12f526b2c6fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:05.108552829Z [2024-07-04 03:50:05,104: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:50:05.399969090Z [2024-07-04 03:50:05,399: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c651ed4f-9480-41b6-bfd8-6eee6806717a] succeeded in 4.384328341999208s: None 2024-07-04T03:50:05.457395335Z [2024-07-04 03:50:05,456: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[377decb1-7488-40d2-ab89-520e0a9f3c63] succeeded in 4.432189831999494s: None 2024-07-04T03:50:06.354526293Z [2024-07-04 03:50:06,354: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:50:06.357714117Z [2024-07-04 03:50:06,357: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:06.404650496Z [2024-07-04 03:50:06,404: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:50:06.407117338Z [2024-07-04 03:50:06,406: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:06.407286946Z [2024-07-04 03:50:06,407: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:06.407595213Z [2024-07-04 03:50:06,407: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:06.407752758Z [2024-07-04 03:50:06,407: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:50:06.409273945Z [2024-07-04 03:50:06,409: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:50:06.409390373Z [2024-07-04 03:50:06,409: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:06.512647458Z [2024-07-04 03:50:06,512: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:07.203811745Z [2024-07-04 03:50:07,203: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3c115671-f132-481b-a48e-12f526b2c6fb] succeeded in 2.3996781620007823s: None 2024-07-04T03:50:07.614956922Z [2024-07-04 03:50:07,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35e5899f-c9c3-4a83-b406-fb5cae47a505] received 2024-07-04T03:50:07.626800816Z [2024-07-04 03:50:07,626: INFO/ForkPoolWorker-15] [35e5899f-c9c3-4a83-b406-fb5cae47a505] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:50:07.900135766Z [2024-07-04 03:50:07,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:50:09.030529867Z [2024-07-04 03:50:09,030: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:50:09.033820091Z [2024-07-04 03:50:09,033: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:09.064284956Z [2024-07-04 03:50:09,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:50:09.066611228Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:09.066626388Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:09.066731024Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:09.066768786Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:50:09.066996969Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:50:09.067014397Z [2024-07-04 03:50:09,066: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:09.158937534Z [2024-07-04 03:50:09,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:09.809651838Z [2024-07-04 03:50:09,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35e5899f-c9c3-4a83-b406-fb5cae47a505] succeeded in 2.1900125880001724s: None 2024-07-04T03:50:09.869404208Z [2024-07-04 03:50:09,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45b7cedc-002b-4b53-bcf3-2a2cb1a42e84] received 2024-07-04T03:50:09.879064041Z [2024-07-04 03:50:09,875: INFO/ForkPoolWorker-15] [45b7cedc-002b-4b53-bcf3-2a2cb1a42e84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:50:10.322644336Z [2024-07-04 03:50:10,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:50:11.579236678Z [2024-07-04 03:50:11,578: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:50:11.582765625Z [2024-07-04 03:50:11,582: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:50:11.615297795Z [2024-07-04 03:50:11,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:50:11.616504156Z [2024-07-04 03:50:11,616: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:50:11.616517847Z [2024-07-04 03:50:11,616: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:50:11.616698667Z [2024-07-04 03:50:11,616: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:50:11.616819817Z [2024-07-04 03:50:11,616: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:50:11.618359249Z [2024-07-04 03:50:11,618: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:50:11.618372850Z [2024-07-04 03:50:11,618: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:50:11.729915553Z [2024-07-04 03:50:11,729: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:50:12.406018180Z [2024-07-04 03:50:12,405: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45b7cedc-002b-4b53-bcf3-2a2cb1a42e84] succeeded in 2.5365247320005437s: None 2024-07-04T03:51:00.716457730Z [2024-07-04 03:51:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c28e70bd-cf05-4b6a-b271-7c7d8a655f29] received 2024-07-04T03:51:00.735003712Z [2024-07-04 03:51:00,734: INFO/ForkPoolWorker-15] [c28e70bd-cf05-4b6a-b271-7c7d8a655f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:51:00.760706810Z [2024-07-04 03:51:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22976a9a-b032-4d41-8892-faeecd1945d8] received 2024-07-04T03:51:00.783205420Z [2024-07-04 03:51:00,782: INFO/ForkPoolWorker-16] [22976a9a-b032-4d41-8892-faeecd1945d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:51:01.136618424Z [2024-07-04 03:51:01,132: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:51:01.164936775Z [2024-07-04 03:51:01,161: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:51:02.350400147Z [2024-07-04 03:51:02,350: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:51:02.353766890Z [2024-07-04 03:51:02,353: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:51:02.360693222Z [2024-07-04 03:51:02,360: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:51:02.364139864Z [2024-07-04 03:51:02,363: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:51:02.391599489Z [2024-07-04 03:51:02,391: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:51:02.392153192Z [2024-07-04 03:51:02,391: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:51:02.393114474Z [2024-07-04 03:51:02,392: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:51:02.393138359Z [2024-07-04 03:51:02,393: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:51:02.393278368Z [2024-07-04 03:51:02,393: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:51:02.393315263Z [2024-07-04 03:51:02,393: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:51:02.393538847Z [2024-07-04 03:51:02,393: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:51:02.393579574Z [2024-07-04 03:51:02,393: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:51:02.394458052Z [2024-07-04 03:51:02,394: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:51:02.394609153Z [2024-07-04 03:51:02,394: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:51:02.395515848Z [2024-07-04 03:51:02,395: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:51:02.395549073Z [2024-07-04 03:51:02,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:51:02.396592278Z [2024-07-04 03:51:02,396: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:51:02.396721218Z [2024-07-04 03:51:02,396: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:51:02.473245851Z [2024-07-04 03:51:02,472: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:51:02.473849820Z [2024-07-04 03:51:02,473: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:51:04.085367189Z [2024-07-04 03:51:04,084: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22976a9a-b032-4d41-8892-faeecd1945d8] succeeded in 3.3216158600007475s: None 2024-07-04T03:51:04.744201958Z [2024-07-04 03:51:04,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c28e70bd-cf05-4b6a-b271-7c7d8a655f29] succeeded in 4.023410027000864s: None 2024-07-04T03:52:00.666658329Z [2024-07-04 03:52:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55697f8a-b5ad-48ab-b022-0701b447c727] received 2024-07-04T03:52:00.678155952Z [2024-07-04 03:52:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e5bffaf-c282-43e3-9ff1-fe708f50a3af] received 2024-07-04T03:52:00.678795793Z [2024-07-04 03:52:00,678: INFO/ForkPoolWorker-15] [55697f8a-b5ad-48ab-b022-0701b447c727] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:52:00.683783490Z [2024-07-04 03:52:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f2f1b9f-fc50-4520-9177-56a144458b5c] received 2024-07-04T03:52:00.690930986Z [2024-07-04 03:52:00,690: INFO/ForkPoolWorker-16] [5e5bffaf-c282-43e3-9ff1-fe708f50a3af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:52:00.704727653Z [2024-07-04 03:52:00,704: INFO/ForkPoolWorker-1] [1f2f1b9f-fc50-4520-9177-56a144458b5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:52:01.023977741Z [2024-07-04 03:52:01,020: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:52:01.190124377Z [2024-07-04 03:52:01,187: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:52:01.308738456Z [2024-07-04 03:52:01,302: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:52:01.439871948Z [2024-07-04 03:52:01,439: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:52:02.128033509Z [2024-07-04 03:52:02,127: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e5bffaf-c282-43e3-9ff1-fe708f50a3af] succeeded in 1.4472402540013718s: None 2024-07-04T03:52:02.419874793Z [2024-07-04 03:52:02,419: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:52:02.423712148Z [2024-07-04 03:52:02,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:52:02.459648134Z [2024-07-04 03:52:02,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:52:02.463399217Z [2024-07-04 03:52:02,462: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:52:02.463872820Z [2024-07-04 03:52:02,463: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:52:02.464339532Z [2024-07-04 03:52:02,463: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:52:02.464653253Z [2024-07-04 03:52:02,464: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:52:02.465320404Z [2024-07-04 03:52:02,465: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:52:02.465758061Z [2024-07-04 03:52:02,465: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:52:02.578226249Z [2024-07-04 03:52:02,577: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:52:02.737321325Z [2024-07-04 03:52:02,736: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:52:02.740576613Z [2024-07-04 03:52:02,740: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:52:02.773710376Z [2024-07-04 03:52:02,773: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:52:02.775691632Z [2024-07-04 03:52:02,775: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:52:02.776022616Z [2024-07-04 03:52:02,775: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:52:02.776337526Z [2024-07-04 03:52:02,776: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:52:02.776555584Z [2024-07-04 03:52:02,776: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:52:02.776999068Z [2024-07-04 03:52:02,776: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:52:02.777104659Z [2024-07-04 03:52:02,776: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:52:02.883009133Z [2024-07-04 03:52:02,882: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:52:04.115360966Z [2024-07-04 03:52:04,114: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55697f8a-b5ad-48ab-b022-0701b447c727] succeeded in 3.4461972059998516s: None 2024-07-04T03:52:05.682321074Z [2024-07-04 03:52:05,681: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f2f1b9f-fc50-4520-9177-56a144458b5c] succeeded in 4.993620277000446s: None 2024-07-04T03:53:00.451355098Z [2024-07-04 03:53:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e18a62c7-2bb0-4176-b9d9-03fa1d34a090] received 2024-07-04T03:53:00.457007873Z [2024-07-04 03:53:00,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05f29f20-eb7c-423a-a275-43fd72c650a9] received 2024-07-04T03:53:00.487342056Z [2024-07-04 03:53:00,486: INFO/ForkPoolWorker-16] [05f29f20-eb7c-423a-a275-43fd72c650a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:53:00.489949369Z [2024-07-04 03:53:00,489: INFO/ForkPoolWorker-15] [e18a62c7-2bb0-4176-b9d9-03fa1d34a090] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:53:00.872614632Z [2024-07-04 03:53:00,868: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:53:00.892928016Z [2024-07-04 03:53:00,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:53:02.209502973Z [2024-07-04 03:53:02,209: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:53:02.213110684Z [2024-07-04 03:53:02,212: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:53:02.242580533Z [2024-07-04 03:53:02,242: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:53:02.245375256Z [2024-07-04 03:53:02,245: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:53:02.245644960Z [2024-07-04 03:53:02,245: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:53:02.245860565Z [2024-07-04 03:53:02,245: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:53:02.246009960Z [2024-07-04 03:53:02,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:53:02.246419604Z [2024-07-04 03:53:02,246: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:53:02.246544441Z [2024-07-04 03:53:02,246: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:53:02.268583150Z [2024-07-04 03:53:02,268: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:53:02.274082660Z [2024-07-04 03:53:02,273: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:53:02.310530960Z [2024-07-04 03:53:02,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:53:02.312374388Z [2024-07-04 03:53:02,312: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:53:02.312563652Z [2024-07-04 03:53:02,312: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:53:02.312843883Z [2024-07-04 03:53:02,312: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:53:02.313087401Z [2024-07-04 03:53:02,312: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:53:02.313474971Z [2024-07-04 03:53:02,313: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:53:02.314140338Z [2024-07-04 03:53:02,313: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:53:02.356820116Z [2024-07-04 03:53:02,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:53:02.410840459Z [2024-07-04 03:53:02,410: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:53:04.502750236Z [2024-07-04 03:53:04,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05f29f20-eb7c-423a-a275-43fd72c650a9] succeeded in 4.043188763000217s: None 2024-07-04T03:53:05.077423533Z [2024-07-04 03:53:05,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e18a62c7-2bb0-4176-b9d9-03fa1d34a090] succeeded in 4.620800882999902s: None 2024-07-04T03:54:00.435738281Z [2024-07-04 03:54:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46b99757-2dae-48f0-92fc-0574d2b344f0] received 2024-07-04T03:54:00.445777126Z [2024-07-04 03:54:00,445: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3835e176-784e-42f8-8f1b-e98dd5a04a28] received 2024-07-04T03:54:00.452913632Z [2024-07-04 03:54:00,452: INFO/ForkPoolWorker-15] [46b99757-2dae-48f0-92fc-0574d2b344f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:54:00.455300039Z [2024-07-04 03:54:00,455: INFO/ForkPoolWorker-16] [3835e176-784e-42f8-8f1b-e98dd5a04a28] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:54:00.465125220Z [2024-07-04 03:54:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2cb7f8d-fa33-4d96-9d8b-d23eabd437bc] received 2024-07-04T03:54:00.500067423Z [2024-07-04 03:54:00,499: INFO/ForkPoolWorker-1] [e2cb7f8d-fa33-4d96-9d8b-d23eabd437bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:54:00.867868898Z [2024-07-04 03:54:00,864: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:54:01.070585000Z [2024-07-04 03:54:01,066: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:54:01.140686350Z [2024-07-04 03:54:01,137: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:54:01.513983773Z [2024-07-04 03:54:01,513: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:54:02.304890889Z [2024-07-04 03:54:02,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3835e176-784e-42f8-8f1b-e98dd5a04a28] succeeded in 1.8569284539989894s: None 2024-07-04T03:54:02.524153245Z [2024-07-04 03:54:02,523: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:54:02.527756571Z [2024-07-04 03:54:02,527: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:54:02.561831299Z [2024-07-04 03:54:02,561: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:54:02.566123388Z [2024-07-04 03:54:02,565: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:54:02.566252599Z [2024-07-04 03:54:02,566: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:54:02.566480375Z [2024-07-04 03:54:02,566: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:54:02.566622615Z [2024-07-04 03:54:02,566: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:54:02.567044918Z [2024-07-04 03:54:02,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:54:02.567256112Z [2024-07-04 03:54:02,567: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:54:02.611577653Z [2024-07-04 03:54:02,611: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:54:02.622550373Z [2024-07-04 03:54:02,622: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:54:02.653177176Z [2024-07-04 03:54:02,652: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:54:02.654735806Z [2024-07-04 03:54:02,654: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:54:02.654885154Z [2024-07-04 03:54:02,654: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:54:02.655111080Z [2024-07-04 03:54:02,654: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:54:02.655230778Z [2024-07-04 03:54:02,655: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:54:02.655548190Z [2024-07-04 03:54:02,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:54:02.656054366Z [2024-07-04 03:54:02,655: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:54:02.666780041Z [2024-07-04 03:54:02,666: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:54:02.756179051Z [2024-07-04 03:54:02,755: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:54:04.437494805Z [2024-07-04 03:54:04,436: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46b99757-2dae-48f0-92fc-0574d2b344f0] succeeded in 3.998791901000004s: None 2024-07-04T03:54:05.156884338Z [2024-07-04 03:54:05,155: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2cb7f8d-fa33-4d96-9d8b-d23eabd437bc] succeeded in 4.687430706000669s: None 2024-07-04T03:55:00.250674972Z [2024-07-04 03:55:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e923b18-36d1-4be9-80a2-3b04ebe3d68b] received 2024-07-04T03:55:00.270235468Z [2024-07-04 03:55:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73810c6a-2a86-4a80-89db-cdca2593af32] received 2024-07-04T03:55:00.274234253Z [2024-07-04 03:55:00,272: INFO/ForkPoolWorker-15] [8e923b18-36d1-4be9-80a2-3b04ebe3d68b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:55:00.296484089Z [2024-07-04 03:55:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2eea6c5-2f67-4679-a72b-272747a7f33a] received 2024-07-04T03:55:00.324086029Z [2024-07-04 03:55:00,323: INFO/ForkPoolWorker-16] [73810c6a-2a86-4a80-89db-cdca2593af32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:55:00.326329549Z [2024-07-04 03:55:00,325: INFO/ForkPoolWorker-1] [d2eea6c5-2f67-4679-a72b-272747a7f33a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:00.634073419Z [2024-07-04 03:55:00,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:55:00.889209755Z [2024-07-04 03:55:00,884: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:55:00.918104314Z [2024-07-04 03:55:00,913: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:55:02.092751403Z [2024-07-04 03:55:02,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:55:02.096328116Z [2024-07-04 03:55:02,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:02.133062723Z [2024-07-04 03:55:02,132: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:55:02.135225291Z [2024-07-04 03:55:02,134: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:02.135794981Z [2024-07-04 03:55:02,135: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:02.136024043Z [2024-07-04 03:55:02,135: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:02.136172851Z [2024-07-04 03:55:02,135: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:55:02.136857959Z [2024-07-04 03:55:02,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:55:02.137043257Z [2024-07-04 03:55:02,136: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:02.198946355Z [2024-07-04 03:55:02,198: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:55:02.202210249Z [2024-07-04 03:55:02,201: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:02.227815886Z [2024-07-04 03:55:02,227: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:02.234918875Z [2024-07-04 03:55:02,234: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:55:02.236149182Z [2024-07-04 03:55:02,235: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:02.236277777Z [2024-07-04 03:55:02,236: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:02.236468497Z [2024-07-04 03:55:02,236: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:02.236628386Z [2024-07-04 03:55:02,236: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:55:02.237526978Z [2024-07-04 03:55:02,237: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:55:02.237653157Z [2024-07-04 03:55:02,237: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:02.328752957Z [2024-07-04 03:55:02,328: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:02.518209876Z [2024-07-04 03:55:02,517: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:55:02.522130851Z [2024-07-04 03:55:02,521: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:02.553291232Z [2024-07-04 03:55:02,553: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:55:02.554988054Z [2024-07-04 03:55:02,554: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:02.555007247Z [2024-07-04 03:55:02,554: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:02.555130861Z [2024-07-04 03:55:02,554: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:02.555167138Z [2024-07-04 03:55:02,555: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:55:02.555573032Z [2024-07-04 03:55:02,555: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:55:02.555587930Z [2024-07-04 03:55:02,555: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:02.644080621Z [2024-07-04 03:55:02,643: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:03.256886029Z [2024-07-04 03:55:03,256: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2eea6c5-2f67-4679-a72b-272747a7f33a] succeeded in 2.9577570629990078s: None 2024-07-04T03:55:03.729953030Z [2024-07-04 03:55:03,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e923b18-36d1-4be9-80a2-3b04ebe3d68b] succeeded in 3.4737684589999844s: None 2024-07-04T03:55:04.012896324Z [2024-07-04 03:55:04,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63219cbf-0e55-46c4-af7f-a8acade3e494] received 2024-07-04T03:55:04.021838759Z [2024-07-04 03:55:04,021: INFO/ForkPoolWorker-15] [63219cbf-0e55-46c4-af7f-a8acade3e494] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:04.284172416Z [2024-07-04 03:55:04,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73810c6a-2a86-4a80-89db-cdca2593af32] succeeded in 4.003214633001335s: None 2024-07-04T03:55:04.334234579Z [2024-07-04 03:55:04,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:55:05.502651260Z [2024-07-04 03:55:05,502: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:55:05.505826424Z [2024-07-04 03:55:05,505: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:05.536044666Z [2024-07-04 03:55:05,535: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:55:05.537714937Z [2024-07-04 03:55:05,537: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:05.537734693Z [2024-07-04 03:55:05,537: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:05.537922717Z [2024-07-04 03:55:05,537: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:05.537963263Z [2024-07-04 03:55:05,537: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:55:05.538274668Z [2024-07-04 03:55:05,538: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:55:05.538545952Z [2024-07-04 03:55:05,538: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:05.642581095Z [2024-07-04 03:55:05,642: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:06.347564237Z [2024-07-04 03:55:06,347: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63219cbf-0e55-46c4-af7f-a8acade3e494] succeeded in 2.3319714139997814s: None 2024-07-04T03:55:06.771697738Z [2024-07-04 03:55:06,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7bb55274-b23e-4b10-b30f-805c790bd666] received 2024-07-04T03:55:06.782860392Z [2024-07-04 03:55:06,782: INFO/ForkPoolWorker-15] [7bb55274-b23e-4b10-b30f-805c790bd666] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T03:55:07.096425304Z [2024-07-04 03:55:07,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:55:08.183354108Z [2024-07-04 03:55:08,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:55:08.186785339Z [2024-07-04 03:55:08,186: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:08.220264279Z [2024-07-04 03:55:08,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:55:08.222343682Z [2024-07-04 03:55:08,221: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:08.222933398Z [2024-07-04 03:55:08,222: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:08.223476068Z [2024-07-04 03:55:08,223: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:08.223544832Z [2024-07-04 03:55:08,223: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:55:08.223899723Z [2024-07-04 03:55:08,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:55:08.223968023Z [2024-07-04 03:55:08,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:08.333091025Z [2024-07-04 03:55:08,332: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:08.897457832Z [2024-07-04 03:55:08,896: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7bb55274-b23e-4b10-b30f-805c790bd666] succeeded in 2.1226827329992375s: None 2024-07-04T03:55:09.179249943Z [2024-07-04 03:55:09,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d8ff105-4b8f-4fe3-ac08-76924113632d] received 2024-07-04T03:55:09.193858490Z [2024-07-04 03:55:09,193: INFO/ForkPoolWorker-15] [5d8ff105-4b8f-4fe3-ac08-76924113632d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T03:55:09.521990755Z [2024-07-04 03:55:09,517: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T03:55:10.722251979Z [2024-07-04 03:55:10,721: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:55:10.725724971Z [2024-07-04 03:55:10,725: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:55:10.747566892Z [2024-07-04 03:55:10,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:55:10.749334935Z [2024-07-04 03:55:10,749: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:55:10.750232320Z [2024-07-04 03:55:10,749: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:55:10.750470787Z [2024-07-04 03:55:10,750: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:55:10.750588670Z [2024-07-04 03:55:10,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:55:10.751267131Z [2024-07-04 03:55:10,751: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T03:55:10.751311582Z [2024-07-04 03:55:10,751: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:55:10.844447758Z [2024-07-04 03:55:10,844: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:55:11.495469607Z [2024-07-04 03:55:11,494: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d8ff105-4b8f-4fe3-ac08-76924113632d] succeeded in 2.3120143619999s: None 2024-07-04T03:56:00.207840520Z [2024-07-04 03:56:00,207: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a53c1e1-7b77-44bb-8531-323855e3d107] received 2024-07-04T03:56:00.215033582Z [2024-07-04 03:56:00,214: INFO/ForkPoolWorker-15] [6a53c1e1-7b77-44bb-8531-323855e3d107] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:56:00.221999528Z [2024-07-04 03:56:00,221: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f8f040-0695-4e31-ac7c-dba6d2681142] received 2024-07-04T03:56:00.224573561Z [2024-07-04 03:56:00,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47f20fdd-0043-4f25-a101-8b9d2a202b30] received 2024-07-04T03:56:00.245626796Z [2024-07-04 03:56:00,245: INFO/ForkPoolWorker-1] [47f20fdd-0043-4f25-a101-8b9d2a202b30] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:56:00.256496054Z [2024-07-04 03:56:00,256: INFO/ForkPoolWorker-16] [c5f8f040-0695-4e31-ac7c-dba6d2681142] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:56:00.544714725Z [2024-07-04 03:56:00,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:56:00.678565936Z [2024-07-04 03:56:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:56:00.728520028Z [2024-07-04 03:56:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:56:01.247004987Z [2024-07-04 03:56:01,246: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:56:01.902969945Z [2024-07-04 03:56:01,899: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:56:01.907060394Z [2024-07-04 03:56:01,903: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:56:01.952228398Z [2024-07-04 03:56:01,951: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[47f20fdd-0043-4f25-a101-8b9d2a202b30] succeeded in 1.7260912120000285s: None 2024-07-04T03:56:01.966800998Z [2024-07-04 03:56:01,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:56:01.968060064Z [2024-07-04 03:56:01,967: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:56:01.968120906Z [2024-07-04 03:56:01,968: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:56:01.968276209Z [2024-07-04 03:56:01,968: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:56:01.968341323Z [2024-07-04 03:56:01,968: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:56:01.968779101Z [2024-07-04 03:56:01,968: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:56:01.971119111Z [2024-07-04 03:56:01,970: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:56:02.067387195Z [2024-07-04 03:56:02,067: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:56:02.080018222Z [2024-07-04 03:56:02,079: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:56:02.083561708Z [2024-07-04 03:56:02,083: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:56:02.112881857Z [2024-07-04 03:56:02,112: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:56:02.115427276Z [2024-07-04 03:56:02,115: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:56:02.116092222Z [2024-07-04 03:56:02,115: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:56:02.116551140Z [2024-07-04 03:56:02,116: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:56:02.116678912Z [2024-07-04 03:56:02,116: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:56:02.117028391Z [2024-07-04 03:56:02,116: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:56:02.117882829Z [2024-07-04 03:56:02,117: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:56:02.230524819Z [2024-07-04 03:56:02,230: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:56:03.787005300Z [2024-07-04 03:56:03,785: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5f8f040-0695-4e31-ac7c-dba6d2681142] succeeded in 3.5627346229994146s: None 2024-07-04T03:56:04.079077706Z [2024-07-04 03:56:04,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a53c1e1-7b77-44bb-8531-323855e3d107] succeeded in 3.869157717001144s: None 2024-07-04T03:57:00.827506374Z [2024-07-04 03:57:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39638ff6-3655-4b96-bbe8-ca50ebaccebd] received 2024-07-04T03:57:00.830654688Z [2024-07-04 03:57:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e485f3d8-98aa-462c-9530-4d73ff79461c] received 2024-07-04T03:57:00.859669032Z [2024-07-04 03:57:00,859: INFO/ForkPoolWorker-15] [39638ff6-3655-4b96-bbe8-ca50ebaccebd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:57:00.884903380Z [2024-07-04 03:57:00,884: INFO/ForkPoolWorker-16] [e485f3d8-98aa-462c-9530-4d73ff79461c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:57:01.214809144Z [2024-07-04 03:57:01,209: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:57:01.263947857Z [2024-07-04 03:57:01,259: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:57:02.547299924Z [2024-07-04 03:57:02,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:57:02.550950307Z [2024-07-04 03:57:02,550: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:57:02.567471435Z [2024-07-04 03:57:02,567: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:57:02.571093624Z [2024-07-04 03:57:02,570: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:57:02.601592286Z [2024-07-04 03:57:02,601: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:57:02.603483333Z [2024-07-04 03:57:02,603: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:57:02.603503222Z [2024-07-04 03:57:02,603: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:57:02.603849327Z [2024-07-04 03:57:02,603: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:57:02.603858661Z [2024-07-04 03:57:02,603: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:57:02.604169367Z [2024-07-04 03:57:02,603: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:57:02.604280968Z [2024-07-04 03:57:02,604: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:57:02.607674958Z [2024-07-04 03:57:02,607: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:57:02.609571653Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:57:02.609593021Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:57:02.609754518Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:57:02.609761923Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:57:02.610023701Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:57:02.610087383Z [2024-07-04 03:57:02,609: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:57:02.706548086Z [2024-07-04 03:57:02,706: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:57:02.712151662Z [2024-07-04 03:57:02,711: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:57:04.837453205Z [2024-07-04 03:57:04,836: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e485f3d8-98aa-462c-9530-4d73ff79461c] succeeded in 3.991696220000449s: None 2024-07-04T03:57:05.314019439Z [2024-07-04 03:57:05,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39638ff6-3655-4b96-bbe8-ca50ebaccebd] succeeded in 4.476804686999458s: None 2024-07-04T03:58:00.875905218Z [2024-07-04 03:58:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c550653-95bd-4759-9891-601d83eeb79b] received 2024-07-04T03:58:00.893548002Z [2024-07-04 03:58:00,893: INFO/ForkPoolWorker-15] [9c550653-95bd-4759-9891-601d83eeb79b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:58:00.911739156Z [2024-07-04 03:58:00,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e77aa6c3-ef0a-4200-8731-bc20117afe36] received 2024-07-04T03:58:00.918478550Z [2024-07-04 03:58:00,918: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f7ce515-68c6-4986-859a-31c2e5ad70cd] received 2024-07-04T03:58:00.934855137Z [2024-07-04 03:58:00,934: INFO/ForkPoolWorker-1] [1f7ce515-68c6-4986-859a-31c2e5ad70cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:58:00.951783495Z [2024-07-04 03:58:00,951: INFO/ForkPoolWorker-16] [e77aa6c3-ef0a-4200-8731-bc20117afe36] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T03:58:01.268559966Z [2024-07-04 03:58:01,264: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T03:58:01.269622102Z [2024-07-04 03:58:01,265: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:58:01.337916160Z [2024-07-04 03:58:01,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:58:01.616384480Z [2024-07-04 03:58:01,616: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:58:02.225964649Z [2024-07-04 03:58:02,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e77aa6c3-ef0a-4200-8731-bc20117afe36] succeeded in 1.3097169130014663s: None 2024-07-04T03:58:02.561735941Z [2024-07-04 03:58:02,561: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T03:58:02.565202647Z [2024-07-04 03:58:02,564: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:58:02.608952877Z [2024-07-04 03:58:02,608: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:58:02.612943443Z [2024-07-04 03:58:02,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:58:02.615281941Z [2024-07-04 03:58:02,614: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T03:58:02.616965917Z [2024-07-04 03:58:02,616: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:58:02.617064846Z [2024-07-04 03:58:02,616: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:58:02.617276434Z [2024-07-04 03:58:02,617: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:58:02.617420285Z [2024-07-04 03:58:02,617: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T03:58:02.617803095Z [2024-07-04 03:58:02,617: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:58:02.617925586Z [2024-07-04 03:58:02,617: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:58:02.632206282Z [2024-07-04 03:58:02,631: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:58:02.633984375Z [2024-07-04 03:58:02,633: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:58:02.634006315Z [2024-07-04 03:58:02,633: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:58:02.634133134Z [2024-07-04 03:58:02,633: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:58:02.634224341Z [2024-07-04 03:58:02,634: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:58:02.634619965Z [2024-07-04 03:58:02,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:58:02.634789398Z [2024-07-04 03:58:02,634: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:58:02.704888086Z [2024-07-04 03:58:02,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:58:02.738030936Z [2024-07-04 03:58:02,737: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:58:04.242915556Z [2024-07-04 03:58:04,242: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f7ce515-68c6-4986-859a-31c2e5ad70cd] succeeded in 3.3207945120011573s: None 2024-07-04T03:58:04.678208072Z [2024-07-04 03:58:04,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c550653-95bd-4759-9891-601d83eeb79b] succeeded in 3.8004741160002595s: None 2024-07-04T03:59:00.596130221Z [2024-07-04 03:59:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0cf39cd-86e9-44a5-ab97-7f5d0e298d29] received 2024-07-04T03:59:00.608045387Z [2024-07-04 03:59:00,607: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[601f2fbf-4c97-4723-ab37-8db08f94de9a] received 2024-07-04T03:59:00.629744927Z [2024-07-04 03:59:00,628: INFO/ForkPoolWorker-15] [e0cf39cd-86e9-44a5-ab97-7f5d0e298d29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T03:59:00.632568583Z [2024-07-04 03:59:00,632: INFO/ForkPoolWorker-16] [601f2fbf-4c97-4723-ab37-8db08f94de9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T03:59:01.009192515Z [2024-07-04 03:59:01,001: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T03:59:01.108958935Z [2024-07-04 03:59:01,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T03:59:02.572869723Z [2024-07-04 03:59:02,572: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T03:59:02.576427972Z [2024-07-04 03:59:02,575: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:59:02.605537568Z [2024-07-04 03:59:02,605: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T03:59:02.608850065Z [2024-07-04 03:59:02,608: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T03:59:02.627226667Z [2024-07-04 03:59:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T03:59:02.628700422Z [2024-07-04 03:59:02,628: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:59:02.628939423Z [2024-07-04 03:59:02,628: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:59:02.629492491Z [2024-07-04 03:59:02,629: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:59:02.629573641Z [2024-07-04 03:59:02,629: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T03:59:02.630080184Z [2024-07-04 03:59:02,629: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T03:59:02.630092143Z [2024-07-04 03:59:02,629: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:59:02.643316337Z [2024-07-04 03:59:02,643: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T03:59:02.644553208Z [2024-07-04 03:59:02,644: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T03:59:02.644698749Z [2024-07-04 03:59:02,644: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T03:59:02.644951017Z [2024-07-04 03:59:02,644: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T03:59:02.645091046Z [2024-07-04 03:59:02,644: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T03:59:02.645866183Z [2024-07-04 03:59:02,645: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T03:59:02.645988626Z [2024-07-04 03:59:02,645: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T03:59:02.733806614Z [2024-07-04 03:59:02,733: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:59:02.743787651Z [2024-07-04 03:59:02,743: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T03:59:04.378041354Z [2024-07-04 03:59:04,377: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0cf39cd-86e9-44a5-ab97-7f5d0e298d29] succeeded in 3.7782446010005515s: None 2024-07-04T03:59:04.707541906Z [2024-07-04 03:59:04,707: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[601f2fbf-4c97-4723-ab37-8db08f94de9a] succeeded in 4.096366727999339s: None 2024-07-04T04:00:00.623886566Z [2024-07-04 04:00:00,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70efd17d-6d7f-49d7-9cd8-a2af39bf64b6] received 2024-07-04T04:00:00.629150225Z [2024-07-04 04:00:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03e1459b-a543-4e59-9473-f5a07c138fe6] received 2024-07-04T04:00:00.645648657Z [2024-07-04 04:00:00,645: INFO/ForkPoolWorker-16] [03e1459b-a543-4e59-9473-f5a07c138fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:00:00.650125072Z [2024-07-04 04:00:00,649: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28178bde-70ed-4b3d-a7fb-dd4f3871e244] received 2024-07-04T04:00:00.652141218Z [2024-07-04 04:00:00,651: INFO/ForkPoolWorker-15] [70efd17d-6d7f-49d7-9cd8-a2af39bf64b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:00.653034739Z [2024-07-04 04:00:00,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05392701-d281-4694-b2ce-b1779553e2fd] received 2024-07-04T04:00:00.694893223Z [2024-07-04 04:00:00,694: INFO/ForkPoolWorker-1] [28178bde-70ed-4b3d-a7fb-dd4f3871e244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:00:00.696793600Z [2024-07-04 04:00:00,695: INFO/ForkPoolWorker-2] [05392701-d281-4694-b2ce-b1779553e2fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:00:01.121504603Z [2024-07-04 04:00:01,117: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:00:01.153098939Z [2024-07-04 04:00:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T04:00:01.326064261Z [2024-07-04 04:00:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:00:01.432041466Z [2024-07-04 04:00:01,428: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:00:01.449838767Z [2024-07-04 04:00:01,449: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:02.150296952Z [2024-07-04 04:00:02,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03e1459b-a543-4e59-9473-f5a07c138fe6] succeeded in 1.5181218199995783s: None 2024-07-04T04:00:02.646930693Z [2024-07-04 04:00:02,646: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:00:02.649981216Z [2024-07-04 04:00:02,649: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:02.675651570Z [2024-07-04 04:00:02,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:00:02.677187933Z [2024-07-04 04:00:02,676: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:02.677284276Z [2024-07-04 04:00:02,677: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:02.677443526Z [2024-07-04 04:00:02,677: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:02.677513589Z [2024-07-04 04:00:02,677: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:00:02.678198519Z [2024-07-04 04:00:02,678: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:00:02.678288266Z [2024-07-04 04:00:02,678: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:02.731656469Z [2024-07-04 04:00:02,731: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T04:00:02.735190681Z [2024-07-04 04:00:02,734: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:02.753920519Z [2024-07-04 04:00:02,753: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:02.775301530Z [2024-07-04 04:00:02,775: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T04:00:02.780229000Z [2024-07-04 04:00:02,780: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:02.780817795Z [2024-07-04 04:00:02,780: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:02.781252799Z [2024-07-04 04:00:02,781: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:02.781664521Z [2024-07-04 04:00:02,781: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T04:00:02.781932690Z [2024-07-04 04:00:02,781: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:00:02.782402223Z [2024-07-04 04:00:02,782: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:02.841418409Z [2024-07-04 04:00:02,841: INFO/ForkPoolWorker-2] Getting VIM list 2024-07-04T04:00:02.844737113Z [2024-07-04 04:00:02,844: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:02.868985893Z [2024-07-04 04:00:02,868: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-07-04T04:00:02.871630632Z [2024-07-04 04:00:02,871: INFO/ForkPoolWorker-2] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:02.871678758Z [2024-07-04 04:00:02,871: INFO/ForkPoolWorker-2] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:02.871858476Z [2024-07-04 04:00:02,871: INFO/ForkPoolWorker-2] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:02.872016587Z [2024-07-04 04:00:02,871: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-07-04T04:00:02.872586105Z [2024-07-04 04:00:02,872: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:00:02.872739830Z [2024-07-04 04:00:02,872: INFO/ForkPoolWorker-2] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:02.874848645Z [2024-07-04 04:00:02,874: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:02.974593504Z [2024-07-04 04:00:02,974: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:03.360717269Z [2024-07-04 04:00:03,360: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70efd17d-6d7f-49d7-9cd8-a2af39bf64b6] succeeded in 2.7319602059997123s: None 2024-07-04T04:00:03.456420777Z [2024-07-04 04:00:03,456: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58a1b54e-6cfc-40ac-ab1d-90e2da7cedb8] received 2024-07-04T04:00:03.470703139Z [2024-07-04 04:00:03,470: INFO/ForkPoolWorker-15] [58a1b54e-6cfc-40ac-ab1d-90e2da7cedb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:03.839546153Z [2024-07-04 04:00:03,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:00:04.499149985Z [2024-07-04 04:00:04,498: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05392701-d281-4694-b2ce-b1779553e2fd] succeeded in 3.839605527000458s: None 2024-07-04T04:00:04.885011966Z [2024-07-04 04:00:04,884: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[28178bde-70ed-4b3d-a7fb-dd4f3871e244] succeeded in 4.222599648001051s: None 2024-07-04T04:00:05.191876057Z [2024-07-04 04:00:05,191: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:00:05.196349868Z [2024-07-04 04:00:05,195: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:05.234750236Z [2024-07-04 04:00:05,233: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:00:05.237031247Z [2024-07-04 04:00:05,236: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:05.237091008Z [2024-07-04 04:00:05,236: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:05.237912601Z [2024-07-04 04:00:05,237: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:05.238033972Z [2024-07-04 04:00:05,237: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:00:05.238499013Z [2024-07-04 04:00:05,238: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:00:05.239376394Z [2024-07-04 04:00:05,238: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:05.338835750Z [2024-07-04 04:00:05,338: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:05.973056054Z [2024-07-04 04:00:05,972: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58a1b54e-6cfc-40ac-ab1d-90e2da7cedb8] succeeded in 2.5146607799997582s: None 2024-07-04T04:00:06.598083873Z [2024-07-04 04:00:06,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0d291cd-975b-4835-8812-d5318bf15928] received 2024-07-04T04:00:06.607253932Z [2024-07-04 04:00:06,606: INFO/ForkPoolWorker-15] [c0d291cd-975b-4835-8812-d5318bf15928] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T04:00:06.892505598Z [2024-07-04 04:00:06,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:00:07.966769410Z [2024-07-04 04:00:07,966: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:00:07.970071803Z [2024-07-04 04:00:07,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:08.023813657Z [2024-07-04 04:00:08,023: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:00:08.026293754Z [2024-07-04 04:00:08,026: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:08.026566916Z [2024-07-04 04:00:08,026: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:08.026924283Z [2024-07-04 04:00:08,026: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:08.027193055Z [2024-07-04 04:00:08,027: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:00:08.027644082Z [2024-07-04 04:00:08,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:00:08.027925477Z [2024-07-04 04:00:08,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:08.135270151Z [2024-07-04 04:00:08,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:08.733037027Z [2024-07-04 04:00:08,732: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0d291cd-975b-4835-8812-d5318bf15928] succeeded in 2.13123198699941s: None 2024-07-04T04:00:09.222010613Z [2024-07-04 04:00:09,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cddfa24-b532-4356-bd7e-9c54337b2316] received 2024-07-04T04:00:09.240574864Z [2024-07-04 04:00:09,240: INFO/ForkPoolWorker-15] [4cddfa24-b532-4356-bd7e-9c54337b2316] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:00:09.621491331Z [2024-07-04 04:00:09,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:00:10.749045382Z [2024-07-04 04:00:10,748: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:00:10.752186303Z [2024-07-04 04:00:10,751: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:00:10.796854622Z [2024-07-04 04:00:10,796: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:00:10.798711185Z [2024-07-04 04:00:10,798: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:00:10.798744635Z [2024-07-04 04:00:10,798: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:00:10.798993236Z [2024-07-04 04:00:10,798: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:00:10.799060255Z [2024-07-04 04:00:10,798: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:00:10.799696496Z [2024-07-04 04:00:10,799: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:00:10.799745360Z [2024-07-04 04:00:10,799: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:00:10.899121941Z [2024-07-04 04:00:10,898: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:00:11.518046198Z [2024-07-04 04:00:11,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cddfa24-b532-4356-bd7e-9c54337b2316] succeeded in 2.293367225998736s: None 2024-07-04T04:01:00.351595272Z [2024-07-04 04:01:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3f09131-ff49-4966-bdc6-aa57f0de10c7] received 2024-07-04T04:01:00.359439556Z [2024-07-04 04:01:00,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b08c123-b89c-4a8b-8a99-35e05caf1410] received 2024-07-04T04:01:00.367827356Z [2024-07-04 04:01:00,367: INFO/ForkPoolWorker-15] [d3f09131-ff49-4966-bdc6-aa57f0de10c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:01:00.388489950Z [2024-07-04 04:01:00,385: INFO/ForkPoolWorker-16] [9b08c123-b89c-4a8b-8a99-35e05caf1410] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:01:00.822452712Z [2024-07-04 04:01:00,818: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:01:00.866128229Z [2024-07-04 04:01:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:01:02.102786234Z [2024-07-04 04:01:02,102: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:01:02.106130881Z [2024-07-04 04:01:02,105: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:01:02.139883804Z [2024-07-04 04:01:02,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:01:02.141908267Z [2024-07-04 04:01:02,141: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:01:02.142159563Z [2024-07-04 04:01:02,141: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:01:02.142433270Z [2024-07-04 04:01:02,142: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:01:02.142597022Z [2024-07-04 04:01:02,142: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:01:02.143187189Z [2024-07-04 04:01:02,143: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:01:02.143551653Z [2024-07-04 04:01:02,143: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:01:02.217363728Z [2024-07-04 04:01:02,216: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:01:02.220498742Z [2024-07-04 04:01:02,220: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:01:02.222135827Z [2024-07-04 04:01:02,221: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:01:02.261427664Z [2024-07-04 04:01:02,261: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:01:02.263842333Z [2024-07-04 04:01:02,263: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:01:02.264161494Z [2024-07-04 04:01:02,263: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:01:02.264317887Z [2024-07-04 04:01:02,264: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:01:02.264502817Z [2024-07-04 04:01:02,264: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:01:02.264970335Z [2024-07-04 04:01:02,264: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:01:02.265156355Z [2024-07-04 04:01:02,264: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:01:02.351265207Z [2024-07-04 04:01:02,350: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:01:03.890735633Z [2024-07-04 04:01:03,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b08c123-b89c-4a8b-8a99-35e05caf1410] succeeded in 3.5264189169993188s: None 2024-07-04T04:01:04.423702374Z [2024-07-04 04:01:04,422: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3f09131-ff49-4966-bdc6-aa57f0de10c7] succeeded in 4.069218904000081s: None 2024-07-04T04:02:00.684596029Z [2024-07-04 04:02:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbd1a035-5c94-4d22-ac7d-acea690e9217] received 2024-07-04T04:02:00.688318343Z [2024-07-04 04:02:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e95d966-03eb-4def-bd90-7ea24c6d794e] received 2024-07-04T04:02:00.696324041Z [2024-07-04 04:02:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f20ec157-5277-477f-91c1-89db9c76c76e] received 2024-07-04T04:02:00.718219588Z [2024-07-04 04:02:00,717: INFO/ForkPoolWorker-15] [fbd1a035-5c94-4d22-ac7d-acea690e9217] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:02:00.723231015Z [2024-07-04 04:02:00,722: INFO/ForkPoolWorker-16] [5e95d966-03eb-4def-bd90-7ea24c6d794e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:02:00.734419771Z [2024-07-04 04:02:00,733: INFO/ForkPoolWorker-1] [f20ec157-5277-477f-91c1-89db9c76c76e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:02:01.178651118Z [2024-07-04 04:02:01,174: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T04:02:01.184206655Z [2024-07-04 04:02:01,180: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:02:01.278530419Z [2024-07-04 04:02:01,274: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:02:01.475087421Z [2024-07-04 04:02:01,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:02:02.070439054Z [2024-07-04 04:02:02,069: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fbd1a035-5c94-4d22-ac7d-acea690e9217] succeeded in 1.3809545439999056s: None 2024-07-04T04:02:02.523250349Z [2024-07-04 04:02:02,522: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T04:02:02.523639182Z [2024-07-04 04:02:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:02:02.526673945Z [2024-07-04 04:02:02,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:02:02.526853989Z [2024-07-04 04:02:02,526: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:02:02.549289140Z [2024-07-04 04:02:02,547: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T04:02:02.551941249Z [2024-07-04 04:02:02,551: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:02:02.552208865Z [2024-07-04 04:02:02,552: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:02:02.552396397Z [2024-07-04 04:02:02,552: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:02:02.552511102Z [2024-07-04 04:02:02,552: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T04:02:02.552760378Z [2024-07-04 04:02:02,552: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:02:02.552957529Z [2024-07-04 04:02:02,552: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:02:02.571465519Z [2024-07-04 04:02:02,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:02:02.573367055Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:02:02.573459058Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:02:02.573674112Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:02:02.573744926Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:02:02.574031642Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:02:02.574095375Z [2024-07-04 04:02:02,573: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:02:02.642531060Z [2024-07-04 04:02:02,642: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:02:02.654236723Z [2024-07-04 04:02:02,654: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:02:04.168661923Z [2024-07-04 04:02:04,168: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f20ec157-5277-477f-91c1-89db9c76c76e] succeeded in 3.4596422699996765s: None 2024-07-04T04:02:04.518723858Z [2024-07-04 04:02:04,518: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5e95d966-03eb-4def-bd90-7ea24c6d794e] succeeded in 3.825971670999934s: None 2024-07-04T04:03:01.112082294Z [2024-07-04 04:03:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7af89c66-c535-4fbf-84fc-fefc30833d15] received 2024-07-04T04:03:01.114722967Z [2024-07-04 04:03:01,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4cd862c-92a9-4b59-a8fe-bf2813f93351] received 2024-07-04T04:03:01.123346620Z [2024-07-04 04:03:01,123: INFO/ForkPoolWorker-15] [7af89c66-c535-4fbf-84fc-fefc30833d15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:03:01.131291438Z [2024-07-04 04:03:01,131: INFO/ForkPoolWorker-16] [a4cd862c-92a9-4b59-a8fe-bf2813f93351] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:03:01.403731900Z [2024-07-04 04:03:01,400: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:03:01.404505935Z [2024-07-04 04:03:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:03:02.550472197Z [2024-07-04 04:03:02,550: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:03:02.553791507Z [2024-07-04 04:03:02,553: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:03:02.565526271Z [2024-07-04 04:03:02,565: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:03:02.568604691Z [2024-07-04 04:03:02,568: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:03:02.587817483Z [2024-07-04 04:03:02,587: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:03:02.589120541Z [2024-07-04 04:03:02,588: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:03:02.589481347Z [2024-07-04 04:03:02,589: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:03:02.589665010Z [2024-07-04 04:03:02,589: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:03:02.589737978Z [2024-07-04 04:03:02,589: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:03:02.590972032Z [2024-07-04 04:03:02,590: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:03:02.591122305Z [2024-07-04 04:03:02,590: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:03:02.604019423Z [2024-07-04 04:03:02,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:03:02.606576885Z [2024-07-04 04:03:02,606: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:03:02.607003203Z [2024-07-04 04:03:02,606: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:03:02.607140399Z [2024-07-04 04:03:02,606: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:03:02.607253090Z [2024-07-04 04:03:02,607: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:03:02.608176532Z [2024-07-04 04:03:02,608: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:03:02.608261124Z [2024-07-04 04:03:02,608: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:03:02.692549014Z [2024-07-04 04:03:02,692: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:03:02.695922591Z [2024-07-04 04:03:02,695: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:03:05.211803488Z [2024-07-04 04:03:05,210: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a4cd862c-92a9-4b59-a8fe-bf2813f93351] succeeded in 4.094650235998415s: None 2024-07-04T04:03:06.115980050Z [2024-07-04 04:03:06,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7af89c66-c535-4fbf-84fc-fefc30833d15] succeeded in 4.999011587999121s: None 2024-07-04T04:04:00.367749081Z [2024-07-04 04:04:00,367: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d09c072-f8e8-41cd-b821-7cc7173e563f] received 2024-07-04T04:04:00.374355273Z [2024-07-04 04:04:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6bedf98c-8e77-469b-821b-086a78c42d57] received 2024-07-04T04:04:00.384324691Z [2024-07-04 04:04:00,383: INFO/ForkPoolWorker-15] [9d09c072-f8e8-41cd-b821-7cc7173e563f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:04:00.391159395Z [2024-07-04 04:04:00,390: INFO/ForkPoolWorker-16] [6bedf98c-8e77-469b-821b-086a78c42d57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:04:00.391929170Z [2024-07-04 04:04:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f5a4a1e-5122-4883-b0d1-81929aa4934f] received 2024-07-04T04:04:00.420056468Z [2024-07-04 04:04:00,419: INFO/ForkPoolWorker-1] [6f5a4a1e-5122-4883-b0d1-81929aa4934f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:04:00.823273967Z [2024-07-04 04:04:00,818: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:04:00.890746853Z [2024-07-04 04:04:00,886: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T04:04:01.231971668Z [2024-07-04 04:04:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:04:01.295529264Z [2024-07-04 04:04:01,295: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:04:02.154157340Z [2024-07-04 04:04:02,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d09c072-f8e8-41cd-b821-7cc7173e563f] succeeded in 1.7828605129998323s: None 2024-07-04T04:04:02.624634447Z [2024-07-04 04:04:02,624: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:04:02.627921793Z [2024-07-04 04:04:02,627: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:04:02.657753708Z [2024-07-04 04:04:02,657: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:04:02.659256480Z [2024-07-04 04:04:02,659: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:04:02.659422427Z [2024-07-04 04:04:02,659: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:04:02.659643459Z [2024-07-04 04:04:02,659: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:04:02.659745109Z [2024-07-04 04:04:02,659: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:04:02.660049649Z [2024-07-04 04:04:02,659: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:04:02.660132509Z [2024-07-04 04:04:02,660: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:04:02.757660017Z [2024-07-04 04:04:02,757: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:04:02.882651535Z [2024-07-04 04:04:02,882: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T04:04:02.885851710Z [2024-07-04 04:04:02,885: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:04:02.915588403Z [2024-07-04 04:04:02,915: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T04:04:02.917595602Z [2024-07-04 04:04:02,917: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:04:02.917762752Z [2024-07-04 04:04:02,917: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:04:02.917939987Z [2024-07-04 04:04:02,917: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:04:02.918021304Z [2024-07-04 04:04:02,917: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T04:04:02.918318197Z [2024-07-04 04:04:02,918: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:04:02.918369216Z [2024-07-04 04:04:02,918: INFO/ForkPoolWorker-1] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:04:03.023288178Z [2024-07-04 04:04:03,022: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:04:04.591359741Z [2024-07-04 04:04:04,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6bedf98c-8e77-469b-821b-086a78c42d57] succeeded in 4.213826974999392s: None 2024-07-04T04:04:06.109536738Z [2024-07-04 04:04:06,108: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f5a4a1e-5122-4883-b0d1-81929aa4934f] succeeded in 5.71418586999971s: None 2024-07-04T04:05:01.150386970Z [2024-07-04 04:05:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd4249f7-e042-4461-a0ec-16e490225e66] received 2024-07-04T04:05:01.162692947Z [2024-07-04 04:05:01,162: INFO/ForkPoolWorker-15] [fd4249f7-e042-4461-a0ec-16e490225e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'extract_metrics_from_vnfrs', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:01.163119808Z [2024-07-04 04:05:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8453d640-3cef-43a5-8314-2528da273280] received 2024-07-04T04:05:01.171399030Z [2024-07-04 04:05:01,171: INFO/ForkPoolWorker-16] [8453d640-3cef-43a5-8314-2528da273280] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:05:01.172989622Z [2024-07-04 04:05:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f3138ef-4224-4404-82bc-82fbd7d5f5ef] received 2024-07-04T04:05:01.193608683Z [2024-07-04 04:05:01,193: INFO/ForkPoolWorker-1] [1f3138ef-4224-4404-82bc-82fbd7d5f5ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:05:01.513426108Z [2024-07-04 04:05:01,509: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:05:01.589739282Z [2024-07-04 04:05:01,585: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:05:01.788158044Z [2024-07-04 04:05:01,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:05:03.022673918Z [2024-07-04 04:05:03,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:05:03.026274018Z [2024-07-04 04:05:03,025: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:03.034735499Z [2024-07-04 04:05:03,034: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T04:05:03.038315575Z [2024-07-04 04:05:03,037: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:03.072683219Z [2024-07-04 04:05:03,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:05:03.076324270Z [2024-07-04 04:05:03,076: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:03.076379939Z [2024-07-04 04:05:03,076: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:03.076504063Z [2024-07-04 04:05:03,076: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:03.076538142Z [2024-07-04 04:05:03,076: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:05:03.077281718Z [2024-07-04 04:05:03,077: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T04:05:03.078528374Z [2024-07-04 04:05:03,078: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:05:03.078617628Z [2024-07-04 04:05:03,078: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:03.079204872Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:03.079246609Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:03.079354125Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:03.079374661Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T04:05:03.079602507Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:05:03.079627305Z [2024-07-04 04:05:03,079: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:03.162867133Z [2024-07-04 04:05:03,162: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:03.183865397Z [2024-07-04 04:05:03,183: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:03.298393545Z [2024-07-04 04:05:03,297: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:05:03.302016262Z [2024-07-04 04:05:03,301: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:03.361543097Z [2024-07-04 04:05:03,361: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:05:03.365937156Z [2024-07-04 04:05:03,365: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:03.369279883Z [2024-07-04 04:05:03,368: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:03.369728095Z [2024-07-04 04:05:03,369: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:03.369893761Z [2024-07-04 04:05:03,369: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:05:03.370277295Z [2024-07-04 04:05:03,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:05:03.375556261Z [2024-07-04 04:05:03,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:03.507651793Z [2024-07-04 04:05:03,507: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:04.300588014Z [2024-07-04 04:05:04,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd4249f7-e042-4461-a0ec-16e490225e66] succeeded in 3.1460954300000594s: None 2024-07-04T04:05:05.056500849Z [2024-07-04 04:05:05,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9cb9fd88-d58f-467e-b904-06fca71b72fa] received 2024-07-04T04:05:05.062253975Z [2024-07-04 04:05:05,061: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8453d640-3cef-43a5-8314-2528da273280] succeeded in 3.897227630999623s: None 2024-07-04T04:05:05.065303159Z [2024-07-04 04:05:05,064: INFO/ForkPoolWorker-15] [9cb9fd88-d58f-467e-b904-06fca71b72fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'split_metrics', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:05.365866523Z [2024-07-04 04:05:05,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:05:05.378532708Z [2024-07-04 04:05:05,377: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1f3138ef-4224-4404-82bc-82fbd7d5f5ef] succeeded in 4.195795416000692s: None 2024-07-04T04:05:06.462029233Z [2024-07-04 04:05:06,461: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:05:06.465040002Z [2024-07-04 04:05:06,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:06.513698190Z [2024-07-04 04:05:06,513: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:05:06.515809447Z [2024-07-04 04:05:06,515: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:06.515950667Z [2024-07-04 04:05:06,515: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:06.516456985Z [2024-07-04 04:05:06,515: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:06.516625501Z [2024-07-04 04:05:06,516: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:05:06.517158653Z [2024-07-04 04:05:06,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:05:06.517430955Z [2024-07-04 04:05:06,517: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:06.619162767Z [2024-07-04 04:05:06,618: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:07.313458944Z [2024-07-04 04:05:07,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9cb9fd88-d58f-467e-b904-06fca71b72fa] succeeded in 2.254358048998256s: None 2024-07-04T04:05:07.500335681Z [2024-07-04 04:05:07,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74abdefa-854a-47e6-a0f2-e63dd52113e2] received 2024-07-04T04:05:07.509743970Z [2024-07-04 04:05:07,509: INFO/ForkPoolWorker-15] [74abdefa-854a-47e6-a0f2-e63dd52113e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'collect_metrics', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-07-04T04:05:07.770191219Z [2024-07-04 04:05:07,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:05:08.864197121Z [2024-07-04 04:05:08,863: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:05:08.867829552Z [2024-07-04 04:05:08,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:08.918175875Z [2024-07-04 04:05:08,917: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:05:08.919967627Z [2024-07-04 04:05:08,919: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:08.920278484Z [2024-07-04 04:05:08,920: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:08.920605579Z [2024-07-04 04:05:08,920: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:08.920724174Z [2024-07-04 04:05:08,920: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:05:08.921142204Z [2024-07-04 04:05:08,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:05:08.921374792Z [2024-07-04 04:05:08,921: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:09.031274103Z [2024-07-04 04:05:09,030: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:09.651341967Z [2024-07-04 04:05:09,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74abdefa-854a-47e6-a0f2-e63dd52113e2] succeeded in 2.149243252000815s: None 2024-07-04T04:05:10.643798466Z [2024-07-04 04:05:10,643: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de90165c-d9bf-42ce-8d26-34b8aa9676f1] received 2024-07-04T04:05:10.656402996Z [2024-07-04 04:05:10,656: INFO/ForkPoolWorker-15] [de90165c-d9bf-42ce-8d26-34b8aa9676f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'send_prometheus', 'scheduled__2024-07-04T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-07-04T04:05:10.969895296Z [2024-07-04 04:05:10,963: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-07-04T04:05:12.094235264Z [2024-07-04 04:05:12,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:05:12.103240661Z [2024-07-04 04:05:12,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:05:12.131057684Z [2024-07-04 04:05:12,130: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:05:12.133655302Z [2024-07-04 04:05:12,133: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:05:12.133669459Z [2024-07-04 04:05:12,133: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:05:12.133938698Z [2024-07-04 04:05:12,133: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:05:12.133945490Z [2024-07-04 04:05:12,133: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:05:12.134562905Z [2024-07-04 04:05:12,134: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-07-04T04:05:12.134577789Z [2024-07-04 04:05:12,134: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:05:12.214782825Z [2024-07-04 04:05:12,214: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:05:12.917088367Z [2024-07-04 04:05:12,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de90165c-d9bf-42ce-8d26-34b8aa9676f1] succeeded in 2.26980743599961s: None 2024-07-04T04:06:01.121168239Z [2024-07-04 04:06:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6208173-971d-48b0-a170-0916a08977f5] received 2024-07-04T04:06:01.125877648Z [2024-07-04 04:06:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dcef296-8bc6-4e3d-baba-47d5e350fa0a] received 2024-07-04T04:06:01.146625082Z [2024-07-04 04:06:01,145: INFO/ForkPoolWorker-15] [e6208173-971d-48b0-a170-0916a08977f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:06:01.151955809Z [2024-07-04 04:06:01,151: INFO/ForkPoolWorker-16] [0dcef296-8bc6-4e3d-baba-47d5e350fa0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:06:01.158041322Z [2024-07-04 04:06:01,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf58cb40-52bf-4b51-988f-61dc33bc65bc] received 2024-07-04T04:06:01.178856186Z [2024-07-04 04:06:01,178: INFO/ForkPoolWorker-1] [cf58cb40-52bf-4b51-988f-61dc33bc65bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:06:01.585678112Z [2024-07-04 04:06:01,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T04:06:01.589375183Z [2024-07-04 04:06:01,585: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:06:01.591424425Z [2024-07-04 04:06:01,586: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:06:01.859068854Z [2024-07-04 04:06:01,858: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:06:02.569787154Z [2024-07-04 04:06:02,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6208173-971d-48b0-a170-0916a08977f5] succeeded in 1.4435747820007236s: None 2024-07-04T04:06:03.084365576Z [2024-07-04 04:06:03,083: INFO/ForkPoolWorker-1] Getting VIM list 2024-07-04T04:06:03.088113504Z [2024-07-04 04:06:03,087: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:06:03.129175515Z [2024-07-04 04:06:03,128: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:06:03.132833605Z [2024-07-04 04:06:03,132: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:06:03.133542974Z [2024-07-04 04:06:03,133: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-07-04T04:06:03.134934545Z [2024-07-04 04:06:03,134: INFO/ForkPoolWorker-1] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:06:03.135143854Z [2024-07-04 04:06:03,134: INFO/ForkPoolWorker-1] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:06:03.135319534Z [2024-07-04 04:06:03,135: INFO/ForkPoolWorker-1] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:06:03.135382698Z [2024-07-04 04:06:03,135: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-07-04T04:06:03.136042430Z [2024-07-04 04:06:03,135: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:06:03.136093369Z [2024-07-04 04:06:03,136: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:06:03.166412491Z [2024-07-04 04:06:03,166: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:06:03.172017241Z [2024-07-04 04:06:03,171: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:06:03.172081022Z [2024-07-04 04:06:03,171: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:06:03.172243738Z [2024-07-04 04:06:03,172: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:06:03.172295019Z [2024-07-04 04:06:03,172: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:06:03.172567085Z [2024-07-04 04:06:03,172: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:06:03.173283774Z [2024-07-04 04:06:03,172: INFO/ForkPoolWorker-16] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:06:03.220449932Z [2024-07-04 04:06:03,220: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:06:03.271891457Z [2024-07-04 04:06:03,271: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:06:05.454855225Z [2024-07-04 04:06:05,453: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0dcef296-8bc6-4e3d-baba-47d5e350fa0a] succeeded in 4.3239761690001615s: None 2024-07-04T04:06:06.109469632Z [2024-07-04 04:06:06,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf58cb40-52bf-4b51-988f-61dc33bc65bc] succeeded in 4.948397674999796s: None 2024-07-04T04:07:00.579659494Z [2024-07-04 04:07:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63506a65-05c4-4654-888e-528500747c27] received 2024-07-04T04:07:00.583967947Z [2024-07-04 04:07:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bff2b57-6677-46b7-b60f-f389ca31b478] received 2024-07-04T04:07:00.594549967Z [2024-07-04 04:07:00,594: INFO/ForkPoolWorker-15] [63506a65-05c4-4654-888e-528500747c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:07:00.605744135Z [2024-07-04 04:07:00,605: INFO/ForkPoolWorker-16] [8bff2b57-6677-46b7-b60f-f389ca31b478] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:07:00.882487852Z [2024-07-04 04:07:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:07:00.940434378Z [2024-07-04 04:07:00,937: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:07:02.121884923Z [2024-07-04 04:07:02,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:07:02.125203637Z [2024-07-04 04:07:02,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:07:02.144049058Z [2024-07-04 04:07:02,143: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:07:02.147439209Z [2024-07-04 04:07:02,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:07:02.165081787Z [2024-07-04 04:07:02,164: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:07:02.173058088Z [2024-07-04 04:07:02,172: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:07:02.173129855Z [2024-07-04 04:07:02,172: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:07:02.173563706Z [2024-07-04 04:07:02,173: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:07:02.175360019Z [2024-07-04 04:07:02,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:07:02.176343566Z [2024-07-04 04:07:02,176: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:07:02.176430918Z [2024-07-04 04:07:02,176: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:07:02.186648078Z [2024-07-04 04:07:02,186: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:07:02.188064542Z [2024-07-04 04:07:02,187: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:07:02.188119319Z [2024-07-04 04:07:02,188: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:07:02.188267727Z [2024-07-04 04:07:02,188: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:07:02.188297506Z [2024-07-04 04:07:02,188: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:07:02.188543512Z [2024-07-04 04:07:02,188: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:07:02.188585103Z [2024-07-04 04:07:02,188: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:07:02.282358217Z [2024-07-04 04:07:02,281: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:07:02.286374534Z [2024-07-04 04:07:02,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:07:04.005239931Z [2024-07-04 04:07:04,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63506a65-05c4-4654-888e-528500747c27] succeeded in 3.4206934200010437s: None 2024-07-04T04:07:04.373670702Z [2024-07-04 04:07:04,373: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8bff2b57-6677-46b7-b60f-f389ca31b478] succeeded in 3.785520851999536s: None 2024-07-04T04:08:01.246084095Z [2024-07-04 04:08:01,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aefc810-1ad0-466c-bd57-1409406e35c4] received 2024-07-04T04:08:01.262991534Z [2024-07-04 04:08:01,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d858c4e-17f0-454d-b177-529cc59c92ae] received 2024-07-04T04:08:01.282708986Z [2024-07-04 04:08:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21b4d044-0879-455d-85ae-b8cecc3fd584] received 2024-07-04T04:08:01.294212357Z [2024-07-04 04:08:01,293: INFO/ForkPoolWorker-15] [8aefc810-1ad0-466c-bd57-1409406e35c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-07-04T04:08:01.298407651Z [2024-07-04 04:08:01,296: INFO/ForkPoolWorker-16] [8d858c4e-17f0-454d-b177-529cc59c92ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-07-04T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-07-04T04:08:01.300607995Z [2024-07-04 04:08:01,300: INFO/ForkPoolWorker-1] [21b4d044-0879-455d-85ae-b8cecc3fd584] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-07-04T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-07-04T04:08:01.685009648Z [2024-07-04 04:08:01,679: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-07-04T04:08:01.758719349Z [2024-07-04 04:08:01,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-07-04T04:08:01.809016283Z [2024-07-04 04:08:01,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-07-04T04:08:02.162940048Z [2024-07-04 04:08:02,162: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:08:02.784609491Z [2024-07-04 04:08:02,784: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21b4d044-0879-455d-85ae-b8cecc3fd584] succeeded in 1.4985352259991487s: None 2024-07-04T04:08:03.099644126Z [2024-07-04 04:08:03,099: INFO/ForkPoolWorker-16] Getting VIM list 2024-07-04T04:08:03.102969180Z [2024-07-04 04:08:03,102: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:08:03.132152248Z [2024-07-04 04:08:03,131: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-07-04T04:08:03.133720214Z [2024-07-04 04:08:03,133: INFO/ForkPoolWorker-16] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:08:03.133896022Z [2024-07-04 04:08:03,133: INFO/ForkPoolWorker-16] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:08:03.134139081Z [2024-07-04 04:08:03,133: INFO/ForkPoolWorker-16] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:08:03.134359816Z [2024-07-04 04:08:03,134: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-07-04T04:08:03.134684083Z [2024-07-04 04:08:03,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-07-04T04:08:03.135295981Z [2024-07-04 04:08:03,135: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:08:03.159675212Z [2024-07-04 04:08:03,159: INFO/ForkPoolWorker-15] Getting VIM list 2024-07-04T04:08:03.162997891Z [2024-07-04 04:08:03,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': '2BVh9JTjr9qpOxDqJbMdlumkmlfrACZL'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-07-04T04:08:03.203109384Z [2024-07-04 04:08:03,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-07-04T04:08:03.205460808Z [2024-07-04 04:08:03,205: INFO/ForkPoolWorker-15] Read VIM 0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3 (_system-osm-vim) 2024-07-04T04:08:03.205774084Z [2024-07-04 04:08:03,205: INFO/ForkPoolWorker-15] Read VIM fdae035c-e1f1-4889-bd8c-23b7610c3808 (osm) 2024-07-04T04:08:03.206155557Z [2024-07-04 04:08:03,205: INFO/ForkPoolWorker-15] [{'_id': '0dbbdcfb-7a8a-4b81-bafe-2fbdf4a07cb3', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'fdae035c-e1f1-4889-bd8c-23b7610c3808', 'name': 'osm', 'vim_type': 'openstack'}] 2024-07-04T04:08:03.206430664Z [2024-07-04 04:08:03,206: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-07-04T04:08:03.207295727Z [2024-07-04 04:08:03,206: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-07-04T04:08:03.207603145Z [2024-07-04 04:08:03,207: INFO/ForkPoolWorker-15] Creating DAG vim_status_fdae035c-e1f1-4889-bd8c-23b7610c3808 2024-07-04T04:08:03.238456427Z [2024-07-04 04:08:03,238: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:08:03.286057028Z [2024-07-04 04:08:03,285: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-07-04T04:08:05.055090763Z [2024-07-04 04:08:05,054: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8aefc810-1ad0-466c-bd57-1409406e35c4] succeeded in 3.804966309999145s: None 2024-07-04T04:08:05.712834187Z [2024-07-04 04:08:05,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8d858c4e-17f0-454d-b177-529cc59c92ae] succeeded in 4.441932933999851s: None 2024-07-04T01:26:12.004045374Z 2024-07-04T01:26:12.011033411Z Cleaning logs every 900 seconds 2024-07-04T01:26:12.011054223Z Trimming airflow logs to 15 days. 2024-07-04T01:30:00.047841384Z Trimming airflow logs to 15 days. 2024-07-04T01:30:01.075433728Z Trimming airflow logs to 15 days. 2024-07-04T01:45:00.120774511Z Trimming airflow logs to 15 days. 2024-07-04T01:45:01.150501926Z Trimming airflow logs to 15 days. 2024-07-04T02:00:00.193374745Z Trimming airflow logs to 15 days. 2024-07-04T02:00:01.229895477Z Trimming airflow logs to 15 days. 2024-07-04T02:15:00.268183316Z Trimming airflow logs to 15 days. 2024-07-04T02:15:01.327927479Z Trimming airflow logs to 15 days. 2024-07-04T02:30:00.388905947Z Trimming airflow logs to 15 days. 2024-07-04T02:30:01.427689816Z Trimming airflow logs to 15 days. 2024-07-04T02:45:00.480475811Z Trimming airflow logs to 15 days. 2024-07-04T02:45:01.529586853Z Trimming airflow logs to 15 days. 2024-07-04T03:00:00.583834216Z Trimming airflow logs to 15 days. 2024-07-04T03:00:01.628400857Z Trimming airflow logs to 15 days. 2024-07-04T03:15:00.684445811Z Trimming airflow logs to 15 days. 2024-07-04T03:15:01.735107395Z Trimming airflow logs to 15 days. 2024-07-04T03:30:00.808390404Z Trimming airflow logs to 15 days. 2024-07-04T03:30:01.938969559Z Trimming airflow logs to 15 days. 2024-07-04T03:45:01.031483251Z Trimming airflow logs to 15 days. 2024-07-04T04:00:00.167477450Z Trimming airflow logs to 15 days. 2024-07-04T04:00:01.227427576Z Trimming airflow logs to 15 days.