2024-04-15T01:24:55.500455211Z . 2024-04-15T01:24:56.224165190Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-15T01:24:57.173811514Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-15T01:25:03.169935684Z [2024-04-15T01:25:03.168+0000] {db.py:755} INFO - Waiting for migrations... 0 second(s) 2024-04-15T01:25:04.179160442Z [2024-04-15T01:25:04.178+0000] {db.py:755} INFO - Waiting for migrations... 1 second(s) 2024-04-15T01:25:05.184147554Z [2024-04-15T01:25:05.180+0000] {db.py:755} INFO - Waiting for migrations... 2 second(s) 2024-04-15T01:25:27.129487356Z 2024-04-15T01:25:28.602008932Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0. 2024-04-15T01:25:32.027592994Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings. Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9) 2024-04-15T01:25:40.168385645Z [2024-04-15 01:25:40 +0000] [28] [INFO] Starting gunicorn 20.1.0 2024-04-15T01:25:40.182548825Z [2024-04-15 01:25:40 +0000] [28] [INFO] Listening at: http://[::]:8793 (28) 2024-04-15T01:25:40.182562471Z [2024-04-15 01:25:40 +0000] [28] [INFO] Using worker: sync 2024-04-15T01:25:40.214039036Z [2024-04-15 01:25:40 +0000] [29] [INFO] Booting worker with pid: 29 2024-04-15T01:25:40.300543651Z [2024-04-15 01:25:40 +0000] [30] [INFO] Booting worker with pid: 30 2024-04-15T01:25:42.734112065Z 2024-04-15T01:25:42.734125012Z -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus) 2024-04-15T01:25:42.734128913Z --- ***** ----- 2024-04-15T01:25:42.734132201Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-04-15 01:25:42 2024-04-15T01:25:42.734135347Z - *** --- * --- 2024-04-15T01:25:42.734138606Z - ** ---------- [config] 2024-04-15T01:25:42.734142094Z - ** ---------- .> app: airflow.executors.celery_executor:0x7f5738550220 2024-04-15T01:25:42.734144931Z - ** ---------- .> transport: redis://:**@airflow-redis:6379/0 2024-04-15T01:25:42.734148286Z - ** ---------- .> results: postgresql://postgres:**@airflow-postgresql.osm:5432/postgres 2024-04-15T01:25:42.734155680Z - *** --- * --- .> concurrency: 16 (prefork) 2024-04-15T01:25:42.734158569Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker) 2024-04-15T01:25:42.734161450Z --- ***** ----- 2024-04-15T01:25:42.734164327Z -------------- [queues] 2024-04-15T01:25:42.734167151Z .> default exchange=default(direct) key=default 2024-04-15T01:25:42.734170078Z 2024-04-15T01:25:42.734172732Z 2024-04-15T01:25:42.734175587Z [tasks] 2024-04-15T01:25:42.734178503Z . airflow.executors.celery_executor.execute_command 2024-04-15T01:25:42.734181268Z 2024-04-15T01:25:52.657244877Z [2024-04-15 01:25:52,652: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0 2024-04-15T01:25:52.673875016Z [2024-04-15 01:25:52,673: INFO/MainProcess] mingle: searching for neighbors 2024-04-15T01:25:53.714275735Z [2024-04-15 01:25:53,711: INFO/MainProcess] mingle: all alone 2024-04-15T01:25:53.823449448Z [2024-04-15 01:25:53,820: INFO/MainProcess] celery@airflow-worker-0 ready. 2024-04-15T01:25:57.289233327Z [2024-04-15 01:25:57,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7358750f-de26-4941-afe0-854e3cbd4290] received 2024-04-15T01:25:57.370668734Z [2024-04-15 01:25:57,370: INFO/ForkPoolWorker-15] [7358750f-de26-4941-afe0-854e3cbd4290] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:25:58.542648816Z [2024-04-15 01:25:58,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:26:00.239742137Z [2024-04-15 01:26:00,239: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:26:02.567359927Z [2024-04-15 01:26:02,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7358750f-de26-4941-afe0-854e3cbd4290] succeeded in 5.27597652999998s: None 2024-04-15T01:26:12.403130193Z [2024-04-15 01:26:12,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bfded68-1c15-4d9d-8f2a-6f05c17b3f0f] received 2024-04-15T01:26:12.414826463Z [2024-04-15 01:26:12,414: INFO/ForkPoolWorker-15] [3bfded68-1c15-4d9d-8f2a-6f05c17b3f0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:12.998052820Z [2024-04-15 01:26:12,992: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:26:13.347455279Z [2024-04-15 01:26:13,347: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:26:13.993327180Z [2024-04-15 01:26:13,992: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3bfded68-1c15-4d9d-8f2a-6f05c17b3f0f] succeeded in 1.5877016790000198s: None 2024-04-15T01:26:16.050773556Z [2024-04-15 01:26:16,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81b984be-9106-4206-883c-3a5124cf9474] received 2024-04-15T01:26:16.082452458Z [2024-04-15 01:26:16,082: INFO/ForkPoolWorker-15] [81b984be-9106-4206-883c-3a5124cf9474] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:16.646864336Z [2024-04-15 01:26:16,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:26:17.233112992Z [2024-04-15 01:26:17,232: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:26:19.686890115Z [2024-04-15 01:26:19,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81b984be-9106-4206-883c-3a5124cf9474] succeeded in 3.633718452000039s: None 2024-04-15T01:26:30.464228160Z [2024-04-15 01:26:30,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b95deb0b-dbe2-4d30-a303-e9fbaee73002] received 2024-04-15T01:26:30.505117111Z [2024-04-15 01:26:30,499: INFO/ForkPoolWorker-15] [b95deb0b-dbe2-4d30-a303-e9fbaee73002] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:26:31.558353089Z [2024-04-15 01:26:31,538: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:26:32.382284669Z [2024-04-15 01:26:32,381: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:26:35.849465895Z [2024-04-15 01:26:35,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b95deb0b-dbe2-4d30-a303-e9fbaee73002] succeeded in 5.385593194999956s: None 2024-04-15T01:28:00.347612961Z [2024-04-15 01:28:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8943e1a1-25f2-480c-847d-c01aea189187] received 2024-04-15T01:28:00.376895368Z [2024-04-15 01:28:00,376: INFO/ForkPoolWorker-15] [8943e1a1-25f2-480c-847d-c01aea189187] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:28:00.748673520Z [2024-04-15 01:28:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:28:01.098827511Z [2024-04-15 01:28:01,098: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:28:01.789718214Z [2024-04-15 01:28:01,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8943e1a1-25f2-480c-847d-c01aea189187] succeeded in 1.4361132430000225s: None 2024-04-15T01:30:00.436210426Z [2024-04-15 01:30:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[982388cd-f690-4309-9736-d13ecf232ae7] received 2024-04-15T01:30:00.464894682Z [2024-04-15 01:30:00,464: INFO/ForkPoolWorker-15] [982388cd-f690-4309-9736-d13ecf232ae7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:30:00.835240392Z [2024-04-15 01:30:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:30:01.227505307Z [2024-04-15 01:30:01,227: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:30:01.877861346Z [2024-04-15 01:30:01,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[982388cd-f690-4309-9736-d13ecf232ae7] succeeded in 1.4328873630000771s: None 2024-04-15T01:32:00.735089566Z [2024-04-15 01:32:00,734: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[399e1393-67dc-49ab-8c29-e749ac3710f1] received 2024-04-15T01:32:00.764739516Z [2024-04-15 01:32:00,764: INFO/ForkPoolWorker-15] [399e1393-67dc-49ab-8c29-e749ac3710f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:32:01.207308307Z [2024-04-15 01:32:01,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:32:01.511984332Z [2024-04-15 01:32:01,511: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:02.180938955Z [2024-04-15 01:32:02,180: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[399e1393-67dc-49ab-8c29-e749ac3710f1] succeeded in 1.4377093699999932s: None 2024-04-15T01:32:23.932168378Z [2024-04-15 01:32:23,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[290dd53d-04e1-4aa9-9b7b-e02b1fe69ed6] received 2024-04-15T01:32:23.959281791Z [2024-04-15 01:32:23,959: INFO/ForkPoolWorker-15] [290dd53d-04e1-4aa9-9b7b-e02b1fe69ed6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:32:24.260913995Z [2024-04-15 01:32:24,257: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:32:25.186291169Z [2024-04-15 01:32:25,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cc4495d-17f8-43b6-91e7-022d4be720df] received 2024-04-15T01:32:25.266158066Z [2024-04-15 01:32:25,265: INFO/ForkPoolWorker-16] [0cc4495d-17f8-43b6-91e7-022d4be720df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:32:25.526850189Z [2024-04-15 01:32:25,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:32:25.708369273Z [2024-04-15 01:32:25,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:25.713598984Z [2024-04-15 01:32:25,713: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:25.746715854Z [2024-04-15 01:32:25,746: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:25.747554509Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:25.747565123Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:25.747704321Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:25.747750834Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:25.747946688Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:32:25.747957722Z [2024-04-15 01:32:25,747: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:25.830098782Z [2024-04-15 01:32:25,829: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:26.858674860Z [2024-04-15 01:32:26,858: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:32:26.861837380Z [2024-04-15 01:32:26,861: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:26.883929613Z [2024-04-15 01:32:26,883: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:32:26.888550333Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:26.888594444Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:26.888694516Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:26.888786634Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:32:26.888999712Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:32:26.889021889Z [2024-04-15 01:32:26,888: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:26.964487304Z [2024-04-15 01:32:26,964: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:27.345659387Z [2024-04-15 01:32:27,345: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[290dd53d-04e1-4aa9-9b7b-e02b1fe69ed6] succeeded in 3.4105693589999646s: None 2024-04-15T01:32:28.810950554Z [2024-04-15 01:32:28,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0cc4495d-17f8-43b6-91e7-022d4be720df] succeeded in 3.6135327179999877s: None 2024-04-15T01:32:34.149744512Z [2024-04-15 01:32:34,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbaece48-f2a7-40db-a3ff-b2865c3aa507] received 2024-04-15T01:32:34.158607852Z [2024-04-15 01:32:34,158: INFO/ForkPoolWorker-15] [bbaece48-f2a7-40db-a3ff-b2865c3aa507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:34.462836637Z [2024-04-15 01:32:34,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:32:35.707031422Z [2024-04-15 01:32:35,706: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:35.710947332Z [2024-04-15 01:32:35,710: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:35.736092320Z [2024-04-15 01:32:35,735: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:35.737192544Z [2024-04-15 01:32:35,736: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:35.737302562Z [2024-04-15 01:32:35,737: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:35.737535331Z [2024-04-15 01:32:35,737: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:35.737593249Z [2024-04-15 01:32:35,737: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:35.737855148Z [2024-04-15 01:32:35,737: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:32:35.737924622Z [2024-04-15 01:32:35,737: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:35.849291412Z [2024-04-15 01:32:35,849: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:36.465647848Z [2024-04-15 01:32:36,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbaece48-f2a7-40db-a3ff-b2865c3aa507] succeeded in 2.313826774000063s: None 2024-04-15T01:32:36.511621006Z [2024-04-15 01:32:36,511: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74c5525e-59ce-4a73-badd-5f92a7f3f8d1] received 2024-04-15T01:32:36.518489130Z [2024-04-15 01:32:36,518: INFO/ForkPoolWorker-15] [74c5525e-59ce-4a73-badd-5f92a7f3f8d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:36.848406035Z [2024-04-15 01:32:36,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:32:38.106384823Z [2024-04-15 01:32:38,106: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:38.110013942Z [2024-04-15 01:32:38,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:38.142744099Z [2024-04-15 01:32:38,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:38.145579465Z [2024-04-15 01:32:38,145: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:38.145744026Z [2024-04-15 01:32:38,145: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:38.146068799Z [2024-04-15 01:32:38,145: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:38.146211132Z [2024-04-15 01:32:38,146: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:38.146523831Z [2024-04-15 01:32:38,146: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:32:38.147346153Z [2024-04-15 01:32:38,147: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:38.218325674Z [2024-04-15 01:32:38,218: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:38.813724009Z [2024-04-15 01:32:38,813: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74c5525e-59ce-4a73-badd-5f92a7f3f8d1] succeeded in 2.299663885999962s: None 2024-04-15T01:32:38.825125314Z [2024-04-15 01:32:38,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e452293-6bb6-4b98-b6e5-77d98653c96a] received 2024-04-15T01:32:38.836925037Z [2024-04-15 01:32:38,836: INFO/ForkPoolWorker-15] [7e452293-6bb6-4b98-b6e5-77d98653c96a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:32:39.221215604Z [2024-04-15 01:32:39,213: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:32:40.503421720Z [2024-04-15 01:32:40,503: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:40.506958580Z [2024-04-15 01:32:40,506: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:40.549264980Z [2024-04-15 01:32:40,549: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:40.550531171Z [2024-04-15 01:32:40,550: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:40.550655421Z [2024-04-15 01:32:40,550: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:40.550899876Z [2024-04-15 01:32:40,550: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:40.551139291Z [2024-04-15 01:32:40,551: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:40.551406947Z [2024-04-15 01:32:40,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:32:40.551704482Z [2024-04-15 01:32:40,551: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:40.669607734Z [2024-04-15 01:32:40,669: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:41.246813013Z [2024-04-15 01:32:41,246: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e452293-6bb6-4b98-b6e5-77d98653c96a] succeeded in 2.416527239000061s: None 2024-04-15T01:32:42.096773715Z [2024-04-15 01:32:42,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f92675c-671a-464d-9b6e-07c24539a91f] received 2024-04-15T01:32:42.106992923Z [2024-04-15 01:32:42,106: INFO/ForkPoolWorker-15] [1f92675c-671a-464d-9b6e-07c24539a91f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:32:42.406512958Z [2024-04-15 01:32:42,402: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:32:43.865708384Z [2024-04-15 01:32:43,863: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:43.867351356Z [2024-04-15 01:32:43,867: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:43.955276599Z [2024-04-15 01:32:43,955: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:43.956412417Z [2024-04-15 01:32:43,956: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:43.956582765Z [2024-04-15 01:32:43,956: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:43.956808523Z [2024-04-15 01:32:43,956: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:32:43.956998700Z [2024-04-15 01:32:43,956: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:43.957330411Z [2024-04-15 01:32:43,957: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:32:43.957518500Z [2024-04-15 01:32:43,957: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:44.065357933Z [2024-04-15 01:32:44,065: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:44.666222379Z [2024-04-15 01:32:44,665: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f92675c-671a-464d-9b6e-07c24539a91f] succeeded in 2.5680322709999928s: None 2024-04-15T01:32:56.793740512Z [2024-04-15 01:32:56,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6008f602-80a8-40ee-a95b-9f124abb09c7] received 2024-04-15T01:32:56.807464693Z [2024-04-15 01:32:56,807: INFO/ForkPoolWorker-15] [6008f602-80a8-40ee-a95b-9f124abb09c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:32:57.257349610Z [2024-04-15 01:32:57,253: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:32:58.118167907Z [2024-04-15 01:32:58,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58633582-f669-4c74-8ae7-91a1f47cf69a] received 2024-04-15T01:32:58.146777378Z [2024-04-15 01:32:58,146: INFO/ForkPoolWorker-16] [58633582-f669-4c74-8ae7-91a1f47cf69a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:32:58.473859083Z [2024-04-15 01:32:58,470: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:32:58.561095483Z [2024-04-15 01:32:58,560: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:32:58.564861088Z [2024-04-15 01:32:58,564: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:58.584292482Z [2024-04-15 01:32:58,584: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:32:58.585541276Z [2024-04-15 01:32:58,585: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:58.585613723Z [2024-04-15 01:32:58,585: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:58.585675236Z [2024-04-15 01:32:58,585: INFO/ForkPoolWorker-15] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:32:58.585856910Z [2024-04-15 01:32:58,585: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:32:58.585879292Z [2024-04-15 01:32:58,585: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:32:58.586138188Z [2024-04-15 01:32:58,586: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:32:58.586176654Z [2024-04-15 01:32:58,586: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:58.590862351Z [2024-04-15 01:32:58,590: INFO/ForkPoolWorker-15] Creating DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:32:58.663887344Z [2024-04-15 01:32:58,663: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:32:59.781261596Z [2024-04-15 01:32:59,780: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:32:59.784506239Z [2024-04-15 01:32:59,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:32:59.817647866Z [2024-04-15 01:32:59,817: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:32:59.818952073Z [2024-04-15 01:32:59,818: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:32:59.819934186Z [2024-04-15 01:32:59,819: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:32:59.819965512Z [2024-04-15 01:32:59,819: INFO/ForkPoolWorker-16] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:32:59.820156527Z [2024-04-15 01:32:59,819: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:32:59.820359514Z [2024-04-15 01:32:59,820: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:32:59.820951555Z [2024-04-15 01:32:59,820: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:32:59.821080322Z [2024-04-15 01:32:59,820: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:32:59.830991723Z [2024-04-15 01:32:59,830: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:32:59.920103367Z [2024-04-15 01:32:59,919: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:00.224113002Z [2024-04-15 01:33:00,223: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6008f602-80a8-40ee-a95b-9f124abb09c7] succeeded in 3.4286623599999757s: None 2024-04-15T01:33:01.037874259Z [2024-04-15 01:33:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57381865-9604-4e06-92e1-daf89ab3f525] received 2024-04-15T01:33:01.041371151Z [2024-04-15 01:33:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[619b2bd0-c494-409f-b556-033c8d6f515f] received 2024-04-15T01:33:01.053299784Z [2024-04-15 01:33:01,053: INFO/ForkPoolWorker-15] [57381865-9604-4e06-92e1-daf89ab3f525] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:33:01.059122335Z [2024-04-15 01:33:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85e0f80d-d08a-4f01-954d-9cdb99599acc] received 2024-04-15T01:33:01.187872018Z [2024-04-15 01:33:01,187: INFO/ForkPoolWorker-1] [619b2bd0-c494-409f-b556-033c8d6f515f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:33:01.198155906Z [2024-04-15 01:33:01,197: INFO/ForkPoolWorker-2] [85e0f80d-d08a-4f01-954d-9cdb99599acc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:33:01.651885215Z [2024-04-15 01:33:01,647: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:33:01.734114072Z [2024-04-15 01:33:01,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:33:01.908699582Z [2024-04-15 01:33:01,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:33:02.094471303Z [2024-04-15 01:33:02,094: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58633582-f669-4c74-8ae7-91a1f47cf69a] succeeded in 3.9714557400000103s: None 2024-04-15T01:33:03.630691366Z [2024-04-15 01:33:03,630: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T01:33:03.635736341Z [2024-04-15 01:33:03,635: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:03.660655120Z [2024-04-15 01:33:03,660: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:33:03.668583195Z [2024-04-15 01:33:03,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:03.702581453Z [2024-04-15 01:33:03,702: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:33:03.703575854Z [2024-04-15 01:33:03,703: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T01:33:03.704233935Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:03.704396193Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:03.704530680Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:03.704715669Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:03.704817875Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:33:03.705077218Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:33:03.705085588Z [2024-04-15 01:33:03,704: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:03.705162886Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:03.705231672Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:03.705477012Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:03.705519951Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T01:33:03.705649316Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:03.705793231Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:33:03.705855115Z [2024-04-15 01:33:03,705: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:03.710617762Z [2024-04-15 01:33:03,710: INFO/ForkPoolWorker-15] Creating DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:03.712425701Z [2024-04-15 01:33:03,712: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:03.819892400Z [2024-04-15 01:33:03,817: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:33:03.823368532Z [2024-04-15 01:33:03,820: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:03.848728475Z [2024-04-15 01:33:03,843: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:03.861511270Z [2024-04-15 01:33:03,855: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:03.962456873Z [2024-04-15 01:33:03,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:33:03.969591254Z [2024-04-15 01:33:03,969: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:03.969884801Z [2024-04-15 01:33:03,969: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:03.969985322Z [2024-04-15 01:33:03,969: INFO/ForkPoolWorker-1] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:03.970756158Z [2024-04-15 01:33:03,970: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:03.970874712Z [2024-04-15 01:33:03,970: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:33:03.971186708Z [2024-04-15 01:33:03,971: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:33:03.972905054Z [2024-04-15 01:33:03,971: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:03.978015275Z [2024-04-15 01:33:03,977: INFO/ForkPoolWorker-1] Creating DAG vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:03.998710209Z [2024-04-15 01:33:03,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7728feb1-9241-4e6c-8f1a-a979026c0bd8] received 2024-04-15T01:33:04.014909085Z [2024-04-15 01:33:04,014: INFO/ForkPoolWorker-16] [7728feb1-9241-4e6c-8f1a-a979026c0bd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:33:04.235913789Z [2024-04-15 01:33:04,235: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:04.506913636Z [2024-04-15 01:33:04,503: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:33:05.920085753Z [2024-04-15 01:33:05,919: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57381865-9604-4e06-92e1-daf89ab3f525] succeeded in 4.877373895000005s: None 2024-04-15T01:33:06.016235022Z [2024-04-15 01:33:06,015: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:33:06.019684522Z [2024-04-15 01:33:06,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:06.072960127Z [2024-04-15 01:33:06,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:33:06.076877210Z [2024-04-15 01:33:06,076: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:06.076982826Z [2024-04-15 01:33:06,076: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:06.077084532Z [2024-04-15 01:33:06,076: INFO/ForkPoolWorker-16] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:06.077256631Z [2024-04-15 01:33:06,077: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:06.077355033Z [2024-04-15 01:33:06,077: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:33:06.077650248Z [2024-04-15 01:33:06,077: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:33:06.077773617Z [2024-04-15 01:33:06,077: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:06.082392982Z [2024-04-15 01:33:06,082: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:06.127068014Z [2024-04-15 01:33:06,126: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[619b2bd0-c494-409f-b556-033c8d6f515f] succeeded in 5.078954759999988s: None 2024-04-15T01:33:06.162066259Z [2024-04-15 01:33:06,161: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:06.359270143Z [2024-04-15 01:33:06,358: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[85e0f80d-d08a-4f01-954d-9cdb99599acc] succeeded in 5.295581878999997s: None 2024-04-15T01:33:07.350822119Z [2024-04-15 01:33:07,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a2dce15-a799-496e-9e9d-a75b591fab8a] received 2024-04-15T01:33:07.358557178Z [2024-04-15 01:33:07,358: INFO/ForkPoolWorker-15] [9a2dce15-a799-496e-9e9d-a75b591fab8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:07.656605810Z [2024-04-15 01:33:07,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:33:07.833982769Z [2024-04-15 01:33:07,832: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7728feb1-9241-4e6c-8f1a-a979026c0bd8] succeeded in 3.826750277999963s: None 2024-04-15T01:33:08.882260283Z [2024-04-15 01:33:08,881: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:33:08.885350532Z [2024-04-15 01:33:08,884: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:08.921122925Z [2024-04-15 01:33:08,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:33:08.926940729Z [2024-04-15 01:33:08,926: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:08.926972084Z [2024-04-15 01:33:08,926: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:08.927024101Z [2024-04-15 01:33:08,926: INFO/ForkPoolWorker-15] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:08.930466353Z [2024-04-15 01:33:08,927: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:08.931064182Z [2024-04-15 01:33:08,930: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:33:08.932237619Z [2024-04-15 01:33:08,931: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:33:08.932395870Z [2024-04-15 01:33:08,932: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:08.938426978Z [2024-04-15 01:33:08,938: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:09.072541125Z [2024-04-15 01:33:09,072: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:09.666831798Z [2024-04-15 01:33:09,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed6717dc-1a35-4ff1-acba-bf2f68d19133] received 2024-04-15T01:33:09.678183256Z [2024-04-15 01:33:09,677: INFO/ForkPoolWorker-16] [ed6717dc-1a35-4ff1-acba-bf2f68d19133] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'split_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:09.793679324Z [2024-04-15 01:33:09,793: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9a2dce15-a799-496e-9e9d-a75b591fab8a] succeeded in 2.4412133179999955s: None 2024-04-15T01:33:10.066761211Z [2024-04-15 01:33:10,063: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:33:11.258839049Z [2024-04-15 01:33:11,258: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:33:11.262105900Z [2024-04-15 01:33:11,261: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:11.304721947Z [2024-04-15 01:33:11,304: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:33:11.306512483Z [2024-04-15 01:33:11,306: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:11.306734921Z [2024-04-15 01:33:11,306: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:11.306921444Z [2024-04-15 01:33:11,306: INFO/ForkPoolWorker-16] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:11.307417170Z [2024-04-15 01:33:11,307: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:11.307562735Z [2024-04-15 01:33:11,307: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:33:11.308074962Z [2024-04-15 01:33:11,307: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:33:11.309358582Z [2024-04-15 01:33:11,308: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:11.316636989Z [2024-04-15 01:33:11,316: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:11.455709209Z [2024-04-15 01:33:11,455: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:12.131888950Z [2024-04-15 01:33:12,131: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ed6717dc-1a35-4ff1-acba-bf2f68d19133] succeeded in 2.4636661600000025s: None 2024-04-15T01:33:12.402747222Z [2024-04-15 01:33:12,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3801a6f-978a-466c-b211-0bcd039dc08e] received 2024-04-15T01:33:12.414303699Z [2024-04-15 01:33:12,414: INFO/ForkPoolWorker-15] [c3801a6f-978a-466c-b211-0bcd039dc08e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'collect_metrics', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:33:12.987335919Z [2024-04-15 01:33:12,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:33:14.580671751Z [2024-04-15 01:33:14,580: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:33:14.583896140Z [2024-04-15 01:33:14,583: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:14.619739857Z [2024-04-15 01:33:14,619: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:33:14.623380322Z [2024-04-15 01:33:14,623: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:14.623392069Z [2024-04-15 01:33:14,623: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:14.626359180Z [2024-04-15 01:33:14,623: INFO/ForkPoolWorker-15] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:14.626495846Z [2024-04-15 01:33:14,626: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:14.626506409Z [2024-04-15 01:33:14,626: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:33:14.626842552Z [2024-04-15 01:33:14,626: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:33:14.626861729Z [2024-04-15 01:33:14,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:14.632730636Z [2024-04-15 01:33:14,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:14.729752520Z [2024-04-15 01:33:14,728: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:15.213893954Z [2024-04-15 01:33:15,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71dc71c0-f20a-4b65-9f9a-502e6e4e505d] received 2024-04-15T01:33:15.225620633Z [2024-04-15 01:33:15,225: INFO/ForkPoolWorker-16] [71dc71c0-f20a-4b65-9f9a-502e6e4e505d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'send_prometheus', 'scheduled__2024-04-15T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:33:15.259359534Z [2024-04-15 01:33:15,259: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3801a6f-978a-466c-b211-0bcd039dc08e] succeeded in 2.855411057000083s: None 2024-04-15T01:33:15.573650024Z [2024-04-15 01:33:15,570: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:33:16.901842236Z [2024-04-15 01:33:16,899: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:33:16.911888899Z [2024-04-15 01:33:16,911: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:33:16.946299147Z [2024-04-15 01:33:16,945: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:33:16.950514913Z [2024-04-15 01:33:16,948: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:33:16.951214465Z [2024-04-15 01:33:16,951: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:33:16.954681987Z [2024-04-15 01:33:16,951: INFO/ForkPoolWorker-16] Read VIM 7f9b103c-1775-407a-91a5-978768a6d4dc (basic01_474842) 2024-04-15T01:33:16.954944027Z [2024-04-15 01:33:16,954: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '7f9b103c-1775-407a-91a5-978768a6d4dc', 'name': 'basic01_474842', 'vim_type': 'openstack'}] 2024-04-15T01:33:16.961807258Z [2024-04-15 01:33:16,954: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:33:16.962434011Z [2024-04-15 01:33:16,962: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:33:16.962479928Z [2024-04-15 01:33:16,962: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:33:16.969039942Z [2024-04-15 01:33:16,968: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_7f9b103c-1775-407a-91a5-978768a6d4dc 2024-04-15T01:33:17.038879317Z [2024-04-15 01:33:17,038: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:33:17.555944877Z [2024-04-15 01:33:17,555: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71dc71c0-f20a-4b65-9f9a-502e6e4e505d] succeeded in 2.339368727999954s: None 2024-04-15T01:34:00.753873365Z [2024-04-15 01:34:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72a72cb2-202a-4d22-8a67-71216424f080] received 2024-04-15T01:34:00.764093947Z [2024-04-15 01:34:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[999625e2-6ab3-4cb2-8f6d-7514f8b757ab] received 2024-04-15T01:34:00.766907687Z [2024-04-15 01:34:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2361a599-3adf-4787-9678-5f97c19c8fe0] received 2024-04-15T01:34:00.776205109Z [2024-04-15 01:34:00,775: INFO/ForkPoolWorker-15] [72a72cb2-202a-4d22-8a67-71216424f080] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:00.785113614Z [2024-04-15 01:34:00,781: INFO/ForkPoolWorker-16] [999625e2-6ab3-4cb2-8f6d-7514f8b757ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:00.790026728Z [2024-04-15 01:34:00,786: INFO/ForkPoolWorker-1] [2361a599-3adf-4787-9678-5f97c19c8fe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:00.790041244Z [2024-04-15 01:34:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01e08091-5ca0-4f41-a40b-4532d454854b] received 2024-04-15T01:34:00.790739870Z [2024-04-15 01:34:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d359020-5daf-4b42-9450-cf2944fbe4da] received 2024-04-15T01:34:00.816420881Z [2024-04-15 01:34:00,801: INFO/ForkPoolWorker-2] [01e08091-5ca0-4f41-a40b-4532d454854b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:34:00.999573051Z [2024-04-15 01:34:00,999: INFO/ForkPoolWorker-3] [6d359020-5daf-4b42-9450-cf2944fbe4da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:01.397444242Z [2024-04-15 01:34:01,391: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:34:01.500428514Z [2024-04-15 01:34:01,496: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:01.630046560Z [2024-04-15 01:34:01,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:01.681620988Z [2024-04-15 01:34:01,677: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:01.866562771Z [2024-04-15 01:34:01,866: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:34:02.081969946Z [2024-04-15 01:34:02,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:03.539534886Z [2024-04-15 01:34:03,537: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01e08091-5ca0-4f41-a40b-4532d454854b] succeeded in 2.7488919610000266s: None 2024-04-15T01:34:03.564149556Z [2024-04-15 01:34:03,563: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-15T01:34:03.568621824Z [2024-04-15 01:34:03,568: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:03.624439786Z [2024-04-15 01:34:03,624: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-15T01:34:03.645522451Z [2024-04-15 01:34:03,642: INFO/ForkPoolWorker-3] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:03.649433615Z [2024-04-15 01:34:03,649: INFO/ForkPoolWorker-3] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:03.650035564Z [2024-04-15 01:34:03,649: INFO/ForkPoolWorker-3] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:03.650150528Z [2024-04-15 01:34:03,650: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-15T01:34:03.650438160Z [2024-04-15 01:34:03,650: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:34:03.650556136Z [2024-04-15 01:34:03,650: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:03.970035979Z [2024-04-15 01:34:03,969: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:34:04.471599947Z [2024-04-15 01:34:04,471: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:34:04.474865843Z [2024-04-15 01:34:04,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:04.561306418Z [2024-04-15 01:34:04,561: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:34:04.563841838Z [2024-04-15 01:34:04,563: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:04.564024758Z [2024-04-15 01:34:04,563: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:04.564280371Z [2024-04-15 01:34:04,564: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:04.564496076Z [2024-04-15 01:34:04,564: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:34:04.564812465Z [2024-04-15 01:34:04,564: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:34:04.565287411Z [2024-04-15 01:34:04,565: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:04.577711291Z [2024-04-15 01:34:04,577: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:04.579080219Z [2024-04-15 01:34:04,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:04.580020164Z [2024-04-15 01:34:04,579: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:34:04.583030020Z [2024-04-15 01:34:04,582: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:04.635340398Z [2024-04-15 01:34:04,635: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:34:04.639093564Z [2024-04-15 01:34:04,638: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:04.639220013Z [2024-04-15 01:34:04,639: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:04.639373520Z [2024-04-15 01:34:04,639: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:04.639445231Z [2024-04-15 01:34:04,639: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:34:04.639732907Z [2024-04-15 01:34:04,639: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:34:04.639852086Z [2024-04-15 01:34:04,639: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:04.640961849Z [2024-04-15 01:34:04,640: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:34:04.645197179Z [2024-04-15 01:34:04,644: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:04.645351111Z [2024-04-15 01:34:04,644: ERROR/ForkPoolWorker-1] [2361a599-3adf-4787-9678-5f97c19c8fe0] Failed to execute task Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:34:04.645359826Z Traceback (most recent call last): 2024-04-15T01:34:04.645363455Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:34:04.645366974Z args.func(args) 2024-04-15T01:34:04.645370131Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:34:04.645373702Z return func(*args, **kwargs) 2024-04-15T01:34:04.645376937Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:34:04.645379790Z return f(*args, **kwargs) 2024-04-15T01:34:04.645382583Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:34:04.645385370Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:34:04.645404825Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:34:04.645408044Z raise AirflowException( 2024-04-15T01:34:04.645413761Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:34:04.700860398Z [2024-04-15 01:34:04,700: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2361a599-3adf-4787-9678-5f97c19c8fe0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2361a599-3adf-4787-9678-5f97c19c8fe0') 2024-04-15T01:34:04.700896522Z Traceback (most recent call last): 2024-04-15T01:34:04.700902784Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:34:04.700907613Z R = retval = fun(*args, **kwargs) 2024-04-15T01:34:04.700912308Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:34:04.700916935Z return self.run(*args, **kwargs) 2024-04-15T01:34:04.700922417Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:34:04.700928181Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:34:04.700932913Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:34:04.700938480Z raise AirflowException(msg) 2024-04-15T01:34:04.700944263Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2361a599-3adf-4787-9678-5f97c19c8fe0 2024-04-15T01:34:04.717599338Z [2024-04-15 01:34:04,714: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:34:04.728402265Z [2024-04-15 01:34:04,728: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:04.728426932Z [2024-04-15 01:34:04,728: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:04.728552024Z [2024-04-15 01:34:04,728: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:04.728565733Z [2024-04-15 01:34:04,728: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:34:04.729554629Z [2024-04-15 01:34:04,729: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:34:04.729570840Z [2024-04-15 01:34:04,729: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:04.773753897Z [2024-04-15 01:34:04,772: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:34:04.781674991Z [2024-04-15 01:34:04,777: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:04.861510348Z [2024-04-15 01:34:04,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:34:04.872778731Z [2024-04-15 01:34:04,872: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:34:04.874489849Z [2024-04-15 01:34:04,874: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:04.874502299Z [2024-04-15 01:34:04,874: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:04.874626130Z [2024-04-15 01:34:04,874: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:04.874650972Z [2024-04-15 01:34:04,874: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:34:04.877109959Z [2024-04-15 01:34:04,876: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:34:04.877119913Z [2024-04-15 01:34:04,876: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:04.895330214Z [2024-04-15 01:34:04,895: WARNING/ForkPoolWorker-15] Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:04.896447903Z [2024-04-15 01:34:04,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:04.898591853Z [2024-04-15 01:34:04,898: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:34:04.902853006Z [2024-04-15 01:34:04,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:04.939990118Z [2024-04-15 01:34:04,938: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:34:04.945005538Z [2024-04-15 01:34:04,944: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:04.946637224Z [2024-04-15 01:34:04,946: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:04.946742403Z [2024-04-15 01:34:04,946: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:04.946795078Z [2024-04-15 01:34:04,946: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:34:04.947378069Z [2024-04-15 01:34:04,947: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:34:04.947390440Z [2024-04-15 01:34:04,947: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:04.951628444Z [2024-04-15 01:34:04,950: ERROR/ForkPoolWorker-15] [72a72cb2-202a-4d22-8a67-71216424f080] Failed to execute task Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:34:04.951643983Z Traceback (most recent call last): 2024-04-15T01:34:04.951649963Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:34:04.951655221Z args.func(args) 2024-04-15T01:34:04.951660007Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:34:04.951664954Z return func(*args, **kwargs) 2024-04-15T01:34:04.951669790Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:34:04.951674392Z return f(*args, **kwargs) 2024-04-15T01:34:04.951679089Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:34:04.951683907Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:34:04.951688241Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:34:04.951692682Z raise AirflowException( 2024-04-15T01:34:04.951698250Z airflow.exceptions.AirflowException: Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:34:05.021639167Z [2024-04-15 01:34:05,021: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72a72cb2-202a-4d22-8a67-71216424f080] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 72a72cb2-202a-4d22-8a67-71216424f080') 2024-04-15T01:34:05.021652895Z Traceback (most recent call last): 2024-04-15T01:34:05.021656744Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:34:05.021659868Z R = retval = fun(*args, **kwargs) 2024-04-15T01:34:05.021662848Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:34:05.021665867Z return self.run(*args, **kwargs) 2024-04-15T01:34:05.021669499Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:34:05.021673145Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:34:05.021676205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:34:05.021679838Z raise AirflowException(msg) 2024-04-15T01:34:05.021683213Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 72a72cb2-202a-4d22-8a67-71216424f080 2024-04-15T01:34:06.117076691Z [2024-04-15 01:34:06,116: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6d359020-5daf-4b42-9450-cf2944fbe4da] succeeded in 5.321542671000088s: None 2024-04-15T01:34:06.369647756Z [2024-04-15 01:34:06,369: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[999625e2-6ab3-4cb2-8f6d-7514f8b757ab] succeeded in 5.603175802999999s: None 2024-04-15T01:34:15.157793137Z [2024-04-15 01:34:15,157: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb0a2ff3-038d-4e66-a280-1099ca7e1375] received 2024-04-15T01:34:15.169405078Z [2024-04-15 01:34:15,169: INFO/ForkPoolWorker-15] [cb0a2ff3-038d-4e66-a280-1099ca7e1375] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:34:15.517428915Z [2024-04-15 01:34:15,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:16.359998622Z [2024-04-15 01:34:16,359: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85eeaa78-5a83-4497-b592-679beb9593a6] received 2024-04-15T01:34:16.369304177Z [2024-04-15 01:34:16,369: INFO/ForkPoolWorker-16] [85eeaa78-5a83-4497-b592-679beb9593a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:34:16.709200811Z [2024-04-15 01:34:16,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:16.816547456Z [2024-04-15 01:34:16,813: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:34:16.820039956Z [2024-04-15 01:34:16,819: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:16.852035152Z [2024-04-15 01:34:16,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:34:16.854743522Z [2024-04-15 01:34:16,854: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:16.855306401Z [2024-04-15 01:34:16,855: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:16.855675474Z [2024-04-15 01:34:16,855: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:16.855817216Z [2024-04-15 01:34:16,855: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:34:16.856073989Z [2024-04-15 01:34:16,855: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:34:16.856188562Z [2024-04-15 01:34:16,856: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:16.866005307Z [2024-04-15 01:34:16,865: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:16.868540787Z [2024-04-15 01:34:16,866: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:34:16.869816674Z [2024-04-15 01:34:16,869: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:34:16.873100073Z [2024-04-15 01:34:16,872: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:16.911424516Z [2024-04-15 01:34:16,911: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:34:16.915319979Z [2024-04-15 01:34:16,914: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:16.915479699Z [2024-04-15 01:34:16,915: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:16.916713369Z [2024-04-15 01:34:16,915: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:16.916776794Z [2024-04-15 01:34:16,916: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:34:16.917062087Z [2024-04-15 01:34:16,916: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:34:16.917070073Z [2024-04-15 01:34:16,917: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:16.921701309Z [2024-04-15 01:34:16,921: ERROR/ForkPoolWorker-15] [cb0a2ff3-038d-4e66-a280-1099ca7e1375] Failed to execute task Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:34:16.921749518Z Traceback (most recent call last): 2024-04-15T01:34:16.921755798Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:34:16.921760418Z args.func(args) 2024-04-15T01:34:16.921765376Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:34:16.921770207Z return func(*args, **kwargs) 2024-04-15T01:34:16.921774536Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:34:16.921791494Z return f(*args, **kwargs) 2024-04-15T01:34:16.921795886Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:34:16.921800076Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:34:16.921804158Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:34:16.921809281Z raise AirflowException( 2024-04-15T01:34:16.921814190Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:34:16.957376830Z [2024-04-15 01:34:16,956: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb0a2ff3-038d-4e66-a280-1099ca7e1375] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cb0a2ff3-038d-4e66-a280-1099ca7e1375') 2024-04-15T01:34:16.957391940Z Traceback (most recent call last): 2024-04-15T01:34:16.957395779Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:34:16.957398876Z R = retval = fun(*args, **kwargs) 2024-04-15T01:34:16.957401758Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:34:16.957404543Z return self.run(*args, **kwargs) 2024-04-15T01:34:16.957408151Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:34:16.957411632Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:34:16.957414915Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:34:16.957418223Z raise AirflowException(msg) 2024-04-15T01:34:16.957421667Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cb0a2ff3-038d-4e66-a280-1099ca7e1375 2024-04-15T01:34:17.960721452Z [2024-04-15 01:34:17,960: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:34:17.966315638Z [2024-04-15 01:34:17,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:17.988048127Z [2024-04-15 01:34:17,987: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:34:17.989351726Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:17.989422871Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:17.989568970Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:17.989637500Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:34:17.989911656Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:34:17.990009461Z [2024-04-15 01:34:17,989: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:17.996614846Z [2024-04-15 01:34:17,996: WARNING/ForkPoolWorker-16] Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:17.997267300Z [2024-04-15 01:34:17,996: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:34:17.997998605Z [2024-04-15 01:34:17,997: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:34:18.000485244Z [2024-04-15 01:34:18,000: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:34:18.022310700Z [2024-04-15 01:34:18,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:34:18.025303079Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:34:18.025314546Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:34:18.025458529Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:34:18.025526761Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:34:18.025734466Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:34:18.025809531Z [2024-04-15 01:34:18,025: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:34:18.028813289Z [2024-04-15 01:34:18,028: ERROR/ForkPoolWorker-16] [85eeaa78-5a83-4497-b592-679beb9593a6] Failed to execute task Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:34:18.028822660Z Traceback (most recent call last): 2024-04-15T01:34:18.028826513Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:34:18.028830090Z args.func(args) 2024-04-15T01:34:18.028833579Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:34:18.028837323Z return func(*args, **kwargs) 2024-04-15T01:34:18.028840351Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:34:18.028843411Z return f(*args, **kwargs) 2024-04-15T01:34:18.028846448Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:34:18.028849552Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:34:18.028852548Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:34:18.028855533Z raise AirflowException( 2024-04-15T01:34:18.028893785Z airflow.exceptions.AirflowException: Dag 'vim_status_7f9b103c-1775-407a-91a5-978768a6d4dc' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:34:18.064722165Z [2024-04-15 01:34:18,064: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85eeaa78-5a83-4497-b592-679beb9593a6] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 85eeaa78-5a83-4497-b592-679beb9593a6') 2024-04-15T01:34:18.064734138Z Traceback (most recent call last): 2024-04-15T01:34:18.064748070Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:34:18.064751211Z R = retval = fun(*args, **kwargs) 2024-04-15T01:34:18.064754181Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:34:18.064772685Z return self.run(*args, **kwargs) 2024-04-15T01:34:18.064777095Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:34:18.064780595Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:34:18.064783527Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:34:18.064787118Z raise AirflowException(msg) 2024-04-15T01:34:18.064790542Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 85eeaa78-5a83-4497-b592-679beb9593a6 2024-04-15T01:35:01.047688528Z [2024-04-15 01:35:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0debe326-cb97-4624-bde5-a8e2e00d588f] received 2024-04-15T01:35:01.054727245Z [2024-04-15 01:35:01,054: INFO/ForkPoolWorker-15] [0debe326-cb97-4624-bde5-a8e2e00d588f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:01.055864477Z [2024-04-15 01:35:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b26b082-eb17-4a9d-8dbd-e1ba81e27b71] received 2024-04-15T01:35:01.079417081Z [2024-04-15 01:35:01,078: INFO/ForkPoolWorker-16] [4b26b082-eb17-4a9d-8dbd-e1ba81e27b71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:35:01.085925131Z [2024-04-15 01:35:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a5317e3-b6cf-4230-93de-54c8833ee97e] received 2024-04-15T01:35:01.102824965Z [2024-04-15 01:35:01,102: INFO/ForkPoolWorker-1] [0a5317e3-b6cf-4230-93de-54c8833ee97e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:35:01.509875424Z [2024-04-15 01:35:01,505: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:35:01.595789561Z [2024-04-15 01:35:01,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:35:01.617946264Z [2024-04-15 01:35:01,614: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:35:03.634054470Z [2024-04-15 01:35:03,633: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:35:03.639118908Z [2024-04-15 01:35:03,638: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:03.732910858Z [2024-04-15 01:35:03,732: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:35:03.742518305Z [2024-04-15 01:35:03,742: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:03.742624841Z [2024-04-15 01:35:03,742: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:03.742781273Z [2024-04-15 01:35:03,742: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:03.742848425Z [2024-04-15 01:35:03,742: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:35:03.743124326Z [2024-04-15 01:35:03,743: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:35:03.743174128Z [2024-04-15 01:35:03,743: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:04.026157991Z [2024-04-15 01:35:04,025: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:04.223580987Z [2024-04-15 01:35:04,223: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:35:04.240284340Z [2024-04-15 01:35:04,239: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:04.288713210Z [2024-04-15 01:35:04,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:35:04.292040037Z [2024-04-15 01:35:04,291: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:04.292060495Z [2024-04-15 01:35:04,291: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:04.292205970Z [2024-04-15 01:35:04,292: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:04.292217694Z [2024-04-15 01:35:04,292: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:35:04.292430194Z [2024-04-15 01:35:04,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:35:04.292462250Z [2024-04-15 01:35:04,292: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:04.495637761Z [2024-04-15 01:35:04,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:04.717988651Z [2024-04-15 01:35:04,717: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:35:04.723081351Z [2024-04-15 01:35:04,722: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:04.919388918Z [2024-04-15 01:35:04,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:35:04.921625577Z [2024-04-15 01:35:04,921: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:04.921722815Z [2024-04-15 01:35:04,921: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:04.921934203Z [2024-04-15 01:35:04,921: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:04.922084745Z [2024-04-15 01:35:04,921: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:35:04.922361672Z [2024-04-15 01:35:04,922: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:35:04.922421194Z [2024-04-15 01:35:04,922: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:05.032414447Z [2024-04-15 01:35:05,032: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:05.416881988Z [2024-04-15 01:35:05,414: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0debe326-cb97-4624-bde5-a8e2e00d588f] succeeded in 4.3646541929999785s: None 2024-04-15T01:35:05.539361475Z [2024-04-15 01:35:05,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b60addba-fca8-4786-9ec7-ae8dcf4586b0] received 2024-04-15T01:35:05.546023633Z [2024-04-15 01:35:05,545: INFO/ForkPoolWorker-15] [b60addba-fca8-4786-9ec7-ae8dcf4586b0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:05.923208476Z [2024-04-15 01:35:05,919: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:35:05.939385575Z [2024-04-15 01:35:05,938: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a5317e3-b6cf-4230-93de-54c8833ee97e] succeeded in 4.850175576000083s: None 2024-04-15T01:35:06.974091894Z [2024-04-15 01:35:06,973: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4b26b082-eb17-4a9d-8dbd-e1ba81e27b71] succeeded in 5.912774243000058s: None 2024-04-15T01:35:07.231805984Z [2024-04-15 01:35:07,231: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:35:07.235913165Z [2024-04-15 01:35:07,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:07.276857962Z [2024-04-15 01:35:07,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:35:07.278577613Z [2024-04-15 01:35:07,278: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:07.278771502Z [2024-04-15 01:35:07,278: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:07.279093164Z [2024-04-15 01:35:07,278: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:07.279756626Z [2024-04-15 01:35:07,279: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:35:07.280333649Z [2024-04-15 01:35:07,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:35:07.280434222Z [2024-04-15 01:35:07,280: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:07.357794181Z [2024-04-15 01:35:07,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:07.958868099Z [2024-04-15 01:35:07,958: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b60addba-fca8-4786-9ec7-ae8dcf4586b0] succeeded in 2.418008527999973s: None 2024-04-15T01:35:08.532708104Z [2024-04-15 01:35:08,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8704cbc-524c-4ee1-b2a2-edbc1646fde0] received 2024-04-15T01:35:08.553973515Z [2024-04-15 01:35:08,553: INFO/ForkPoolWorker-15] [d8704cbc-524c-4ee1-b2a2-edbc1646fde0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:35:08.849563375Z [2024-04-15 01:35:08,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:35:10.228097289Z [2024-04-15 01:35:10,227: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:35:10.231371496Z [2024-04-15 01:35:10,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:10.287980935Z [2024-04-15 01:35:10,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:35:10.289182052Z [2024-04-15 01:35:10,288: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:10.289197337Z [2024-04-15 01:35:10,289: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:10.289307944Z [2024-04-15 01:35:10,289: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:10.289332129Z [2024-04-15 01:35:10,289: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:35:10.289518250Z [2024-04-15 01:35:10,289: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:35:10.289545010Z [2024-04-15 01:35:10,289: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:10.377980017Z [2024-04-15 01:35:10,377: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:10.846726682Z [2024-04-15 01:35:10,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c86bc35-052a-4508-903f-bf2f02a98a9d] received 2024-04-15T01:35:10.860706947Z [2024-04-15 01:35:10,858: INFO/ForkPoolWorker-16] [8c86bc35-052a-4508-903f-bf2f02a98a9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:35:10.986453997Z [2024-04-15 01:35:10,986: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d8704cbc-524c-4ee1-b2a2-edbc1646fde0] succeeded in 2.451265504000048s: None 2024-04-15T01:35:11.189257454Z [2024-04-15 01:35:11,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:35:12.413950425Z [2024-04-15 01:35:12,413: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:35:12.417202797Z [2024-04-15 01:35:12,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:35:12.445091216Z [2024-04-15 01:35:12,444: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:35:12.446320395Z [2024-04-15 01:35:12,446: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:35:12.446477941Z [2024-04-15 01:35:12,446: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:35:12.446748041Z [2024-04-15 01:35:12,446: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:35:12.446907743Z [2024-04-15 01:35:12,446: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:35:12.447227917Z [2024-04-15 01:35:12,447: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:35:12.447472717Z [2024-04-15 01:35:12,447: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:35:12.553354636Z [2024-04-15 01:35:12,552: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:35:13.126369867Z [2024-04-15 01:35:13,126: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c86bc35-052a-4508-903f-bf2f02a98a9d] succeeded in 2.2781377270000576s: None 2024-04-15T01:36:00.212327622Z [2024-04-15 01:36:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04a8175d-dbf1-4ff5-9b14-21733e869639] received 2024-04-15T01:36:00.217696834Z [2024-04-15 01:36:00,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18ffa34e-2778-4582-90fc-4b4845542a85] received 2024-04-15T01:36:00.220458608Z [2024-04-15 01:36:00,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38eeffd6-86e0-4969-81a0-1c424bb986cd] received 2024-04-15T01:36:00.223598568Z [2024-04-15 01:36:00,223: INFO/ForkPoolWorker-15] [04a8175d-dbf1-4ff5-9b14-21733e869639] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:36:00.231110682Z [2024-04-15 01:36:00,230: INFO/ForkPoolWorker-16] [18ffa34e-2778-4582-90fc-4b4845542a85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:36:00.239827793Z [2024-04-15 01:36:00,239: INFO/ForkPoolWorker-1] [38eeffd6-86e0-4969-81a0-1c424bb986cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:36:00.557311448Z [2024-04-15 01:36:00,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:36:00.590366478Z [2024-04-15 01:36:00,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:36:00.631933934Z [2024-04-15 01:36:00,625: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:36:00.968878650Z [2024-04-15 01:36:00,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:01.862620350Z [2024-04-15 01:36:01,862: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[38eeffd6-86e0-4969-81a0-1c424bb986cd] succeeded in 1.6406503189998602s: None 2024-04-15T01:36:02.362294879Z [2024-04-15 01:36:02,361: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:02.365639415Z [2024-04-15 01:36:02,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:02.419115571Z [2024-04-15 01:36:02,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:02.420258506Z [2024-04-15 01:36:02,419: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:02.420326524Z [2024-04-15 01:36:02,420: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:02.420448205Z [2024-04-15 01:36:02,420: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:02.420850470Z [2024-04-15 01:36:02,420: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:02.420888482Z [2024-04-15 01:36:02,420: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:02.421179633Z [2024-04-15 01:36:02,421: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:36:02.421193486Z [2024-04-15 01:36:02,421: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:02.427004550Z [2024-04-15 01:36:02,426: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:02.467772595Z [2024-04-15 01:36:02,467: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:36:02.471751915Z [2024-04-15 01:36:02,471: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:02.527609008Z [2024-04-15 01:36:02,527: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:02.547575219Z [2024-04-15 01:36:02,547: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:36:02.564549186Z [2024-04-15 01:36:02,564: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:02.564672502Z [2024-04-15 01:36:02,564: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:02.564798691Z [2024-04-15 01:36:02,564: INFO/ForkPoolWorker-16] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:02.565176781Z [2024-04-15 01:36:02,564: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:02.568097257Z [2024-04-15 01:36:02,565: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:36:02.569649266Z [2024-04-15 01:36:02,569: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:36:02.569782057Z [2024-04-15 01:36:02,569: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:02.592562480Z [2024-04-15 01:36:02,592: INFO/ForkPoolWorker-16] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:02.732174782Z [2024-04-15 01:36:02,731: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:04.570217328Z [2024-04-15 01:36:04,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[18ffa34e-2778-4582-90fc-4b4845542a85] succeeded in 4.348006193999936s: None 2024-04-15T01:36:04.976255240Z [2024-04-15 01:36:04,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04a8175d-dbf1-4ff5-9b14-21733e869639] succeeded in 4.7621788179999385s: None 2024-04-15T01:36:08.402571416Z [2024-04-15 01:36:08,402: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e5145dd-3fc6-4825-8ab5-e01129ca8a27] received 2024-04-15T01:36:08.427432177Z [2024-04-15 01:36:08,427: INFO/ForkPoolWorker-15] [2e5145dd-3fc6-4825-8ab5-e01129ca8a27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:36:08.746327361Z [2024-04-15 01:36:08,742: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:36:09.725684444Z [2024-04-15 01:36:09,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3db3037e-9087-4218-b379-ada8ff38c9ce] received 2024-04-15T01:36:09.738106122Z [2024-04-15 01:36:09,737: INFO/ForkPoolWorker-16] [3db3037e-9087-4218-b379-ada8ff38c9ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:36:10.194958493Z [2024-04-15 01:36:10,194: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:10.198875161Z [2024-04-15 01:36:10,197: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:10.251808014Z [2024-04-15 01:36:10,247: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:36:10.256300143Z [2024-04-15 01:36:10,256: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:10.260233157Z [2024-04-15 01:36:10,259: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:10.260344023Z [2024-04-15 01:36:10,260: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:10.260445433Z [2024-04-15 01:36:10,260: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:10.260675479Z [2024-04-15 01:36:10,260: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:10.260780979Z [2024-04-15 01:36:10,260: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:10.261044960Z [2024-04-15 01:36:10,260: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:36:10.261168237Z [2024-04-15 01:36:10,261: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:10.270558977Z [2024-04-15 01:36:10,270: INFO/ForkPoolWorker-15] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:10.357811644Z [2024-04-15 01:36:10,357: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:11.661860345Z [2024-04-15 01:36:11,661: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:36:11.670491731Z [2024-04-15 01:36:11,670: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:11.710740897Z [2024-04-15 01:36:11,710: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:36:11.712889330Z [2024-04-15 01:36:11,712: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:11.713121489Z [2024-04-15 01:36:11,712: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:11.713302350Z [2024-04-15 01:36:11,713: INFO/ForkPoolWorker-16] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:11.713550428Z [2024-04-15 01:36:11,713: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:11.713678225Z [2024-04-15 01:36:11,713: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:36:11.714072806Z [2024-04-15 01:36:11,713: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:36:11.714329196Z [2024-04-15 01:36:11,714: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:11.718957948Z [2024-04-15 01:36:11,718: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:11.838766715Z [2024-04-15 01:36:11,837: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:12.031971276Z [2024-04-15 01:36:12,031: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2e5145dd-3fc6-4825-8ab5-e01129ca8a27] succeeded in 3.626937644999998s: None 2024-04-15T01:36:13.787320533Z [2024-04-15 01:36:13,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3db3037e-9087-4218-b379-ada8ff38c9ce] succeeded in 4.057409864999954s: None 2024-04-15T01:36:18.215359881Z [2024-04-15 01:36:18,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dcd50d15-0038-402a-8f51-93b0477e17e6] received 2024-04-15T01:36:18.230215584Z [2024-04-15 01:36:18,228: INFO/ForkPoolWorker-15] [dcd50d15-0038-402a-8f51-93b0477e17e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:18.578485647Z [2024-04-15 01:36:18,575: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:36:20.014856168Z [2024-04-15 01:36:20,014: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:20.018197080Z [2024-04-15 01:36:20,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:20.056120282Z [2024-04-15 01:36:20,055: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:20.060522130Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:20.060564658Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:20.060574978Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:20.060785837Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:20.060872099Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:20.061080193Z [2024-04-15 01:36:20,060: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:36:20.061088935Z [2024-04-15 01:36:20,061: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:20.067045104Z [2024-04-15 01:36:20,066: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:20.151989104Z [2024-04-15 01:36:20,151: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:20.743736284Z [2024-04-15 01:36:20,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dcd50d15-0038-402a-8f51-93b0477e17e6] succeeded in 2.525115006000078s: None 2024-04-15T01:36:20.903306696Z [2024-04-15 01:36:20,903: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[090059e1-a219-416e-a8d8-b6bb5f20e834] received 2024-04-15T01:36:20.935041460Z [2024-04-15 01:36:20,934: INFO/ForkPoolWorker-15] [090059e1-a219-416e-a8d8-b6bb5f20e834] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'split_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:21.304538426Z [2024-04-15 01:36:21,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:36:23.121960469Z [2024-04-15 01:36:23,121: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:23.126855533Z [2024-04-15 01:36:23,126: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:23.189413151Z [2024-04-15 01:36:23,189: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:23.190479416Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:23.190490369Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:23.190503149Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:23.190655730Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:23.190703579Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:23.190900757Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:36:23.190932959Z [2024-04-15 01:36:23,190: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:23.197528010Z [2024-04-15 01:36:23,197: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:23.284164302Z [2024-04-15 01:36:23,283: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:23.961579291Z [2024-04-15 01:36:23,961: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[090059e1-a219-416e-a8d8-b6bb5f20e834] succeeded in 3.0522814880000624s: None 2024-04-15T01:36:24.892473697Z [2024-04-15 01:36:24,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd3086a7-a518-4a81-8238-71967ca8e63f] received 2024-04-15T01:36:24.904474438Z [2024-04-15 01:36:24,904: INFO/ForkPoolWorker-15] [dd3086a7-a518-4a81-8238-71967ca8e63f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'collect_metrics', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:36:25.232122619Z [2024-04-15 01:36:25,228: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:36:26.443897343Z [2024-04-15 01:36:26,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:26.448694252Z [2024-04-15 01:36:26,448: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:26.498573298Z [2024-04-15 01:36:26,498: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:26.499722015Z [2024-04-15 01:36:26,499: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:26.499759710Z [2024-04-15 01:36:26,499: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:26.499817204Z [2024-04-15 01:36:26,499: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:26.499973375Z [2024-04-15 01:36:26,499: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:26.500008566Z [2024-04-15 01:36:26,499: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:26.500335345Z [2024-04-15 01:36:26,500: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:36:26.500375840Z [2024-04-15 01:36:26,500: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:26.507135922Z [2024-04-15 01:36:26,506: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:26.584852206Z [2024-04-15 01:36:26,584: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:27.206745634Z [2024-04-15 01:36:27,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd3086a7-a518-4a81-8238-71967ca8e63f] succeeded in 2.3129101109998373s: None 2024-04-15T01:36:27.223998223Z [2024-04-15 01:36:27,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e13b8c20-c717-40ea-8c8a-e99c198dbe4f] received 2024-04-15T01:36:27.230638356Z [2024-04-15 01:36:27,230: INFO/ForkPoolWorker-15] [e13b8c20-c717-40ea-8c8a-e99c198dbe4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'send_prometheus', 'scheduled__2024-04-15T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:36:27.543590841Z [2024-04-15 01:36:27,540: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:36:28.818863048Z [2024-04-15 01:36:28,818: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:36:28.823545628Z [2024-04-15 01:36:28,823: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:36:28.866293111Z [2024-04-15 01:36:28,866: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:36:28.868615804Z [2024-04-15 01:36:28,868: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:36:28.868712222Z [2024-04-15 01:36:28,868: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:36:28.868830687Z [2024-04-15 01:36:28,868: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:36:28.869022486Z [2024-04-15 01:36:28,868: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:36:28.869203176Z [2024-04-15 01:36:28,869: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:36:28.869843587Z [2024-04-15 01:36:28,869: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:36:28.869959252Z [2024-04-15 01:36:28,869: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:36:28.877011242Z [2024-04-15 01:36:28,876: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:36:28.954692061Z [2024-04-15 01:36:28,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:36:29.626884380Z [2024-04-15 01:36:29,626: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e13b8c20-c717-40ea-8c8a-e99c198dbe4f] succeeded in 2.4012601330000507s: None 2024-04-15T01:37:00.550746135Z [2024-04-15 01:37:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b22f8fb-46be-404e-b190-f0e19f7fcf60] received 2024-04-15T01:37:00.552565128Z [2024-04-15 01:37:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfd6be39-51cf-4944-945c-48a80c83459a] received 2024-04-15T01:37:00.555200540Z [2024-04-15 01:37:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66b0bd2c-d375-4f1a-a47d-62db1d33f4bb] received 2024-04-15T01:37:00.560321071Z [2024-04-15 01:37:00,559: INFO/ForkPoolWorker-16] [bfd6be39-51cf-4944-945c-48a80c83459a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:37:00.561035302Z [2024-04-15 01:37:00,560: INFO/ForkPoolWorker-15] [5b22f8fb-46be-404e-b190-f0e19f7fcf60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:37:00.564838100Z [2024-04-15 01:37:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ffaf150-07f0-4ab3-866c-71edd7e9018e] received 2024-04-15T01:37:00.566129746Z [2024-04-15 01:37:00,565: INFO/ForkPoolWorker-1] [66b0bd2c-d375-4f1a-a47d-62db1d33f4bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:37:00.597842291Z [2024-04-15 01:37:00,597: INFO/ForkPoolWorker-2] [9ffaf150-07f0-4ab3-866c-71edd7e9018e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:37:01.094665612Z [2024-04-15 01:37:01,091: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:37:01.170647216Z [2024-04-15 01:37:01,167: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:37:01.322375974Z [2024-04-15 01:37:01,306: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:37:01.480095147Z [2024-04-15 01:37:01,476: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:37:03.303228330Z [2024-04-15 01:37:03,302: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:37:03.309593262Z [2024-04-15 01:37:03,309: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:37:03.365806894Z [2024-04-15 01:37:03,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:37:03.366981137Z [2024-04-15 01:37:03,366: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:37:03.366995203Z [2024-04-15 01:37:03,366: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:37:03.367048161Z [2024-04-15 01:37:03,366: INFO/ForkPoolWorker-16] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:37:03.368357329Z [2024-04-15 01:37:03,367: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:37:03.368402057Z [2024-04-15 01:37:03,368: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:37:03.371927544Z [2024-04-15 01:37:03,368: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:37:03.372075871Z [2024-04-15 01:37:03,371: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:37:03.384488662Z [2024-04-15 01:37:03,384: INFO/ForkPoolWorker-16] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:37:03.490338811Z [2024-04-15 01:37:03,490: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:37:03.682549032Z [2024-04-15 01:37:03,682: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:37:03.685927540Z [2024-04-15 01:37:03,685: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:37:03.747610789Z [2024-04-15 01:37:03,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:37:03.753770252Z [2024-04-15 01:37:03,753: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:37:03.753814483Z [2024-04-15 01:37:03,753: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:37:03.753826046Z [2024-04-15 01:37:03,753: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:37:03.753995326Z [2024-04-15 01:37:03,753: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:37:03.754018468Z [2024-04-15 01:37:03,753: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:37:03.754470548Z [2024-04-15 01:37:03,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:37:03.754500069Z [2024-04-15 01:37:03,754: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:37:03.758936099Z [2024-04-15 01:37:03,758: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:37:03.937059595Z [2024-04-15 01:37:03,936: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:37:04.093620390Z [2024-04-15 01:37:04,093: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T01:37:04.097679018Z [2024-04-15 01:37:04,097: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:37:04.143077071Z [2024-04-15 01:37:04,142: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T01:37:04.150692286Z [2024-04-15 01:37:04,149: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:37:04.150842671Z [2024-04-15 01:37:04,150: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:37:04.153141769Z [2024-04-15 01:37:04,152: INFO/ForkPoolWorker-2] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:37:04.155266851Z [2024-04-15 01:37:04,155: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:37:04.158014429Z [2024-04-15 01:37:04,155: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T01:37:04.162302860Z [2024-04-15 01:37:04,162: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:37:04.170347749Z [2024-04-15 01:37:04,170: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:37:04.179185053Z [2024-04-15 01:37:04,178: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:37:04.275702614Z [2024-04-15 01:37:04,275: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:37:04.279758041Z [2024-04-15 01:37:04,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:37:04.296869777Z [2024-04-15 01:37:04,296: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:37:04.342753443Z [2024-04-15 01:37:04,342: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:37:04.345289082Z [2024-04-15 01:37:04,345: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:37:04.346017705Z [2024-04-15 01:37:04,345: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:37:04.346253397Z [2024-04-15 01:37:04,346: INFO/ForkPoolWorker-1] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:37:04.346863964Z [2024-04-15 01:37:04,346: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:37:04.347653251Z [2024-04-15 01:37:04,346: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:37:04.347964798Z [2024-04-15 01:37:04,347: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:37:04.348118292Z [2024-04-15 01:37:04,347: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:37:04.362528684Z [2024-04-15 01:37:04,362: INFO/ForkPoolWorker-1] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:37:04.474799901Z [2024-04-15 01:37:04,474: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:37:05.502442934Z [2024-04-15 01:37:05,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bfd6be39-51cf-4944-945c-48a80c83459a] succeeded in 4.947955941999908s: None 2024-04-15T01:37:06.211777994Z [2024-04-15 01:37:06,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66b0bd2c-d375-4f1a-a47d-62db1d33f4bb] succeeded in 5.654356991999975s: None 2024-04-15T01:37:06.470164660Z [2024-04-15 01:37:06,469: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9ffaf150-07f0-4ab3-866c-71edd7e9018e] succeeded in 5.896416060000092s: None 2024-04-15T01:37:07.159936432Z [2024-04-15 01:37:07,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b22f8fb-46be-404e-b190-f0e19f7fcf60] succeeded in 6.605650640000022s: None 2024-04-15T01:38:00.397639457Z [2024-04-15 01:38:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f87c57e5-f430-4fe5-bd46-21e24f98056a] received 2024-04-15T01:38:00.403538894Z [2024-04-15 01:38:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fba28d7-8cab-45ce-a81d-74f592333db0] received 2024-04-15T01:38:00.406751416Z [2024-04-15 01:38:00,406: INFO/ForkPoolWorker-15] [f87c57e5-f430-4fe5-bd46-21e24f98056a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:38:00.407166342Z [2024-04-15 01:38:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d734161-53b7-41e8-a8ab-84982a1f54aa] received 2024-04-15T01:38:00.415565205Z [2024-04-15 01:38:00,415: INFO/ForkPoolWorker-16] [9fba28d7-8cab-45ce-a81d-74f592333db0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:38:00.415611957Z [2024-04-15 01:38:00,415: INFO/ForkPoolWorker-1] [0d734161-53b7-41e8-a8ab-84982a1f54aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:38:00.417970065Z [2024-04-15 01:38:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0b14865-e672-4fdb-967e-c3f92694dbbb] received 2024-04-15T01:38:00.422252503Z [2024-04-15 01:38:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8f1e834-ae9a-4b35-ab05-4198bd0ec470] received 2024-04-15T01:38:00.430332636Z [2024-04-15 01:38:00,430: INFO/ForkPoolWorker-2] [d0b14865-e672-4fdb-967e-c3f92694dbbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:38:00.448832251Z [2024-04-15 01:38:00,448: INFO/ForkPoolWorker-3] [d8f1e834-ae9a-4b35-ab05-4198bd0ec470] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:38:00.944538361Z [2024-04-15 01:38:00,939: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:38:01.130880197Z [2024-04-15 01:38:01,126: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:38:01.212287920Z [2024-04-15 01:38:01,208: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:38:01.334757394Z [2024-04-15 01:38:01,331: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:38:01.383471267Z [2024-04-15 01:38:01,379: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:38:01.880403809Z [2024-04-15 01:38:01,876: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:38:03.187231557Z [2024-04-15 01:38:03,186: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d0b14865-e672-4fdb-967e-c3f92694dbbb] succeeded in 2.7633246069999586s: None 2024-04-15T01:38:03.600524649Z [2024-04-15 01:38:03,600: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-15T01:38:03.603941814Z [2024-04-15 01:38:03,603: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:38:03.676160472Z [2024-04-15 01:38:03,675: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-15T01:38:03.682739979Z [2024-04-15 01:38:03,680: INFO/ForkPoolWorker-3] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:38:03.682911441Z [2024-04-15 01:38:03,682: INFO/ForkPoolWorker-3] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:38:03.682921974Z [2024-04-15 01:38:03,682: INFO/ForkPoolWorker-3] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:38:03.683091815Z [2024-04-15 01:38:03,682: INFO/ForkPoolWorker-3] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:38:03.683098186Z [2024-04-15 01:38:03,683: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-15T01:38:03.683329997Z [2024-04-15 01:38:03,683: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:38:03.683343017Z [2024-04-15 01:38:03,683: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:38:03.693252911Z [2024-04-15 01:38:03,692: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:38:03.837319337Z [2024-04-15 01:38:03,836: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:38:04.247448831Z [2024-04-15 01:38:04,247: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:38:04.251523711Z [2024-04-15 01:38:04,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:38:04.307618729Z [2024-04-15 01:38:04,307: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:38:04.312415771Z [2024-04-15 01:38:04,312: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:38:04.312593804Z [2024-04-15 01:38:04,312: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:38:04.312743548Z [2024-04-15 01:38:04,312: INFO/ForkPoolWorker-15] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:38:04.312963585Z [2024-04-15 01:38:04,312: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:38:04.313257658Z [2024-04-15 01:38:04,313: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:38:04.313559492Z [2024-04-15 01:38:04,313: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:38:04.314025851Z [2024-04-15 01:38:04,313: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:38:04.318581608Z [2024-04-15 01:38:04,318: INFO/ForkPoolWorker-15] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:38:04.461781627Z [2024-04-15 01:38:04,461: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:38:04.473230675Z [2024-04-15 01:38:04,472: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:38:04.506713219Z [2024-04-15 01:38:04,506: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:38:04.526575481Z [2024-04-15 01:38:04,526: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:38:04.528019582Z [2024-04-15 01:38:04,527: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:38:04.532589404Z [2024-04-15 01:38:04,527: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:38:04.532806701Z [2024-04-15 01:38:04,532: INFO/ForkPoolWorker-1] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:38:04.533088112Z [2024-04-15 01:38:04,532: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:38:04.533135283Z [2024-04-15 01:38:04,532: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:38:04.533557524Z [2024-04-15 01:38:04,533: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:38:04.533665709Z [2024-04-15 01:38:04,533: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:38:04.542564979Z [2024-04-15 01:38:04,542: INFO/ForkPoolWorker-1] Creating DAG vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:38:04.568137681Z [2024-04-15 01:38:04,565: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:38:04.576492805Z [2024-04-15 01:38:04,571: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:38:04.667980800Z [2024-04-15 01:38:04,667: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:38:04.672200534Z [2024-04-15 01:38:04,671: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:38:04.672689003Z [2024-04-15 01:38:04,672: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:38:04.672957722Z [2024-04-15 01:38:04,672: INFO/ForkPoolWorker-16] Read VIM 3d2e531c-9514-4033-9563-372b09c4c9c4 (basic_08_vim_test) 2024-04-15T01:38:04.673269193Z [2024-04-15 01:38:04,672: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '3d2e531c-9514-4033-9563-372b09c4c9c4', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}] 2024-04-15T01:38:04.674350474Z [2024-04-15 01:38:04,674: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:38:04.674715667Z [2024-04-15 01:38:04,674: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:38:04.674843821Z [2024-04-15 01:38:04,674: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:38:04.683454957Z [2024-04-15 01:38:04,683: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4 2024-04-15T01:38:04.713371944Z [2024-04-15 01:38:04,713: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:38:04.875699094Z [2024-04-15 01:38:04,873: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:38:06.378179927Z [2024-04-15 01:38:06,377: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d8f1e834-ae9a-4b35-ab05-4198bd0ec470] succeeded in 5.938841350999837s: None 2024-04-15T01:38:06.443805566Z [2024-04-15 01:38:06,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f87c57e5-f430-4fe5-bd46-21e24f98056a] succeeded in 6.043752626000014s: None 2024-04-15T01:38:06.550898802Z [2024-04-15 01:38:06,550: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d734161-53b7-41e8-a8ab-84982a1f54aa] succeeded in 6.142000303999794s: None 2024-04-15T01:38:06.944290384Z [2024-04-15 01:38:06,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9fba28d7-8cab-45ce-a81d-74f592333db0] succeeded in 6.537107442999968s: None 2024-04-15T01:39:01.168399343Z [2024-04-15 01:39:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccac20bf-d7fa-44bc-b1a3-c3e94c0df5fb] received 2024-04-15T01:39:01.176041157Z [2024-04-15 01:39:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d34f37a-6bd4-43be-a399-c7c9e5882f99] received 2024-04-15T01:39:01.181528230Z [2024-04-15 01:39:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64dc4268-083d-4a1f-a245-988f25fdadd3] received 2024-04-15T01:39:01.194171730Z [2024-04-15 01:39:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bfa0f60-7ae8-44d6-8f41-ba69e96b2347] received 2024-04-15T01:39:01.204557643Z [2024-04-15 01:39:01,204: INFO/ForkPoolWorker-1] [64dc4268-083d-4a1f-a245-988f25fdadd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:01.222659074Z [2024-04-15 01:39:01,222: INFO/ForkPoolWorker-16] [5d34f37a-6bd4-43be-a399-c7c9e5882f99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:01.227188614Z [2024-04-15 01:39:01,226: INFO/ForkPoolWorker-2] [9bfa0f60-7ae8-44d6-8f41-ba69e96b2347] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:01.232924480Z [2024-04-15 01:39:01,232: INFO/ForkPoolWorker-15] [ccac20bf-d7fa-44bc-b1a3-c3e94c0df5fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:01.623184016Z [2024-04-15 01:39:01,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:01.791862472Z [2024-04-15 01:39:01,787: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:01.857318290Z [2024-04-15 01:39:01,793: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:02.617383787Z [2024-04-15 01:39:02,581: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:04.119939205Z [2024-04-15 01:39:04,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:39:04.123979779Z [2024-04-15 01:39:04,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.179365841Z [2024-04-15 01:39:04,179: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:39:04.181757400Z [2024-04-15 01:39:04,181: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.181770126Z [2024-04-15 01:39:04,181: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.182046020Z [2024-04-15 01:39:04,181: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.182083456Z [2024-04-15 01:39:04,181: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:39:04.182356333Z [2024-04-15 01:39:04,182: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:39:04.182410190Z [2024-04-15 01:39:04,182: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.196988434Z [2024-04-15 01:39:04,196: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T01:39:04.209677037Z [2024-04-15 01:39:04,209: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.282856871Z [2024-04-15 01:39:04,282: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:39:04.348208569Z [2024-04-15 01:39:04,347: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T01:39:04.354503116Z [2024-04-15 01:39:04,354: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.354522007Z [2024-04-15 01:39:04,354: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.354685733Z [2024-04-15 01:39:04,354: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.354735376Z [2024-04-15 01:39:04,354: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T01:39:04.356546961Z [2024-04-15 01:39:04,356: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:39:04.356645695Z [2024-04-15 01:39:04,356: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.389301763Z [2024-04-15 01:39:04,389: WARNING/ForkPoolWorker-2] Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:04.397307688Z [2024-04-15 01:39:04,390: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:04.399253374Z [2024-04-15 01:39:04,399: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T01:39:04.403675982Z [2024-04-15 01:39:04,403: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.442598676Z [2024-04-15 01:39:04,442: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:39:04.447465395Z [2024-04-15 01:39:04,447: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.490931954Z [2024-04-15 01:39:04,490: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T01:39:04.492370081Z [2024-04-15 01:39:04,492: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.492609077Z [2024-04-15 01:39:04,492: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.493885304Z [2024-04-15 01:39:04,492: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.493937961Z [2024-04-15 01:39:04,493: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T01:39:04.494221817Z [2024-04-15 01:39:04,494: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:39:04.494310690Z [2024-04-15 01:39:04,494: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.495391634Z [2024-04-15 01:39:04,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:39:04.500113700Z [2024-04-15 01:39:04,499: ERROR/ForkPoolWorker-2] [9bfa0f60-7ae8-44d6-8f41-ba69e96b2347] Failed to execute task Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:39:04.500125989Z Traceback (most recent call last): 2024-04-15T01:39:04.500130171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:39:04.500133964Z args.func(args) 2024-04-15T01:39:04.500137832Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:39:04.500141459Z return func(*args, **kwargs) 2024-04-15T01:39:04.500144472Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:39:04.500147503Z return f(*args, **kwargs) 2024-04-15T01:39:04.500150606Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:39:04.500153772Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:39:04.500156886Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:39:04.500160041Z raise AirflowException( 2024-04-15T01:39:04.500164209Z airflow.exceptions.AirflowException: Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:39:04.506992561Z [2024-04-15 01:39:04,506: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.507297927Z [2024-04-15 01:39:04,506: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.507872862Z [2024-04-15 01:39:04,507: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.508064330Z [2024-04-15 01:39:04,507: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:39:04.511445413Z [2024-04-15 01:39:04,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:39:04.511623286Z [2024-04-15 01:39:04,511: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.539682374Z [2024-04-15 01:39:04,539: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:04.540804361Z [2024-04-15 01:39:04,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:04.541800979Z [2024-04-15 01:39:04,541: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:39:04.545543882Z [2024-04-15 01:39:04,545: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.595969887Z [2024-04-15 01:39:04,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:39:04.600518727Z [2024-04-15 01:39:04,600: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.600721201Z [2024-04-15 01:39:04,600: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.601052364Z [2024-04-15 01:39:04,600: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.601361925Z [2024-04-15 01:39:04,601: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:39:04.601698613Z [2024-04-15 01:39:04,601: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:39:04.601961331Z [2024-04-15 01:39:04,601: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.607899641Z [2024-04-15 01:39:04,607: ERROR/ForkPoolWorker-16] [5d34f37a-6bd4-43be-a399-c7c9e5882f99] Failed to execute task Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:39:04.607911136Z Traceback (most recent call last): 2024-04-15T01:39:04.607915078Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:39:04.607918646Z args.func(args) 2024-04-15T01:39:04.607922249Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:39:04.607925975Z return func(*args, **kwargs) 2024-04-15T01:39:04.607928927Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:39:04.607931845Z return f(*args, **kwargs) 2024-04-15T01:39:04.607935222Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:39:04.607938126Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:39:04.607941044Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:39:04.607943969Z raise AirflowException( 2024-04-15T01:39:04.607947447Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:39:04.657735090Z [2024-04-15 01:39:04,656: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bfa0f60-7ae8-44d6-8f41-ba69e96b2347] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9bfa0f60-7ae8-44d6-8f41-ba69e96b2347') 2024-04-15T01:39:04.657752073Z Traceback (most recent call last): 2024-04-15T01:39:04.657756268Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:39:04.657759475Z R = retval = fun(*args, **kwargs) 2024-04-15T01:39:04.657762667Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:39:04.657765943Z return self.run(*args, **kwargs) 2024-04-15T01:39:04.657769465Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:39:04.657773003Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:39:04.657775996Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:39:04.657791911Z raise AirflowException(msg) 2024-04-15T01:39:04.657795586Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9bfa0f60-7ae8-44d6-8f41-ba69e96b2347 2024-04-15T01:39:04.683040680Z [2024-04-15 01:39:04,682: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d34f37a-6bd4-43be-a399-c7c9e5882f99] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5d34f37a-6bd4-43be-a399-c7c9e5882f99') 2024-04-15T01:39:04.683055637Z Traceback (most recent call last): 2024-04-15T01:39:04.683059876Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:39:04.683062987Z R = retval = fun(*args, **kwargs) 2024-04-15T01:39:04.683066008Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:39:04.683069020Z return self.run(*args, **kwargs) 2024-04-15T01:39:04.683072527Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:39:04.683076102Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:39:04.683079232Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:39:04.683082703Z raise AirflowException(msg) 2024-04-15T01:39:04.683087687Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5d34f37a-6bd4-43be-a399-c7c9e5882f99 2024-04-15T01:39:04.747377677Z [2024-04-15 01:39:04,747: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:39:04.750627799Z [2024-04-15 01:39:04,750: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:04.783171556Z [2024-04-15 01:39:04,782: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:39:04.784192774Z [2024-04-15 01:39:04,783: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:04.784309701Z [2024-04-15 01:39:04,784: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:04.784454377Z [2024-04-15 01:39:04,784: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:04.784530937Z [2024-04-15 01:39:04,784: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:39:04.784757190Z [2024-04-15 01:39:04,784: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:39:04.784852034Z [2024-04-15 01:39:04,784: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:04.947106286Z [2024-04-15 01:39:04,946: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:39:06.116006681Z [2024-04-15 01:39:06,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ccac20bf-d7fa-44bc-b1a3-c3e94c0df5fb] succeeded in 4.943366313999832s: None 2024-04-15T01:39:06.847199393Z [2024-04-15 01:39:06,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64dc4268-083d-4a1f-a245-988f25fdadd3] succeeded in 5.663377816000093s: None 2024-04-15T01:39:16.076621508Z [2024-04-15 01:39:16,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c24a3310-3912-4e5f-ac6d-ec6f0ba309a2] received 2024-04-15T01:39:16.079272692Z [2024-04-15 01:39:16,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f8fe117-b6f7-4505-b48b-a079898f3373] received 2024-04-15T01:39:16.086699356Z [2024-04-15 01:39:16,086: INFO/ForkPoolWorker-15] [c24a3310-3912-4e5f-ac6d-ec6f0ba309a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:39:16.088863422Z [2024-04-15 01:39:16,088: INFO/ForkPoolWorker-16] [9f8fe117-b6f7-4505-b48b-a079898f3373] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:39:16.403679898Z [2024-04-15 01:39:16,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:16.441571006Z [2024-04-15 01:39:16,436: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:17.619206596Z [2024-04-15 01:39:17,618: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:39:17.623517285Z [2024-04-15 01:39:17,623: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:17.646734165Z [2024-04-15 01:39:17,646: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:39:17.647917571Z [2024-04-15 01:39:17,647: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:17.647934680Z [2024-04-15 01:39:17,647: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:17.648126012Z [2024-04-15 01:39:17,647: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:17.648166086Z [2024-04-15 01:39:17,648: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:39:17.648359677Z [2024-04-15 01:39:17,648: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:39:17.648387948Z [2024-04-15 01:39:17,648: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:17.654842544Z [2024-04-15 01:39:17,654: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:17.655574753Z [2024-04-15 01:39:17,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:39:17.656852474Z [2024-04-15 01:39:17,656: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:39:17.659504631Z [2024-04-15 01:39:17,659: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:17.687575804Z [2024-04-15 01:39:17,687: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:39:17.689269203Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:17.689345223Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:17.689514564Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:17.689586325Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:39:17.689861061Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:39:17.689924221Z [2024-04-15 01:39:17,689: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:17.695712218Z [2024-04-15 01:39:17,694: ERROR/ForkPoolWorker-15] [c24a3310-3912-4e5f-ac6d-ec6f0ba309a2] Failed to execute task Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:39:17.695726551Z Traceback (most recent call last): 2024-04-15T01:39:17.695730812Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:39:17.695735407Z args.func(args) 2024-04-15T01:39:17.695739424Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:39:17.695743981Z return func(*args, **kwargs) 2024-04-15T01:39:17.695747012Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:39:17.695749995Z return f(*args, **kwargs) 2024-04-15T01:39:17.695753278Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:39:17.695756349Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:39:17.695759328Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:39:17.695762268Z raise AirflowException( 2024-04-15T01:39:17.695765735Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:39:17.729112029Z [2024-04-15 01:39:17,728: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c24a3310-3912-4e5f-ac6d-ec6f0ba309a2] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c24a3310-3912-4e5f-ac6d-ec6f0ba309a2') 2024-04-15T01:39:17.729126862Z Traceback (most recent call last): 2024-04-15T01:39:17.729131858Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:39:17.729135380Z R = retval = fun(*args, **kwargs) 2024-04-15T01:39:17.729138623Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:39:17.729141660Z return self.run(*args, **kwargs) 2024-04-15T01:39:17.729146414Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:39:17.729162630Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:39:17.729165883Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:39:17.729170739Z raise AirflowException(msg) 2024-04-15T01:39:17.729174326Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c24a3310-3912-4e5f-ac6d-ec6f0ba309a2 2024-04-15T01:39:17.808268148Z [2024-04-15 01:39:17,807: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:39:17.811775840Z [2024-04-15 01:39:17,811: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:17.849581357Z [2024-04-15 01:39:17,849: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:39:17.850794955Z [2024-04-15 01:39:17,850: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:17.851171383Z [2024-04-15 01:39:17,851: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:17.851369972Z [2024-04-15 01:39:17,851: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:17.851537329Z [2024-04-15 01:39:17,851: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:39:17.851857806Z [2024-04-15 01:39:17,851: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:39:17.852840074Z [2024-04-15 01:39:17,852: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:17.858562093Z [2024-04-15 01:39:17,858: WARNING/ForkPoolWorker-16] Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:17.859525908Z [2024-04-15 01:39:17,858: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:39:17.860352110Z [2024-04-15 01:39:17,860: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:39:17.862900936Z [2024-04-15 01:39:17,862: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:39:17.884653208Z [2024-04-15 01:39:17,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:39:17.885676310Z [2024-04-15 01:39:17,885: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:39:17.885930167Z [2024-04-15 01:39:17,885: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:39:17.886283771Z [2024-04-15 01:39:17,886: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:39:17.886508123Z [2024-04-15 01:39:17,886: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:39:17.886897914Z [2024-04-15 01:39:17,886: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:39:17.887027804Z [2024-04-15 01:39:17,886: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:39:17.890364717Z [2024-04-15 01:39:17,889: ERROR/ForkPoolWorker-16] [9f8fe117-b6f7-4505-b48b-a079898f3373] Failed to execute task Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse.. 2024-04-15T01:39:17.890373100Z Traceback (most recent call last): 2024-04-15T01:39:17.890377285Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T01:39:17.890381072Z args.func(args) 2024-04-15T01:39:17.890384765Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T01:39:17.890388338Z return func(*args, **kwargs) 2024-04-15T01:39:17.890391611Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T01:39:17.890394859Z return f(*args, **kwargs) 2024-04-15T01:39:17.890397884Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T01:39:17.890400896Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T01:39:17.890403934Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T01:39:17.890406783Z raise AirflowException( 2024-04-15T01:39:17.890412171Z airflow.exceptions.AirflowException: Dag 'vim_status_3d2e531c-9514-4033-9563-372b09c4c9c4' could not be found; either it does not exist or it failed to parse. 2024-04-15T01:39:17.929348666Z [2024-04-15 01:39:17,928: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f8fe117-b6f7-4505-b48b-a079898f3373] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9f8fe117-b6f7-4505-b48b-a079898f3373') 2024-04-15T01:39:17.929363030Z Traceback (most recent call last): 2024-04-15T01:39:17.929367124Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T01:39:17.929370193Z R = retval = fun(*args, **kwargs) 2024-04-15T01:39:17.929373305Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T01:39:17.929376341Z return self.run(*args, **kwargs) 2024-04-15T01:39:17.929379990Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T01:39:17.929384937Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T01:39:17.929388165Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T01:39:17.929391797Z raise AirflowException(msg) 2024-04-15T01:39:17.929395904Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9f8fe117-b6f7-4505-b48b-a079898f3373 2024-04-15T01:40:00.245697011Z [2024-04-15 01:40:00,245: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a5f82be-ccfc-4d3f-a94e-b234d88edc45] received 2024-04-15T01:40:00.251839916Z [2024-04-15 01:40:00,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30bf2e93-21a7-4b88-94c9-9fa330db804b] received 2024-04-15T01:40:00.252710923Z [2024-04-15 01:40:00,252: INFO/ForkPoolWorker-15] [7a5f82be-ccfc-4d3f-a94e-b234d88edc45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:40:00.258292298Z [2024-04-15 01:40:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1df39d59-a1ce-4f4d-b6d4-228229c2144d] received 2024-04-15T01:40:00.264356200Z [2024-04-15 01:40:00,264: INFO/ForkPoolWorker-1] [1df39d59-a1ce-4f4d-b6d4-228229c2144d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:00.275296450Z [2024-04-15 01:40:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23ba4ea7-d23e-4786-85d0-bf91dab13e83] received 2024-04-15T01:40:00.277602119Z [2024-04-15 01:40:00,277: INFO/ForkPoolWorker-16] [30bf2e93-21a7-4b88-94c9-9fa330db804b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:40:00.287980316Z [2024-04-15 01:40:00,287: INFO/ForkPoolWorker-2] [23ba4ea7-d23e-4786-85d0-bf91dab13e83] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:40:00.701204502Z [2024-04-15 01:40:00,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:40:00.821995167Z [2024-04-15 01:40:00,810: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:40:00.822017964Z [2024-04-15 01:40:00,785: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:40:00.854023230Z [2024-04-15 01:40:00,830: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:40:01.292912405Z [2024-04-15 01:40:01,292: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:02.414721702Z [2024-04-15 01:40:02,414: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23ba4ea7-d23e-4786-85d0-bf91dab13e83] succeeded in 2.1372601909999958s: None 2024-04-15T01:40:03.790163356Z [2024-04-15 01:40:03,789: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:40:03.797134845Z [2024-04-15 01:40:03,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:03.946335313Z [2024-04-15 01:40:03,946: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:40:03.951816243Z [2024-04-15 01:40:03,951: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:03.951919340Z [2024-04-15 01:40:03,951: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:03.952104365Z [2024-04-15 01:40:03,951: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:03.952188984Z [2024-04-15 01:40:03,952: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:40:03.952457982Z [2024-04-15 01:40:03,952: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:40:03.954828596Z [2024-04-15 01:40:03,954: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:04.172629212Z [2024-04-15 01:40:04,172: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:04.267223795Z [2024-04-15 01:40:04,266: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:40:04.270663615Z [2024-04-15 01:40:04,270: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:04.318100933Z [2024-04-15 01:40:04,317: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:40:04.323268341Z [2024-04-15 01:40:04,323: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:04.323486530Z [2024-04-15 01:40:04,323: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:04.323666048Z [2024-04-15 01:40:04,323: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:04.323738560Z [2024-04-15 01:40:04,323: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:40:04.324179000Z [2024-04-15 01:40:04,324: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:40:04.324751109Z [2024-04-15 01:40:04,324: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:04.459196723Z [2024-04-15 01:40:04,459: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:04.485386539Z [2024-04-15 01:40:04,485: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:40:04.489035168Z [2024-04-15 01:40:04,488: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:04.549817379Z [2024-04-15 01:40:04,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:40:04.553429487Z [2024-04-15 01:40:04,553: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:04.553452404Z [2024-04-15 01:40:04,553: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:04.554243696Z [2024-04-15 01:40:04,553: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:04.554449793Z [2024-04-15 01:40:04,554: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:40:04.554737559Z [2024-04-15 01:40:04,554: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:40:04.554824775Z [2024-04-15 01:40:04,554: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:04.632866010Z [2024-04-15 01:40:04,632: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:05.290264159Z [2024-04-15 01:40:05,288: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1df39d59-a1ce-4f4d-b6d4-228229c2144d] succeeded in 5.029484805000038s: None 2024-04-15T01:40:05.555722493Z [2024-04-15 01:40:05,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2064cd-7262-4904-a158-8b5df99b0ba0] received 2024-04-15T01:40:05.564047384Z [2024-04-15 01:40:05,563: INFO/ForkPoolWorker-1] [0a2064cd-7262-4904-a158-8b5df99b0ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:05.805724321Z [2024-04-15 01:40:05,803: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a5f82be-ccfc-4d3f-a94e-b234d88edc45] succeeded in 5.55663158099992s: None 2024-04-15T01:40:05.917354119Z [2024-04-15 01:40:05,914: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:40:06.755201014Z [2024-04-15 01:40:06,754: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[30bf2e93-21a7-4b88-94c9-9fa330db804b] succeeded in 6.489828164000073s: None 2024-04-15T01:40:07.254872161Z [2024-04-15 01:40:07,254: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:40:07.257760763Z [2024-04-15 01:40:07,257: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:07.295319338Z [2024-04-15 01:40:07,295: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:40:07.296484419Z [2024-04-15 01:40:07,296: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:07.296661191Z [2024-04-15 01:40:07,296: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:07.296899146Z [2024-04-15 01:40:07,296: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:07.297044278Z [2024-04-15 01:40:07,296: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:40:07.297463197Z [2024-04-15 01:40:07,297: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:40:07.297577299Z [2024-04-15 01:40:07,297: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:07.380291956Z [2024-04-15 01:40:07,379: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:07.979091827Z [2024-04-15 01:40:07,978: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a2064cd-7262-4904-a158-8b5df99b0ba0] succeeded in 2.4201078640001015s: None 2024-04-15T01:40:08.397003941Z [2024-04-15 01:40:08,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf0ceaa-55de-499d-b1cc-bf3641eb363b] received 2024-04-15T01:40:08.412105836Z [2024-04-15 01:40:08,411: INFO/ForkPoolWorker-15] [4cf0ceaa-55de-499d-b1cc-bf3641eb363b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:40:08.738529977Z [2024-04-15 01:40:08,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:40:10.102707386Z [2024-04-15 01:40:10,102: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:40:10.106526832Z [2024-04-15 01:40:10,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:10.137736224Z [2024-04-15 01:40:10,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:40:10.139731307Z [2024-04-15 01:40:10,139: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:10.139953591Z [2024-04-15 01:40:10,139: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:10.140224981Z [2024-04-15 01:40:10,140: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:10.140383763Z [2024-04-15 01:40:10,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:40:10.141382694Z [2024-04-15 01:40:10,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:40:10.141577647Z [2024-04-15 01:40:10,141: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:10.257746744Z [2024-04-15 01:40:10,257: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:12.450583952Z [2024-04-15 01:40:12,450: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4cf0ceaa-55de-499d-b1cc-bf3641eb363b] succeeded in 4.046405959999902s: None 2024-04-15T01:40:12.971556755Z [2024-04-15 01:40:12,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bea80ce-5044-44e6-aac4-c8060940b6a2] received 2024-04-15T01:40:12.979254871Z [2024-04-15 01:40:12,978: INFO/ForkPoolWorker-15] [5bea80ce-5044-44e6-aac4-c8060940b6a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:40:13.302101317Z [2024-04-15 01:40:13,298: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:40:14.577974525Z [2024-04-15 01:40:14,577: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:40:14.582415545Z [2024-04-15 01:40:14,582: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:40:14.629991427Z [2024-04-15 01:40:14,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:40:14.631050367Z [2024-04-15 01:40:14,630: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:40:14.631084694Z [2024-04-15 01:40:14,631: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:40:14.631238609Z [2024-04-15 01:40:14,631: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:40:14.631272139Z [2024-04-15 01:40:14,631: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:40:14.631836472Z [2024-04-15 01:40:14,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:40:14.632019781Z [2024-04-15 01:40:14,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:40:14.723220930Z [2024-04-15 01:40:14,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:40:15.336740073Z [2024-04-15 01:40:15,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bea80ce-5044-44e6-aac4-c8060940b6a2] succeeded in 2.3634187969998948s: None 2024-04-15T01:41:00.429712940Z [2024-04-15 01:41:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48150f43-d753-4d3b-827d-42944ad1de0b] received 2024-04-15T01:41:00.432388455Z [2024-04-15 01:41:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0876b618-fe3f-437a-88dc-0d69bf2fc87e] received 2024-04-15T01:41:00.442449349Z [2024-04-15 01:41:00,442: INFO/ForkPoolWorker-15] [48150f43-d753-4d3b-827d-42944ad1de0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:41:00.443564687Z [2024-04-15 01:41:00,443: INFO/ForkPoolWorker-16] [0876b618-fe3f-437a-88dc-0d69bf2fc87e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:41:00.794794292Z [2024-04-15 01:41:00,786: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:41:00.816514733Z [2024-04-15 01:41:00,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:41:02.402338732Z [2024-04-15 01:41:02,402: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:41:02.405641359Z [2024-04-15 01:41:02,405: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:41:02.456143368Z [2024-04-15 01:41:02,455: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:41:02.459082193Z [2024-04-15 01:41:02,458: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:41:02.459100764Z [2024-04-15 01:41:02,459: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:41:02.459297102Z [2024-04-15 01:41:02,459: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:41:02.459338769Z [2024-04-15 01:41:02,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:41:02.459580972Z [2024-04-15 01:41:02,459: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:41:02.459841613Z [2024-04-15 01:41:02,459: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:41:02.574691361Z [2024-04-15 01:41:02,574: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:41:02.616737907Z [2024-04-15 01:41:02,616: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:41:02.620555662Z [2024-04-15 01:41:02,620: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:41:02.644249938Z [2024-04-15 01:41:02,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:41:02.646434176Z [2024-04-15 01:41:02,646: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:41:02.646478179Z [2024-04-15 01:41:02,646: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:41:02.646741935Z [2024-04-15 01:41:02,646: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:41:02.646805674Z [2024-04-15 01:41:02,646: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:41:02.647198942Z [2024-04-15 01:41:02,647: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:41:02.647256339Z [2024-04-15 01:41:02,647: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:41:02.752334359Z [2024-04-15 01:41:02,752: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:41:05.044830637Z [2024-04-15 01:41:05,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[48150f43-d753-4d3b-827d-42944ad1de0b] succeeded in 4.612076275999925s: None 2024-04-15T01:41:05.427390021Z [2024-04-15 01:41:05,426: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0876b618-fe3f-437a-88dc-0d69bf2fc87e] succeeded in 4.990781246000097s: None 2024-04-15T01:42:00.315513486Z [2024-04-15 01:42:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44214cae-047a-48c1-a4e0-accd88c9bdad] received 2024-04-15T01:42:00.323863122Z [2024-04-15 01:42:00,323: INFO/ForkPoolWorker-15] [44214cae-047a-48c1-a4e0-accd88c9bdad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:42:00.378444102Z [2024-04-15 01:42:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb9d6ddb-2d3a-4166-8e49-1f2a6c292987] received 2024-04-15T01:42:00.389652360Z [2024-04-15 01:42:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[828d3a29-c525-4c7f-b61a-a8b7fc87a459] received 2024-04-15T01:42:00.396148946Z [2024-04-15 01:42:00,395: INFO/ForkPoolWorker-16] [cb9d6ddb-2d3a-4166-8e49-1f2a6c292987] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:42:00.414016480Z [2024-04-15 01:42:00,413: INFO/ForkPoolWorker-1] [828d3a29-c525-4c7f-b61a-a8b7fc87a459] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:42:00.899146197Z [2024-04-15 01:42:00,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:42:00.926212507Z [2024-04-15 01:42:00,920: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:42:01.210075823Z [2024-04-15 01:42:01,188: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:42:01.228706703Z [2024-04-15 01:42:01,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:42:02.390199022Z [2024-04-15 01:42:02,389: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cb9d6ddb-2d3a-4166-8e49-1f2a6c292987] succeeded in 2.005889195000009s: None 2024-04-15T01:42:03.362655521Z [2024-04-15 01:42:03,362: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:42:03.365883480Z [2024-04-15 01:42:03,365: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:42:03.426637954Z [2024-04-15 01:42:03,426: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:42:03.427919031Z [2024-04-15 01:42:03,427: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:42:03.428120127Z [2024-04-15 01:42:03,427: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:42:03.428430605Z [2024-04-15 01:42:03,428: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:42:03.428667478Z [2024-04-15 01:42:03,428: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:42:03.428976586Z [2024-04-15 01:42:03,428: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:42:03.429164643Z [2024-04-15 01:42:03,429: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:42:03.560540239Z [2024-04-15 01:42:03,560: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:42:03.667383339Z [2024-04-15 01:42:03,667: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:42:03.671923769Z [2024-04-15 01:42:03,671: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:42:03.710770153Z [2024-04-15 01:42:03,710: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:42:03.712483594Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:42:03.712495304Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:42:03.712633857Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:42:03.712645351Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:42:03.712840371Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:42:03.712875586Z [2024-04-15 01:42:03,712: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:42:03.801146511Z [2024-04-15 01:42:03,800: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:42:05.535985570Z [2024-04-15 01:42:05,535: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[828d3a29-c525-4c7f-b61a-a8b7fc87a459] succeeded in 5.1388483230000475s: None 2024-04-15T01:42:05.917199902Z [2024-04-15 01:42:05,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44214cae-047a-48c1-a4e0-accd88c9bdad] succeeded in 5.59940124600007s: None 2024-04-15T01:43:01.048024005Z [2024-04-15 01:43:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81972b6c-3cb7-417e-bd0b-765001b2886d] received 2024-04-15T01:43:01.055529887Z [2024-04-15 01:43:01,055: INFO/ForkPoolWorker-15] [81972b6c-3cb7-417e-bd0b-765001b2886d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:43:01.062410748Z [2024-04-15 01:43:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b52fb9e0-4344-4c49-b8e7-dbaa92c7a5da] received 2024-04-15T01:43:01.084910849Z [2024-04-15 01:43:01,082: INFO/ForkPoolWorker-16] [b52fb9e0-4344-4c49-b8e7-dbaa92c7a5da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:43:01.478999636Z [2024-04-15 01:43:01,474: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:43:01.646646077Z [2024-04-15 01:43:01,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:43:03.476146881Z [2024-04-15 01:43:03,475: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:43:03.484385779Z [2024-04-15 01:43:03,483: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:43:03.571149505Z [2024-04-15 01:43:03,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:43:03.575291929Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:43:03.575305406Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:43:03.575398413Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:43:03.575422251Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:43:03.575653396Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:43:03.575664411Z [2024-04-15 01:43:03,575: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:43:03.667163454Z [2024-04-15 01:43:03,666: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:43:03.670972032Z [2024-04-15 01:43:03,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:43:03.691487398Z [2024-04-15 01:43:03,691: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:43:03.721996263Z [2024-04-15 01:43:03,721: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:43:03.727226900Z [2024-04-15 01:43:03,727: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:43:03.727464906Z [2024-04-15 01:43:03,727: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:43:03.727705199Z [2024-04-15 01:43:03,727: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:43:03.727909604Z [2024-04-15 01:43:03,727: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:43:03.728298849Z [2024-04-15 01:43:03,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:43:03.728607925Z [2024-04-15 01:43:03,728: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:43:03.843548700Z [2024-04-15 01:43:03,840: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:43:05.538497475Z [2024-04-15 01:43:05,537: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b52fb9e0-4344-4c49-b8e7-dbaa92c7a5da] succeeded in 4.473778673999959s: None 2024-04-15T01:43:05.940089308Z [2024-04-15 01:43:05,939: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[81972b6c-3cb7-417e-bd0b-765001b2886d] succeeded in 4.8901878609999585s: None 2024-04-15T01:44:00.302952962Z [2024-04-15 01:44:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dfb8289e-7449-4088-b2a5-fe4e22e0745d] received 2024-04-15T01:44:00.306602210Z [2024-04-15 01:44:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ce24dbd-8dfb-46e5-b419-27f0c1f3d8c1] received 2024-04-15T01:44:00.320964973Z [2024-04-15 01:44:00,320: INFO/ForkPoolWorker-16] [7ce24dbd-8dfb-46e5-b419-27f0c1f3d8c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:44:00.321630480Z [2024-04-15 01:44:00,321: INFO/ForkPoolWorker-15] [dfb8289e-7449-4088-b2a5-fe4e22e0745d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:44:00.326541347Z [2024-04-15 01:44:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4adbcd-fc90-4ebb-8512-58cdba459b8f] received 2024-04-15T01:44:00.341627216Z [2024-04-15 01:44:00,341: INFO/ForkPoolWorker-1] [aa4adbcd-fc90-4ebb-8512-58cdba459b8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:44:00.665957656Z [2024-04-15 01:44:00,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:44:00.672725002Z [2024-04-15 01:44:00,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:44:00.674718556Z [2024-04-15 01:44:00,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:44:01.298939627Z [2024-04-15 01:44:01,298: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:44:02.028175369Z [2024-04-15 01:44:02,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dfb8289e-7449-4088-b2a5-fe4e22e0745d] succeeded in 1.7184632230000716s: None 2024-04-15T01:44:02.505528713Z [2024-04-15 01:44:02,505: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:44:02.510088876Z [2024-04-15 01:44:02,509: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:44:02.561157175Z [2024-04-15 01:44:02,560: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:44:02.565448653Z [2024-04-15 01:44:02,565: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:44:02.565715102Z [2024-04-15 01:44:02,565: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:44:02.566040684Z [2024-04-15 01:44:02,565: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:44:02.566273584Z [2024-04-15 01:44:02,566: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:44:02.566773851Z [2024-04-15 01:44:02,566: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:44:02.566969968Z [2024-04-15 01:44:02,566: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:44:02.673428003Z [2024-04-15 01:44:02,671: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:44:02.715027056Z [2024-04-15 01:44:02,714: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:44:02.719601120Z [2024-04-15 01:44:02,717: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:44:02.771680274Z [2024-04-15 01:44:02,771: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:44:02.776069093Z [2024-04-15 01:44:02,775: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:44:02.779320677Z [2024-04-15 01:44:02,775: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:44:02.779535467Z [2024-04-15 01:44:02,779: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:44:02.779597469Z [2024-04-15 01:44:02,779: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:44:02.779890146Z [2024-04-15 01:44:02,779: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:44:02.779948053Z [2024-04-15 01:44:02,779: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:44:02.922720600Z [2024-04-15 01:44:02,919: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:44:04.518827165Z [2024-04-15 01:44:04,518: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa4adbcd-fc90-4ebb-8512-58cdba459b8f] succeeded in 4.184296827000026s: None 2024-04-15T01:44:04.863180996Z [2024-04-15 01:44:04,862: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ce24dbd-8dfb-46e5-b419-27f0c1f3d8c1] succeeded in 4.551613952000025s: None 2024-04-15T01:45:00.720272672Z [2024-04-15 01:45:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b80b6764-3f4a-4457-885f-387e0cd81291] received 2024-04-15T01:45:00.725489607Z [2024-04-15 01:45:00,725: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[028161c2-e664-4ae4-88a8-7f4be2f9c084] received 2024-04-15T01:45:00.727509514Z [2024-04-15 01:45:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e7bdc80-978d-4595-a7ca-b57edfde6169] received 2024-04-15T01:45:00.746204266Z [2024-04-15 01:45:00,745: INFO/ForkPoolWorker-16] [028161c2-e664-4ae4-88a8-7f4be2f9c084] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:45:00.746673106Z [2024-04-15 01:45:00,746: INFO/ForkPoolWorker-15] [b80b6764-3f4a-4457-885f-387e0cd81291] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:00.750825137Z [2024-04-15 01:45:00,750: INFO/ForkPoolWorker-1] [1e7bdc80-978d-4595-a7ca-b57edfde6169] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:45:01.229300451Z [2024-04-15 01:45:01,218: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:45:01.343039184Z [2024-04-15 01:45:01,339: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:45:01.510976057Z [2024-04-15 01:45:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:45:03.326138043Z [2024-04-15 01:45:03,325: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:45:03.329915182Z [2024-04-15 01:45:03,329: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:03.385203556Z [2024-04-15 01:45:03,384: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:45:03.386539668Z [2024-04-15 01:45:03,386: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:03.389817479Z [2024-04-15 01:45:03,389: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:03.390087099Z [2024-04-15 01:45:03,389: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:03.390285753Z [2024-04-15 01:45:03,390: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:45:03.390766472Z [2024-04-15 01:45:03,390: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:45:03.390856593Z [2024-04-15 01:45:03,390: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:03.492705002Z [2024-04-15 01:45:03,492: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:03.683204099Z [2024-04-15 01:45:03,682: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:45:03.686616094Z [2024-04-15 01:45:03,686: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:03.725594823Z [2024-04-15 01:45:03,725: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:45:03.730519862Z [2024-04-15 01:45:03,730: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:03.734702204Z [2024-04-15 01:45:03,734: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:03.734902546Z [2024-04-15 01:45:03,734: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:03.735303417Z [2024-04-15 01:45:03,734: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:45:03.735316609Z [2024-04-15 01:45:03,735: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:45:03.735355767Z [2024-04-15 01:45:03,735: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:03.793277718Z [2024-04-15 01:45:03,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:45:03.802331460Z [2024-04-15 01:45:03,801: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:03.860753486Z [2024-04-15 01:45:03,859: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:03.922945166Z [2024-04-15 01:45:03,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:45:03.925261642Z [2024-04-15 01:45:03,925: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:03.925561630Z [2024-04-15 01:45:03,925: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:03.926045249Z [2024-04-15 01:45:03,925: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:03.926686368Z [2024-04-15 01:45:03,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:45:03.927030092Z [2024-04-15 01:45:03,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:45:03.927196906Z [2024-04-15 01:45:03,927: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:04.079905490Z [2024-04-15 01:45:04,079: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:04.778578309Z [2024-04-15 01:45:04,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b80b6764-3f4a-4457-885f-387e0cd81291] succeeded in 4.055414223000071s: None 2024-04-15T01:45:05.583552271Z [2024-04-15 01:45:05,583: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e7bdc80-978d-4595-a7ca-b57edfde6169] succeeded in 4.848658202999786s: None 2024-04-15T01:45:05.639072814Z [2024-04-15 01:45:05,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6654fb4-4444-4bf8-81dd-d1d1b6d92166] received 2024-04-15T01:45:05.649673968Z [2024-04-15 01:45:05,649: INFO/ForkPoolWorker-15] [b6654fb4-4444-4bf8-81dd-d1d1b6d92166] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:05.706489054Z [2024-04-15 01:45:05,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[028161c2-e664-4ae4-88a8-7f4be2f9c084] succeeded in 4.976410836000014s: None 2024-04-15T01:45:06.000204730Z [2024-04-15 01:45:05,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:45:07.261846654Z [2024-04-15 01:45:07,261: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:45:07.265589670Z [2024-04-15 01:45:07,265: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:07.287845189Z [2024-04-15 01:45:07,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:45:07.294799655Z [2024-04-15 01:45:07,294: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:07.296166718Z [2024-04-15 01:45:07,294: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:07.297014057Z [2024-04-15 01:45:07,296: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:07.297249082Z [2024-04-15 01:45:07,297: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:45:07.298391890Z [2024-04-15 01:45:07,298: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:45:07.298540855Z [2024-04-15 01:45:07,298: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:07.384103444Z [2024-04-15 01:45:07,383: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:08.006512247Z [2024-04-15 01:45:08,006: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6654fb4-4444-4bf8-81dd-d1d1b6d92166] succeeded in 2.3632051209999645s: None 2024-04-15T01:45:08.009764177Z [2024-04-15 01:45:08,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[620ebe73-dcb6-42a2-87bb-6b31395226f6] received 2024-04-15T01:45:08.017850256Z [2024-04-15 01:45:08,017: INFO/ForkPoolWorker-15] [620ebe73-dcb6-42a2-87bb-6b31395226f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:45:08.316617147Z [2024-04-15 01:45:08,312: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:45:09.796701013Z [2024-04-15 01:45:09,796: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:45:09.800331050Z [2024-04-15 01:45:09,799: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:09.822937492Z [2024-04-15 01:45:09,822: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:45:09.824142020Z [2024-04-15 01:45:09,823: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:09.824283666Z [2024-04-15 01:45:09,824: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:09.824491319Z [2024-04-15 01:45:09,824: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:09.824641332Z [2024-04-15 01:45:09,824: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:45:09.825065931Z [2024-04-15 01:45:09,824: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:45:09.825211492Z [2024-04-15 01:45:09,825: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:09.926969069Z [2024-04-15 01:45:09,926: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:10.498729731Z [2024-04-15 01:45:10,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[620ebe73-dcb6-42a2-87bb-6b31395226f6] succeeded in 2.4865038559998993s: None 2024-04-15T01:45:10.647210888Z [2024-04-15 01:45:10,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a825f64a-3f62-4995-b22f-7e3bc7440657] received 2024-04-15T01:45:10.656378768Z [2024-04-15 01:45:10,656: INFO/ForkPoolWorker-15] [a825f64a-3f62-4995-b22f-7e3bc7440657] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:45:10.999637887Z [2024-04-15 01:45:10,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:45:12.631665442Z [2024-04-15 01:45:12,631: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:45:12.637507828Z [2024-04-15 01:45:12,637: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:45:12.666154303Z [2024-04-15 01:45:12,665: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:45:12.670646973Z [2024-04-15 01:45:12,670: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:45:12.670810665Z [2024-04-15 01:45:12,670: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:45:12.671017399Z [2024-04-15 01:45:12,670: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:45:12.671148133Z [2024-04-15 01:45:12,671: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:45:12.671489336Z [2024-04-15 01:45:12,671: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:45:12.671636054Z [2024-04-15 01:45:12,671: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:45:12.776122082Z [2024-04-15 01:45:12,775: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:45:13.413477881Z [2024-04-15 01:45:13,413: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a825f64a-3f62-4995-b22f-7e3bc7440657] succeeded in 2.7644852210000863s: None 2024-04-15T01:46:01.067144747Z [2024-04-15 01:46:01,065: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ef8851-6deb-4499-bf3d-89a9ac5badf0] received 2024-04-15T01:46:01.094595847Z [2024-04-15 01:46:01,094: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b18bf64-9d3b-43ae-914b-4072b3c786ea] received 2024-04-15T01:46:01.094957333Z [2024-04-15 01:46:01,094: INFO/ForkPoolWorker-15] [c4ef8851-6deb-4499-bf3d-89a9ac5badf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:46:01.108713408Z [2024-04-15 01:46:01,108: INFO/ForkPoolWorker-16] [0b18bf64-9d3b-43ae-914b-4072b3c786ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:46:01.118035801Z [2024-04-15 01:46:01,117: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9773f718-413c-495c-9a86-b60cf8a245b8] received 2024-04-15T01:46:01.150089848Z [2024-04-15 01:46:01,149: INFO/ForkPoolWorker-1] [9773f718-413c-495c-9a86-b60cf8a245b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:46:01.645068053Z [2024-04-15 01:46:01,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:46:01.691361290Z [2024-04-15 01:46:01,680: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:46:01.773555086Z [2024-04-15 01:46:01,770: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:46:01.944861690Z [2024-04-15 01:46:01,944: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:46:02.872928660Z [2024-04-15 01:46:02,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4ef8851-6deb-4499-bf3d-89a9ac5badf0] succeeded in 1.7976326719999633s: None 2024-04-15T01:46:03.367184960Z [2024-04-15 01:46:03,366: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:46:03.374500904Z [2024-04-15 01:46:03,373: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:46:03.422007762Z [2024-04-15 01:46:03,421: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:46:03.423143694Z [2024-04-15 01:46:03,422: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:46:03.423225927Z [2024-04-15 01:46:03,423: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:46:03.423406964Z [2024-04-15 01:46:03,423: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:46:03.423459834Z [2024-04-15 01:46:03,423: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:46:03.423733950Z [2024-04-15 01:46:03,423: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:46:03.423787927Z [2024-04-15 01:46:03,423: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:46:03.545751725Z [2024-04-15 01:46:03,545: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:46:03.677456007Z [2024-04-15 01:46:03,677: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:46:03.681333610Z [2024-04-15 01:46:03,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:46:03.720065468Z [2024-04-15 01:46:03,719: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:46:03.722480747Z [2024-04-15 01:46:03,722: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:46:03.722692150Z [2024-04-15 01:46:03,722: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:46:03.722906447Z [2024-04-15 01:46:03,722: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:46:03.723012263Z [2024-04-15 01:46:03,722: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:46:03.723311222Z [2024-04-15 01:46:03,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:46:03.723442064Z [2024-04-15 01:46:03,723: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:46:03.830000710Z [2024-04-15 01:46:03,822: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:46:05.569095878Z [2024-04-15 01:46:05,568: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0b18bf64-9d3b-43ae-914b-4072b3c786ea] succeeded in 4.471616906999998s: None 2024-04-15T01:46:05.616682438Z [2024-04-15 01:46:05,616: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9773f718-413c-495c-9a86-b60cf8a245b8] succeeded in 4.494609124999897s: None 2024-04-15T01:47:00.260697031Z [2024-04-15 01:47:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f46018b-3574-4af4-b3de-662860476406] received 2024-04-15T01:47:00.265333736Z [2024-04-15 01:47:00,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2afc21b6-7746-4816-a20a-91c951a6a335] received 2024-04-15T01:47:00.275458042Z [2024-04-15 01:47:00,275: INFO/ForkPoolWorker-15] [3f46018b-3574-4af4-b3de-662860476406] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:47:00.279857724Z [2024-04-15 01:47:00,279: INFO/ForkPoolWorker-16] [2afc21b6-7746-4816-a20a-91c951a6a335] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:47:00.602431693Z [2024-04-15 01:47:00,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:47:00.668398975Z [2024-04-15 01:47:00,662: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:47:02.114875688Z [2024-04-15 01:47:02,114: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:47:02.119266194Z [2024-04-15 01:47:02,118: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:47:02.139490617Z [2024-04-15 01:47:02,139: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:47:02.143558585Z [2024-04-15 01:47:02,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:47:02.152822025Z [2024-04-15 01:47:02,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:47:02.154345375Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:47:02.154420799Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:47:02.154613937Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:47:02.154681384Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:47:02.154919190Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:47:02.155036179Z [2024-04-15 01:47:02,154: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:47:02.212102588Z [2024-04-15 01:47:02,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:47:02.227080105Z [2024-04-15 01:47:02,226: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:47:02.227152941Z [2024-04-15 01:47:02,226: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:47:02.227334939Z [2024-04-15 01:47:02,227: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:47:02.227404900Z [2024-04-15 01:47:02,227: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:47:02.227743622Z [2024-04-15 01:47:02,227: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:47:02.227786957Z [2024-04-15 01:47:02,227: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:47:02.253731734Z [2024-04-15 01:47:02,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:47:02.367887420Z [2024-04-15 01:47:02,367: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:47:04.010628107Z [2024-04-15 01:47:04,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2afc21b6-7746-4816-a20a-91c951a6a335] succeeded in 3.7429019890000745s: None 2024-04-15T01:47:04.432500466Z [2024-04-15 01:47:04,431: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f46018b-3574-4af4-b3de-662860476406] succeeded in 4.1687963480001144s: None 2024-04-15T01:48:00.541533927Z [2024-04-15 01:48:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0946656e-4372-4c96-8de0-a9b7faf0f481] received 2024-04-15T01:48:00.560899796Z [2024-04-15 01:48:00,560: INFO/ForkPoolWorker-15] [0946656e-4372-4c96-8de0-a9b7faf0f481] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:48:00.565070569Z [2024-04-15 01:48:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70276154-3b17-40b5-a2ea-c49a02d55c73] received 2024-04-15T01:48:00.581283679Z [2024-04-15 01:48:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7d1ed07-929b-4f15-a3c0-cd425ca311b3] received 2024-04-15T01:48:00.582374520Z [2024-04-15 01:48:00,582: INFO/ForkPoolWorker-16] [70276154-3b17-40b5-a2ea-c49a02d55c73] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:48:00.601597277Z [2024-04-15 01:48:00,601: INFO/ForkPoolWorker-1] [d7d1ed07-929b-4f15-a3c0-cd425ca311b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:48:01.077188389Z [2024-04-15 01:48:01,069: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:48:01.096352234Z [2024-04-15 01:48:01,092: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:48:01.244077232Z [2024-04-15 01:48:01,238: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:48:01.451131279Z [2024-04-15 01:48:01,450: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:48:02.694029555Z [2024-04-15 01:48:02,691: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d7d1ed07-929b-4f15-a3c0-cd425ca311b3] succeeded in 2.0999910339999133s: None 2024-04-15T01:48:03.371489108Z [2024-04-15 01:48:03,371: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:48:03.374992491Z [2024-04-15 01:48:03,374: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:48:03.421351442Z [2024-04-15 01:48:03,421: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:48:03.423831515Z [2024-04-15 01:48:03,423: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:48:03.423845992Z [2024-04-15 01:48:03,423: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:48:03.424011515Z [2024-04-15 01:48:03,423: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:48:03.424049265Z [2024-04-15 01:48:03,423: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:48:03.424334825Z [2024-04-15 01:48:03,424: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:48:03.424399120Z [2024-04-15 01:48:03,424: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:48:03.546359506Z [2024-04-15 01:48:03,546: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:48:03.760898284Z [2024-04-15 01:48:03,760: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:48:03.765006708Z [2024-04-15 01:48:03,764: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:48:03.794618445Z [2024-04-15 01:48:03,794: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:48:03.795762645Z [2024-04-15 01:48:03,795: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:48:03.795800369Z [2024-04-15 01:48:03,795: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:48:03.795934624Z [2024-04-15 01:48:03,795: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:48:03.796281083Z [2024-04-15 01:48:03,796: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:48:03.796564324Z [2024-04-15 01:48:03,796: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:48:03.796660958Z [2024-04-15 01:48:03,796: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:48:03.965552715Z [2024-04-15 01:48:03,965: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:48:05.236154073Z [2024-04-15 01:48:05,235: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0946656e-4372-4c96-8de0-a9b7faf0f481] succeeded in 4.691373284999827s: None 2024-04-15T01:48:05.833879834Z [2024-04-15 01:48:05,833: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70276154-3b17-40b5-a2ea-c49a02d55c73] succeeded in 5.2657664620001015s: None 2024-04-15T01:49:00.510494402Z [2024-04-15 01:49:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28bf798c-332c-4059-afe3-eaff7e0f34eb] received 2024-04-15T01:49:00.521886067Z [2024-04-15 01:49:00,521: INFO/ForkPoolWorker-15] [28bf798c-332c-4059-afe3-eaff7e0f34eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:49:00.527433263Z [2024-04-15 01:49:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c88f849-ed39-4a6c-93a9-5b62af788bf0] received 2024-04-15T01:49:00.541708977Z [2024-04-15 01:49:00,540: INFO/ForkPoolWorker-16] [7c88f849-ed39-4a6c-93a9-5b62af788bf0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:49:00.873296903Z [2024-04-15 01:49:00,869: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:49:00.899740572Z [2024-04-15 01:49:00,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:49:02.393457890Z [2024-04-15 01:49:02,393: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:49:02.397463331Z [2024-04-15 01:49:02,396: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:49:02.458713653Z [2024-04-15 01:49:02,458: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:49:02.467805955Z [2024-04-15 01:49:02,467: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:49:02.467945129Z [2024-04-15 01:49:02,467: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:49:02.469557533Z [2024-04-15 01:49:02,469: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:49:02.470663287Z [2024-04-15 01:49:02,470: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:49:02.470824711Z [2024-04-15 01:49:02,470: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:49:02.471124025Z [2024-04-15 01:49:02,471: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:49:02.471260540Z [2024-04-15 01:49:02,471: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:49:02.473347516Z [2024-04-15 01:49:02,472: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:49:02.536506152Z [2024-04-15 01:49:02,536: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:49:02.559071026Z [2024-04-15 01:49:02,558: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:49:02.559120477Z [2024-04-15 01:49:02,558: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:49:02.559349521Z [2024-04-15 01:49:02,559: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:49:02.559775203Z [2024-04-15 01:49:02,559: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:49:02.560173841Z [2024-04-15 01:49:02,560: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:49:02.560325297Z [2024-04-15 01:49:02,560: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:49:02.601519012Z [2024-04-15 01:49:02,601: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:49:02.714916023Z [2024-04-15 01:49:02,714: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:49:04.363125366Z [2024-04-15 01:49:04,362: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28bf798c-332c-4059-afe3-eaff7e0f34eb] succeeded in 3.850932040000089s: None 2024-04-15T01:49:04.800026800Z [2024-04-15 01:49:04,798: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c88f849-ed39-4a6c-93a9-5b62af788bf0] succeeded in 4.268225103999839s: None 2024-04-15T01:50:00.399607997Z [2024-04-15 01:50:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c88ab79-1838-4f23-a5af-6c30a1abdfa9] received 2024-04-15T01:50:00.401597582Z [2024-04-15 01:50:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8fd1f03-d722-4314-a4d1-84c01ce3eb3c] received 2024-04-15T01:50:00.408107547Z [2024-04-15 01:50:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34f6c729-351b-4a98-9869-421aee137337] received 2024-04-15T01:50:00.410653732Z [2024-04-15 01:50:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30196c83-1413-4dd7-a1e8-735790b0ed8a] received 2024-04-15T01:50:00.429319921Z [2024-04-15 01:50:00,428: INFO/ForkPoolWorker-16] [e8fd1f03-d722-4314-a4d1-84c01ce3eb3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:50:00.434626368Z [2024-04-15 01:50:00,434: INFO/ForkPoolWorker-2] [30196c83-1413-4dd7-a1e8-735790b0ed8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:50:00.442054316Z [2024-04-15 01:50:00,441: INFO/ForkPoolWorker-15] [9c88ab79-1838-4f23-a5af-6c30a1abdfa9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:00.446989409Z [2024-04-15 01:50:00,446: INFO/ForkPoolWorker-1] [34f6c729-351b-4a98-9869-421aee137337] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:50:00.822286304Z [2024-04-15 01:50:00,818: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:50:00.902921558Z [2024-04-15 01:50:00,895: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:50:01.389034695Z [2024-04-15 01:50:01,385: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:50:01.907652751Z [2024-04-15 01:50:01,907: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:01.981444983Z [2024-04-15 01:50:01,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:50:03.348549551Z [2024-04-15 01:50:03,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8fd1f03-d722-4314-a4d1-84c01ce3eb3c] succeeded in 2.9414492870000686s: None 2024-04-15T01:50:03.729396674Z [2024-04-15 01:50:03,729: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:50:03.734718942Z [2024-04-15 01:50:03,733: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:03.769220725Z [2024-04-15 01:50:03,768: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T01:50:03.773356845Z [2024-04-15 01:50:03,772: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:03.798922778Z [2024-04-15 01:50:03,798: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:50:03.801242916Z [2024-04-15 01:50:03,801: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:03.801313093Z [2024-04-15 01:50:03,801: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:03.801496435Z [2024-04-15 01:50:03,801: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:03.801583106Z [2024-04-15 01:50:03,801: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:50:03.801832697Z [2024-04-15 01:50:03,801: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:50:03.802226349Z [2024-04-15 01:50:03,802: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:03.878719185Z [2024-04-15 01:50:03,876: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T01:50:03.887748611Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:03.887772104Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:03.887776032Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:03.887779923Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T01:50:03.887782774Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:50:03.887785778Z [2024-04-15 01:50:03,886: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:03.976989712Z [2024-04-15 01:50:03,976: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:04.139968777Z [2024-04-15 01:50:04,139: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:04.167340891Z [2024-04-15 01:50:04,167: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:50:04.171317577Z [2024-04-15 01:50:04,170: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:04.198400164Z [2024-04-15 01:50:04,198: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:50:04.202419040Z [2024-04-15 01:50:04,202: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:04.202608190Z [2024-04-15 01:50:04,202: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:04.202871930Z [2024-04-15 01:50:04,202: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:04.203200137Z [2024-04-15 01:50:04,202: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:50:04.204351837Z [2024-04-15 01:50:04,204: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:50:04.204515362Z [2024-04-15 01:50:04,204: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:04.341679221Z [2024-04-15 01:50:04,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:05.159647713Z [2024-04-15 01:50:05,159: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c88ab79-1838-4f23-a5af-6c30a1abdfa9] succeeded in 4.741378028000099s: None 2024-04-15T01:50:05.291359877Z [2024-04-15 01:50:05,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb180167-079f-4e7b-8f7c-c896ae96e8bc] received 2024-04-15T01:50:05.306352469Z [2024-04-15 01:50:05,306: INFO/ForkPoolWorker-15] [cb180167-079f-4e7b-8f7c-c896ae96e8bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:05.650440628Z [2024-04-15 01:50:05,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:50:06.124517720Z [2024-04-15 01:50:06,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[34f6c729-351b-4a98-9869-421aee137337] succeeded in 5.708468461999928s: None 2024-04-15T01:50:06.297875791Z [2024-04-15 01:50:06,297: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[30196c83-1413-4dd7-a1e8-735790b0ed8a] succeeded in 5.87723393400006s: None 2024-04-15T01:50:06.899636302Z [2024-04-15 01:50:06,899: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:50:06.903155093Z [2024-04-15 01:50:06,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:06.930374672Z [2024-04-15 01:50:06,930: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:50:06.932950889Z [2024-04-15 01:50:06,932: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:06.933162090Z [2024-04-15 01:50:06,932: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:06.933344458Z [2024-04-15 01:50:06,933: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:06.933464729Z [2024-04-15 01:50:06,933: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:50:06.934663391Z [2024-04-15 01:50:06,934: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:50:06.934823241Z [2024-04-15 01:50:06,934: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:07.018340872Z [2024-04-15 01:50:07,018: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:07.639873603Z [2024-04-15 01:50:07,639: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb180167-079f-4e7b-8f7c-c896ae96e8bc] succeeded in 2.344596025999863s: None 2024-04-15T01:50:07.727332672Z [2024-04-15 01:50:07,726: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45020723-0028-463b-a646-eeb76a27dae1] received 2024-04-15T01:50:07.740399838Z [2024-04-15 01:50:07,740: INFO/ForkPoolWorker-15] [45020723-0028-463b-a646-eeb76a27dae1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:50:08.040813227Z [2024-04-15 01:50:08,037: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:50:09.362946766Z [2024-04-15 01:50:09,362: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:50:09.366102399Z [2024-04-15 01:50:09,365: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:09.425993580Z [2024-04-15 01:50:09,425: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:50:09.434478357Z [2024-04-15 01:50:09,434: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:09.435094543Z [2024-04-15 01:50:09,434: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:09.435322349Z [2024-04-15 01:50:09,435: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:09.435535979Z [2024-04-15 01:50:09,435: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:50:09.435826826Z [2024-04-15 01:50:09,435: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:50:09.436126574Z [2024-04-15 01:50:09,435: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:09.528528843Z [2024-04-15 01:50:09,528: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:10.145462716Z [2024-04-15 01:50:10,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[45020723-0028-463b-a646-eeb76a27dae1] succeeded in 2.4141634860000067s: None 2024-04-15T01:50:10.564567030Z [2024-04-15 01:50:10,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc53c5d6-0685-40f6-9792-e28630b36650] received 2024-04-15T01:50:10.590939956Z [2024-04-15 01:50:10,590: INFO/ForkPoolWorker-15] [fc53c5d6-0685-40f6-9792-e28630b36650] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:50:10.969540852Z [2024-04-15 01:50:10,965: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:50:12.438935536Z [2024-04-15 01:50:12,438: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:50:12.442558017Z [2024-04-15 01:50:12,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:50:12.504857022Z [2024-04-15 01:50:12,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:50:12.508580609Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:50:12.508597058Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:50:12.508743419Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:50:12.508780266Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:50:12.509009412Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:50:12.509048460Z [2024-04-15 01:50:12,508: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:50:12.604117987Z [2024-04-15 01:50:12,603: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:50:13.364486057Z [2024-04-15 01:50:13,364: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fc53c5d6-0685-40f6-9792-e28630b36650] succeeded in 2.79588261899994s: None 2024-04-15T01:51:00.212644983Z [2024-04-15 01:51:00,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96880bf0-6b18-4254-862b-96728ea2dc40] received 2024-04-15T01:51:00.216241971Z [2024-04-15 01:51:00,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d949332-1de7-4e95-beb4-dddfad957ddb] received 2024-04-15T01:51:00.227812444Z [2024-04-15 01:51:00,227: INFO/ForkPoolWorker-15] [96880bf0-6b18-4254-862b-96728ea2dc40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:51:00.231013757Z [2024-04-15 01:51:00,230: INFO/ForkPoolWorker-16] [5d949332-1de7-4e95-beb4-dddfad957ddb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:51:00.548281613Z [2024-04-15 01:51:00,542: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:51:00.621740520Z [2024-04-15 01:51:00,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:51:01.971575663Z [2024-04-15 01:51:01,971: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:51:01.980010646Z [2024-04-15 01:51:01,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:51:02.033315097Z [2024-04-15 01:51:02,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:51:02.034703068Z [2024-04-15 01:51:02,034: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:51:02.034724523Z [2024-04-15 01:51:02,034: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:51:02.034832803Z [2024-04-15 01:51:02,034: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:51:02.034856198Z [2024-04-15 01:51:02,034: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:51:02.035046713Z [2024-04-15 01:51:02,034: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:51:02.035080557Z [2024-04-15 01:51:02,035: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:51:02.142558126Z [2024-04-15 01:51:02,142: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:51:02.144838275Z [2024-04-15 01:51:02,144: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:51:02.145614772Z [2024-04-15 01:51:02,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:51:02.213280146Z [2024-04-15 01:51:02,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:51:02.218503724Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:51:02.218517504Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:51:02.218600416Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:51:02.218624364Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:51:02.218858965Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:51:02.218869870Z [2024-04-15 01:51:02,218: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:51:02.323553811Z [2024-04-15 01:51:02,323: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:51:03.780381396Z [2024-04-15 01:51:03,779: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d949332-1de7-4e95-beb4-dddfad957ddb] succeeded in 3.561199656000099s: None 2024-04-15T01:51:04.473951972Z [2024-04-15 01:51:04,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[96880bf0-6b18-4254-862b-96728ea2dc40] succeeded in 4.258611852000058s: None 2024-04-15T01:52:01.199768423Z [2024-04-15 01:52:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80b41034-f4ce-4153-97fb-8566144a865e] received 2024-04-15T01:52:01.209522196Z [2024-04-15 01:52:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79c94c74-f248-4216-a4b7-851e61242b24] received 2024-04-15T01:52:01.215070482Z [2024-04-15 01:52:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b1909e3-f903-44e8-960b-c372f1de3531] received 2024-04-15T01:52:01.226681243Z [2024-04-15 01:52:01,226: INFO/ForkPoolWorker-15] [80b41034-f4ce-4153-97fb-8566144a865e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:52:01.233392874Z [2024-04-15 01:52:01,233: INFO/ForkPoolWorker-16] [79c94c74-f248-4216-a4b7-851e61242b24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:52:01.234113051Z [2024-04-15 01:52:01,233: INFO/ForkPoolWorker-1] [2b1909e3-f903-44e8-960b-c372f1de3531] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:52:01.604632645Z [2024-04-15 01:52:01,600: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:52:01.610765586Z [2024-04-15 01:52:01,606: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:52:01.946835917Z [2024-04-15 01:52:01,943: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:52:02.034078181Z [2024-04-15 01:52:02,024: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:52:02.639281384Z [2024-04-15 01:52:02,638: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b1909e3-f903-44e8-960b-c372f1de3531] succeeded in 1.4216859749999458s: None 2024-04-15T01:52:03.449390703Z [2024-04-15 01:52:03,449: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:52:03.452816418Z [2024-04-15 01:52:03,452: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:52:03.489963159Z [2024-04-15 01:52:03,489: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:52:03.490894898Z [2024-04-15 01:52:03,490: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:52:03.490930518Z [2024-04-15 01:52:03,490: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:52:03.491104529Z [2024-04-15 01:52:03,490: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:52:03.491134511Z [2024-04-15 01:52:03,491: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:52:03.491450607Z [2024-04-15 01:52:03,491: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:52:03.491786893Z [2024-04-15 01:52:03,491: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:52:03.586399004Z [2024-04-15 01:52:03,586: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:52:03.801943439Z [2024-04-15 01:52:03,801: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:52:03.805339262Z [2024-04-15 01:52:03,804: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:52:03.895167898Z [2024-04-15 01:52:03,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:52:03.895203477Z [2024-04-15 01:52:03,893: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:52:03.895207215Z [2024-04-15 01:52:03,893: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:52:03.895211065Z [2024-04-15 01:52:03,893: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:52:03.895214871Z [2024-04-15 01:52:03,893: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:52:03.899113894Z [2024-04-15 01:52:03,898: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:52:03.899127813Z [2024-04-15 01:52:03,898: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:52:04.013538502Z [2024-04-15 01:52:04,013: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:52:05.232060490Z [2024-04-15 01:52:05,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79c94c74-f248-4216-a4b7-851e61242b24] succeeded in 4.015761031999773s: None 2024-04-15T01:52:05.985577684Z [2024-04-15 01:52:05,984: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80b41034-f4ce-4153-97fb-8566144a865e] succeeded in 4.769583925000006s: None 2024-04-15T01:53:00.947036275Z [2024-04-15 01:53:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b0393c2-04e5-49ae-8684-ce647618616c] received 2024-04-15T01:53:00.950552750Z [2024-04-15 01:53:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e65db3e2-9702-41a4-8153-c55eeaaef51e] received 2024-04-15T01:53:00.970018468Z [2024-04-15 01:53:00,968: INFO/ForkPoolWorker-16] [e65db3e2-9702-41a4-8153-c55eeaaef51e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:53:00.982236661Z [2024-04-15 01:53:00,981: INFO/ForkPoolWorker-15] [4b0393c2-04e5-49ae-8684-ce647618616c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:53:01.457960649Z [2024-04-15 01:53:01,453: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:53:01.468367172Z [2024-04-15 01:53:01,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:53:03.219039191Z [2024-04-15 01:53:03,218: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:53:03.222626816Z [2024-04-15 01:53:03,222: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:53:03.262163626Z [2024-04-15 01:53:03,261: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:53:03.263612247Z [2024-04-15 01:53:03,263: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:53:03.264179674Z [2024-04-15 01:53:03,264: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:53:03.264337703Z [2024-04-15 01:53:03,264: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:53:03.264386729Z [2024-04-15 01:53:03,264: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:53:03.264748053Z [2024-04-15 01:53:03,264: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:53:03.266066755Z [2024-04-15 01:53:03,264: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:53:03.400851741Z [2024-04-15 01:53:03,400: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:53:03.405052217Z [2024-04-15 01:53:03,404: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:53:03.415778684Z [2024-04-15 01:53:03,415: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:53:03.455625285Z [2024-04-15 01:53:03,455: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:53:03.458471592Z [2024-04-15 01:53:03,456: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:53:03.458536047Z [2024-04-15 01:53:03,458: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:53:03.458786082Z [2024-04-15 01:53:03,458: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:53:03.458832300Z [2024-04-15 01:53:03,458: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:53:03.459034724Z [2024-04-15 01:53:03,458: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:53:03.459073126Z [2024-04-15 01:53:03,459: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:53:03.590907415Z [2024-04-15 01:53:03,590: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:53:05.407917516Z [2024-04-15 01:53:05,407: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4b0393c2-04e5-49ae-8684-ce647618616c] succeeded in 4.454669929999909s: None 2024-04-15T01:53:05.590965379Z [2024-04-15 01:53:05,590: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e65db3e2-9702-41a4-8153-c55eeaaef51e] succeeded in 4.638110518000303s: None 2024-04-15T01:54:00.271885125Z [2024-04-15 01:54:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66e96acf-1665-4c20-8cc3-ca823459d542] received 2024-04-15T01:54:00.278421984Z [2024-04-15 01:54:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd1c8314-4315-4bad-90e4-d4f89a1edad9] received 2024-04-15T01:54:00.283316797Z [2024-04-15 01:54:00,283: INFO/ForkPoolWorker-15] [66e96acf-1665-4c20-8cc3-ca823459d542] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:54:00.292628712Z [2024-04-15 01:54:00,292: INFO/ForkPoolWorker-16] [cd1c8314-4315-4bad-90e4-d4f89a1edad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:54:00.315219013Z [2024-04-15 01:54:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48a8f84a-085d-4c8b-8d38-3d8da24d7728] received 2024-04-15T01:54:00.350368882Z [2024-04-15 01:54:00,350: INFO/ForkPoolWorker-1] [48a8f84a-085d-4c8b-8d38-3d8da24d7728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:54:00.666487305Z [2024-04-15 01:54:00,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:54:00.671932549Z [2024-04-15 01:54:00,668: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:54:00.727229706Z [2024-04-15 01:54:00,723: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:54:01.004412657Z [2024-04-15 01:54:01,004: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:54:02.161451031Z [2024-04-15 01:54:02,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66e96acf-1665-4c20-8cc3-ca823459d542] succeeded in 1.8858540560004258s: None 2024-04-15T01:54:02.427268964Z [2024-04-15 01:54:02,426: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:54:02.430792094Z [2024-04-15 01:54:02,430: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:54:02.468560205Z [2024-04-15 01:54:02,468: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:54:02.474577366Z [2024-04-15 01:54:02,472: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:54:02.489539601Z [2024-04-15 01:54:02,489: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:54:02.492654985Z [2024-04-15 01:54:02,492: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:54:02.492974916Z [2024-04-15 01:54:02,492: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:54:02.493166763Z [2024-04-15 01:54:02,493: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:54:02.493251952Z [2024-04-15 01:54:02,493: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:54:02.493503460Z [2024-04-15 01:54:02,493: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:54:02.494439940Z [2024-04-15 01:54:02,493: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:54:02.567500174Z [2024-04-15 01:54:02,567: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:54:02.569522347Z [2024-04-15 01:54:02,569: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:54:02.571012129Z [2024-04-15 01:54:02,569: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:54:02.572642062Z [2024-04-15 01:54:02,570: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:54:02.575500786Z [2024-04-15 01:54:02,572: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:54:02.575920070Z [2024-04-15 01:54:02,575: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:54:02.576055837Z [2024-04-15 01:54:02,575: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:54:02.623152489Z [2024-04-15 01:54:02,622: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:54:02.705051436Z [2024-04-15 01:54:02,704: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:54:04.310958793Z [2024-04-15 01:54:04,310: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cd1c8314-4315-4bad-90e4-d4f89a1edad9] succeeded in 4.029656553999757s: None 2024-04-15T01:54:04.963708675Z [2024-04-15 01:54:04,963: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[48a8f84a-085d-4c8b-8d38-3d8da24d7728] succeeded in 4.636760056000185s: None 2024-04-15T01:55:00.444845170Z [2024-04-15 01:55:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a086cef-d2de-4b23-bdd3-6cbc181044aa] received 2024-04-15T01:55:00.477167994Z [2024-04-15 01:55:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ef2ec27-c19b-4add-a848-0b3b61f28892] received 2024-04-15T01:55:00.481738811Z [2024-04-15 01:55:00,479: INFO/ForkPoolWorker-15] [8a086cef-d2de-4b23-bdd3-6cbc181044aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:00.485657188Z [2024-04-15 01:55:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e8b905d-a164-45ec-a705-e11c2e997f1f] received 2024-04-15T01:55:00.561282143Z [2024-04-15 01:55:00,558: INFO/ForkPoolWorker-1] [4e8b905d-a164-45ec-a705-e11c2e997f1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:55:00.565753418Z [2024-04-15 01:55:00,565: INFO/ForkPoolWorker-16] [4ef2ec27-c19b-4add-a848-0b3b61f28892] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:55:00.890292597Z [2024-04-15 01:55:00,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:55:00.993559777Z [2024-04-15 01:55:00,990: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:55:01.273172257Z [2024-04-15 01:55:01,263: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:55:03.237875246Z [2024-04-15 01:55:03,235: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:55:03.241791475Z [2024-04-15 01:55:03,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:03.424155112Z [2024-04-15 01:55:03,423: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:55:03.446748638Z [2024-04-15 01:55:03,446: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:03.446761122Z [2024-04-15 01:55:03,446: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:03.446896866Z [2024-04-15 01:55:03,446: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:03.446903486Z [2024-04-15 01:55:03,446: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:55:03.448038844Z [2024-04-15 01:55:03,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:55:03.448059380Z [2024-04-15 01:55:03,447: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:03.629890225Z [2024-04-15 01:55:03,626: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:04.126197616Z [2024-04-15 01:55:04,125: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:55:04.135817669Z [2024-04-15 01:55:04,133: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:04.265987624Z [2024-04-15 01:55:04,264: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:55:04.272599358Z [2024-04-15 01:55:04,268: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:04.324234768Z [2024-04-15 01:55:04,323: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:55:04.337165360Z [2024-04-15 01:55:04,333: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:04.337177071Z [2024-04-15 01:55:04,334: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:04.337182506Z [2024-04-15 01:55:04,335: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:04.337191926Z [2024-04-15 01:55:04,336: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:55:04.344736841Z [2024-04-15 01:55:04,344: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:55:04.344946703Z [2024-04-15 01:55:04,344: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:04.452152018Z [2024-04-15 01:55:04,450: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:55:04.462073209Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:04.462082433Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:04.462087723Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:04.462091249Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:55:04.462094302Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:55:04.462314415Z [2024-04-15 01:55:04,460: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:04.609323838Z [2024-04-15 01:55:04,609: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:04.749581766Z [2024-04-15 01:55:04,749: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:05.064506844Z [2024-04-15 01:55:05,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a086cef-d2de-4b23-bdd3-6cbc181044aa] succeeded in 4.596154129999832s: None 2024-04-15T01:55:05.511299491Z [2024-04-15 01:55:05,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87cc10b5-2b24-4d3b-a8bc-bde2eee2689d] received 2024-04-15T01:55:05.528071144Z [2024-04-15 01:55:05,527: INFO/ForkPoolWorker-15] [87cc10b5-2b24-4d3b-a8bc-bde2eee2689d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:05.908943666Z [2024-04-15 01:55:05,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:55:06.404205572Z [2024-04-15 01:55:06,402: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ef2ec27-c19b-4add-a848-0b3b61f28892] succeeded in 5.921628813000098s: None 2024-04-15T01:55:06.766434823Z [2024-04-15 01:55:06,766: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e8b905d-a164-45ec-a705-e11c2e997f1f] succeeded in 6.2575767989997075s: None 2024-04-15T01:55:07.311913738Z [2024-04-15 01:55:07,309: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:55:07.316302950Z [2024-04-15 01:55:07,314: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:07.348662190Z [2024-04-15 01:55:07,348: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:55:07.354339718Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:07.354371837Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:07.354375574Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:07.354379350Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:55:07.354382296Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:55:07.354385217Z [2024-04-15 01:55:07,349: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:07.457035187Z [2024-04-15 01:55:07,456: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:08.218377452Z [2024-04-15 01:55:08,216: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87cc10b5-2b24-4d3b-a8bc-bde2eee2689d] succeeded in 2.705258859999958s: None 2024-04-15T01:55:08.253265790Z [2024-04-15 01:55:08,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f854ae00-0b93-4afc-84bf-705968dcfd54] received 2024-04-15T01:55:08.261700291Z [2024-04-15 01:55:08,261: INFO/ForkPoolWorker-15] [f854ae00-0b93-4afc-84bf-705968dcfd54] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T01:55:08.558380176Z [2024-04-15 01:55:08,555: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:55:10.168069669Z [2024-04-15 01:55:10,167: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:55:10.177017466Z [2024-04-15 01:55:10,176: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:10.231036987Z [2024-04-15 01:55:10,229: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:55:10.232788283Z [2024-04-15 01:55:10,232: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:10.232924520Z [2024-04-15 01:55:10,232: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:10.233466690Z [2024-04-15 01:55:10,232: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:10.233476544Z [2024-04-15 01:55:10,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:55:10.235369702Z [2024-04-15 01:55:10,233: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:55:10.235650597Z [2024-04-15 01:55:10,235: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:10.414332947Z [2024-04-15 01:55:10,406: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:11.091462568Z [2024-04-15 01:55:11,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f854ae00-0b93-4afc-84bf-705968dcfd54] succeeded in 2.8390163219996793s: None 2024-04-15T01:55:11.684916888Z [2024-04-15 01:55:11,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41a8dfa9-fd88-4bff-b8c8-091c5c7289d4] received 2024-04-15T01:55:11.702430551Z [2024-04-15 01:55:11,701: INFO/ForkPoolWorker-15] [41a8dfa9-fd88-4bff-b8c8-091c5c7289d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T01:55:12.041190731Z [2024-04-15 01:55:12,037: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T01:55:13.579812816Z [2024-04-15 01:55:13,579: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:55:13.582884444Z [2024-04-15 01:55:13,582: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:55:13.615088456Z [2024-04-15 01:55:13,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:55:13.617126811Z [2024-04-15 01:55:13,616: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:55:13.617157690Z [2024-04-15 01:55:13,617: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:55:13.617462162Z [2024-04-15 01:55:13,617: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:55:13.617550671Z [2024-04-15 01:55:13,617: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:55:13.617832575Z [2024-04-15 01:55:13,617: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T01:55:13.617996081Z [2024-04-15 01:55:13,617: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:55:13.697103854Z [2024-04-15 01:55:13,696: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:55:14.399040015Z [2024-04-15 01:55:14,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41a8dfa9-fd88-4bff-b8c8-091c5c7289d4] succeeded in 2.7099067159997503s: None 2024-04-15T01:56:00.347148855Z [2024-04-15 01:56:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d67bdf-daff-443e-8e9f-fdf089c7f329] received 2024-04-15T01:56:00.353798341Z [2024-04-15 01:56:00,352: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7e13668-f38e-45f2-b58f-b44101dda571] received 2024-04-15T01:56:00.358198810Z [2024-04-15 01:56:00,357: INFO/ForkPoolWorker-15] [39d67bdf-daff-443e-8e9f-fdf089c7f329] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:56:00.364982447Z [2024-04-15 01:56:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef063217-b4d5-433c-bbb4-dc2b6578633e] received 2024-04-15T01:56:00.371414989Z [2024-04-15 01:56:00,371: INFO/ForkPoolWorker-16] [d7e13668-f38e-45f2-b58f-b44101dda571] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:56:00.381381655Z [2024-04-15 01:56:00,381: INFO/ForkPoolWorker-1] [ef063217-b4d5-433c-bbb4-dc2b6578633e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:56:00.745022925Z [2024-04-15 01:56:00,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:56:00.788022065Z [2024-04-15 01:56:00,777: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:56:01.027074268Z [2024-04-15 01:56:01,020: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:56:01.440825630Z [2024-04-15 01:56:01,440: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:56:02.736628351Z [2024-04-15 01:56:02,736: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ef063217-b4d5-433c-bbb4-dc2b6578633e] succeeded in 2.3675331849999566s: None 2024-04-15T01:56:02.944845875Z [2024-04-15 01:56:02,944: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:56:02.950046208Z [2024-04-15 01:56:02,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:56:03.062008964Z [2024-04-15 01:56:03,061: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:56:03.063391304Z [2024-04-15 01:56:03,062: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:56:03.063567754Z [2024-04-15 01:56:03,063: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:56:03.063743987Z [2024-04-15 01:56:03,063: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:56:03.063808338Z [2024-04-15 01:56:03,063: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:56:03.064096853Z [2024-04-15 01:56:03,063: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:56:03.064232603Z [2024-04-15 01:56:03,064: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:56:03.159040733Z [2024-04-15 01:56:03,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:56:03.392892403Z [2024-04-15 01:56:03,392: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:56:03.402986144Z [2024-04-15 01:56:03,402: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:56:03.440835725Z [2024-04-15 01:56:03,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:56:03.442010254Z [2024-04-15 01:56:03,441: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:56:03.442127527Z [2024-04-15 01:56:03,441: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:56:03.442386340Z [2024-04-15 01:56:03,442: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:56:03.442399937Z [2024-04-15 01:56:03,442: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:56:03.442562438Z [2024-04-15 01:56:03,442: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:56:03.442671274Z [2024-04-15 01:56:03,442: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:56:03.528791535Z [2024-04-15 01:56:03,528: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:56:04.666257262Z [2024-04-15 01:56:04,665: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39d67bdf-daff-443e-8e9f-fdf089c7f329] succeeded in 4.316281324999636s: None 2024-04-15T01:56:05.813748522Z [2024-04-15 01:56:05,813: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d7e13668-f38e-45f2-b58f-b44101dda571] succeeded in 5.457009222000124s: None 2024-04-15T01:57:00.952611808Z [2024-04-15 01:57:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[304633ef-7e35-43c1-9e69-e4e21c1ba5e1] received 2024-04-15T01:57:00.970280436Z [2024-04-15 01:57:00,968: INFO/ForkPoolWorker-15] [304633ef-7e35-43c1-9e69-e4e21c1ba5e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:57:00.976573201Z [2024-04-15 01:57:00,975: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d0172e5-3e6e-474b-90f4-f1a96b4b0cf6] received 2024-04-15T01:57:00.991711356Z [2024-04-15 01:57:00,990: INFO/ForkPoolWorker-16] [7d0172e5-3e6e-474b-90f4-f1a96b4b0cf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:57:01.333516936Z [2024-04-15 01:57:01,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:57:01.459718257Z [2024-04-15 01:57:01,451: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:57:02.841645827Z [2024-04-15 01:57:02,841: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:57:02.845112089Z [2024-04-15 01:57:02,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:57:02.949800408Z [2024-04-15 01:57:02,949: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:57:02.951561711Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:57:02.951598456Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:57:02.951715209Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:57:02.951754577Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:57:02.951956861Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:57:02.951989379Z [2024-04-15 01:57:02,951: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:57:03.027066507Z [2024-04-15 01:57:03,026: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:57:03.031154647Z [2024-04-15 01:57:03,030: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:57:03.040869169Z [2024-04-15 01:57:03,040: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:57:03.061362439Z [2024-04-15 01:57:03,060: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:57:03.065115351Z [2024-04-15 01:57:03,064: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:57:03.065223957Z [2024-04-15 01:57:03,065: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:57:03.065348835Z [2024-04-15 01:57:03,065: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:57:03.065409320Z [2024-04-15 01:57:03,065: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:57:03.065764113Z [2024-04-15 01:57:03,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:57:03.066638795Z [2024-04-15 01:57:03,066: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:57:03.157923325Z [2024-04-15 01:57:03,157: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:57:04.625537042Z [2024-04-15 01:57:04,625: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[304633ef-7e35-43c1-9e69-e4e21c1ba5e1] succeeded in 3.666696735000187s: None 2024-04-15T01:57:05.099674522Z [2024-04-15 01:57:05,099: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7d0172e5-3e6e-474b-90f4-f1a96b4b0cf6] succeeded in 4.121475922999707s: None 2024-04-15T01:58:01.022211707Z [2024-04-15 01:58:01,021: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f836ae0-6c5e-4884-89cf-351951d9722a] received 2024-04-15T01:58:01.030846887Z [2024-04-15 01:58:01,030: INFO/ForkPoolWorker-15] [4f836ae0-6c5e-4884-89cf-351951d9722a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T01:58:01.040192933Z [2024-04-15 01:58:01,039: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dd9df00-0968-4125-8741-24d3d6c797ad] received 2024-04-15T01:58:01.049507560Z [2024-04-15 01:58:01,048: INFO/ForkPoolWorker-16] [5dd9df00-0968-4125-8741-24d3d6c797ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:58:01.055941197Z [2024-04-15 01:58:01,055: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37001400-0dfe-4bf2-8bf4-5c14f8a89fbd] received 2024-04-15T01:58:01.105094893Z [2024-04-15 01:58:01,097: INFO/ForkPoolWorker-1] [37001400-0dfe-4bf2-8bf4-5c14f8a89fbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:58:01.515498990Z [2024-04-15 01:58:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T01:58:01.572987072Z [2024-04-15 01:58:01,568: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:58:01.725457908Z [2024-04-15 01:58:01,722: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:58:01.938674779Z [2024-04-15 01:58:01,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:58:03.038073133Z [2024-04-15 01:58:03,037: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4f836ae0-6c5e-4884-89cf-351951d9722a] succeeded in 2.013045583999883s: None 2024-04-15T01:58:03.845793803Z [2024-04-15 01:58:03,839: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T01:58:03.870031162Z [2024-04-15 01:58:03,856: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:58:03.978344980Z [2024-04-15 01:58:03,978: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T01:58:03.980613074Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:58:03.980661944Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:58:03.980760600Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:58:03.980796455Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T01:58:03.980982776Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:58:03.981021677Z [2024-04-15 01:58:03,980: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:58:04.086156665Z [2024-04-15 01:58:04,085: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:58:04.209332808Z [2024-04-15 01:58:04,209: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:58:04.222909875Z [2024-04-15 01:58:04,217: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:58:04.269160800Z [2024-04-15 01:58:04,268: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:58:04.270557200Z [2024-04-15 01:58:04,270: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:58:04.270626685Z [2024-04-15 01:58:04,270: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:58:04.271508560Z [2024-04-15 01:58:04,270: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:58:04.272200786Z [2024-04-15 01:58:04,272: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:58:04.272707738Z [2024-04-15 01:58:04,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:58:04.272812437Z [2024-04-15 01:58:04,272: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:58:04.364425200Z [2024-04-15 01:58:04,363: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:58:06.116169321Z [2024-04-15 01:58:06,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dd9df00-0968-4125-8741-24d3d6c797ad] succeeded in 5.07350209499964s: None 2024-04-15T01:58:06.147821493Z [2024-04-15 01:58:06,147: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[37001400-0dfe-4bf2-8bf4-5c14f8a89fbd] succeeded in 5.0858105199999954s: None 2024-04-15T01:59:00.576064688Z [2024-04-15 01:59:00,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[837d0e39-4097-45d1-8977-f7d3c8b15be9] received 2024-04-15T01:59:00.593112033Z [2024-04-15 01:59:00,592: INFO/ForkPoolWorker-15] [837d0e39-4097-45d1-8977-f7d3c8b15be9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T01:59:00.597362630Z [2024-04-15 01:59:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecc55e8c-918b-4bca-8d3e-759f47e20a05] received 2024-04-15T01:59:00.636816463Z [2024-04-15 01:59:00,636: INFO/ForkPoolWorker-16] [ecc55e8c-918b-4bca-8d3e-759f47e20a05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T01:59:00.972072855Z [2024-04-15 01:59:00,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T01:59:01.089934496Z [2024-04-15 01:59:01,086: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T01:59:02.740333414Z [2024-04-15 01:59:02,739: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T01:59:02.743283684Z [2024-04-15 01:59:02,742: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:59:02.810547437Z [2024-04-15 01:59:02,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T01:59:02.820737709Z [2024-04-15 01:59:02,820: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:59:02.820751588Z [2024-04-15 01:59:02,820: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:59:02.822077066Z [2024-04-15 01:59:02,821: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:59:02.822093794Z [2024-04-15 01:59:02,821: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T01:59:02.822365613Z [2024-04-15 01:59:02,822: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T01:59:02.829230328Z [2024-04-15 01:59:02,822: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:59:02.835705111Z [2024-04-15 01:59:02,834: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T01:59:02.845918989Z [2024-04-15 01:59:02,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T01:59:02.925204092Z [2024-04-15 01:59:02,923: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T01:59:02.929956665Z [2024-04-15 01:59:02,925: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T01:59:02.929963440Z [2024-04-15 01:59:02,926: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T01:59:02.929971418Z [2024-04-15 01:59:02,926: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T01:59:02.929976015Z [2024-04-15 01:59:02,926: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T01:59:02.929979104Z [2024-04-15 01:59:02,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T01:59:02.929982215Z [2024-04-15 01:59:02,926: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T01:59:03.027525714Z [2024-04-15 01:59:03,027: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:59:03.066977694Z [2024-04-15 01:59:03,066: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T01:59:04.674073898Z [2024-04-15 01:59:04,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[837d0e39-4097-45d1-8977-f7d3c8b15be9] succeeded in 4.095665502999964s: None 2024-04-15T01:59:05.097499475Z [2024-04-15 01:59:05,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ecc55e8c-918b-4bca-8d3e-759f47e20a05] succeeded in 4.47497165499999s: None 2024-04-15T02:00:00.530958763Z [2024-04-15 02:00:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e71d03f-ed43-47a9-aea7-6c2c86fec0a1] received 2024-04-15T02:00:00.534282035Z [2024-04-15 02:00:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48b47537-6435-45a3-91da-5b4f51beb793] received 2024-04-15T02:00:00.541537531Z [2024-04-15 02:00:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b08d87fc-cbe0-4842-9051-41e7db7947b4] received 2024-04-15T02:00:00.542641933Z [2024-04-15 02:00:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4d1b317-2d14-4ac3-aa07-39b2ea9dae57] received 2024-04-15T02:00:00.552589900Z [2024-04-15 02:00:00,552: INFO/ForkPoolWorker-16] [48b47537-6435-45a3-91da-5b4f51beb793] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:00:00.555368085Z [2024-04-15 02:00:00,555: INFO/ForkPoolWorker-15] [6e71d03f-ed43-47a9-aea7-6c2c86fec0a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:00.561091591Z [2024-04-15 02:00:00,560: INFO/ForkPoolWorker-1] [b08d87fc-cbe0-4842-9051-41e7db7947b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:00:00.567418539Z [2024-04-15 02:00:00,567: INFO/ForkPoolWorker-2] [c4d1b317-2d14-4ac3-aa07-39b2ea9dae57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:00:01.152081338Z [2024-04-15 02:00:01,147: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:00:01.227045599Z [2024-04-15 02:00:01,223: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:00:01.284624415Z [2024-04-15 02:00:01,278: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:00:01.507509499Z [2024-04-15 02:00:01,498: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:00:01.550215733Z [2024-04-15 02:00:01,549: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:02.680137663Z [2024-04-15 02:00:02,679: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48b47537-6435-45a3-91da-5b4f51beb793] succeeded in 2.143864126000153s: None 2024-04-15T02:00:03.362228342Z [2024-04-15 02:00:03,361: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:00:03.365819809Z [2024-04-15 02:00:03,365: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:03.482990536Z [2024-04-15 02:00:03,482: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:00:03.484243431Z [2024-04-15 02:00:03,483: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:03.484315087Z [2024-04-15 02:00:03,484: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:03.485582068Z [2024-04-15 02:00:03,484: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:03.485594720Z [2024-04-15 02:00:03,485: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:00:03.485598708Z [2024-04-15 02:00:03,485: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:00:03.485601720Z [2024-04-15 02:00:03,485: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:03.607109533Z [2024-04-15 02:00:03,606: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:03.792692332Z [2024-04-15 02:00:03,792: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:00:03.801791656Z [2024-04-15 02:00:03,801: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:03.945516240Z [2024-04-15 02:00:03,945: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:00:03.974535220Z [2024-04-15 02:00:03,974: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:03.974554275Z [2024-04-15 02:00:03,974: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:03.978297804Z [2024-04-15 02:00:03,974: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:03.981435100Z [2024-04-15 02:00:03,978: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:00:03.981737921Z [2024-04-15 02:00:03,981: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:00:03.982606373Z [2024-04-15 02:00:03,981: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:04.088796409Z [2024-04-15 02:00:04,088: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:04.205488853Z [2024-04-15 02:00:04,205: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:00:04.210389609Z [2024-04-15 02:00:04,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:04.287703300Z [2024-04-15 02:00:04,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:00:04.290709600Z [2024-04-15 02:00:04,290: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:04.291001737Z [2024-04-15 02:00:04,290: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:04.291422535Z [2024-04-15 02:00:04,290: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:04.291758968Z [2024-04-15 02:00:04,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:00:04.292332925Z [2024-04-15 02:00:04,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:00:04.293266527Z [2024-04-15 02:00:04,293: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:04.411944371Z [2024-04-15 02:00:04,411: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:05.133831469Z [2024-04-15 02:00:05,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6e71d03f-ed43-47a9-aea7-6c2c86fec0a1] succeeded in 4.596522784999706s: None 2024-04-15T02:00:05.739472592Z [2024-04-15 02:00:05,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff081410-bee9-4edb-85fb-793127394b1f] received 2024-04-15T02:00:05.752158425Z [2024-04-15 02:00:05,751: INFO/ForkPoolWorker-15] [ff081410-bee9-4edb-85fb-793127394b1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:05.819650321Z [2024-04-15 02:00:05,819: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b08d87fc-cbe0-4842-9051-41e7db7947b4] succeeded in 5.27437037899972s: None 2024-04-15T02:00:05.836384471Z [2024-04-15 02:00:05,835: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c4d1b317-2d14-4ac3-aa07-39b2ea9dae57] succeeded in 5.289199781000207s: None 2024-04-15T02:00:06.073141124Z [2024-04-15 02:00:06,070: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:00:07.246078457Z [2024-04-15 02:00:07,245: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:00:07.249364991Z [2024-04-15 02:00:07,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:07.295143482Z [2024-04-15 02:00:07,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:00:07.296169142Z [2024-04-15 02:00:07,295: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:07.296289914Z [2024-04-15 02:00:07,296: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:07.296465310Z [2024-04-15 02:00:07,296: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:07.296562907Z [2024-04-15 02:00:07,296: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:00:07.296853685Z [2024-04-15 02:00:07,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:00:07.296995747Z [2024-04-15 02:00:07,296: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:07.380067404Z [2024-04-15 02:00:07,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:07.965738082Z [2024-04-15 02:00:07,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff081410-bee9-4edb-85fb-793127394b1f] succeeded in 2.218122600999777s: None 2024-04-15T02:00:08.113663896Z [2024-04-15 02:00:08,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92b06e20-8522-4e4f-8474-9331153e0b09] received 2024-04-15T02:00:08.120152152Z [2024-04-15 02:00:08,119: INFO/ForkPoolWorker-15] [92b06e20-8522-4e4f-8474-9331153e0b09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:00:08.455510920Z [2024-04-15 02:00:08,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:00:09.695741723Z [2024-04-15 02:00:09,695: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:00:09.699610154Z [2024-04-15 02:00:09,699: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:09.761060245Z [2024-04-15 02:00:09,760: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:00:09.762133234Z [2024-04-15 02:00:09,761: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:09.762150209Z [2024-04-15 02:00:09,762: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:09.762271823Z [2024-04-15 02:00:09,762: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:09.762289180Z [2024-04-15 02:00:09,762: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:00:09.762476811Z [2024-04-15 02:00:09,762: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:00:09.762488158Z [2024-04-15 02:00:09,762: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:09.890449509Z [2024-04-15 02:00:09,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:10.571424406Z [2024-04-15 02:00:10,570: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92b06e20-8522-4e4f-8474-9331153e0b09] succeeded in 2.4549290089998976s: None 2024-04-15T02:00:10.732177107Z [2024-04-15 02:00:10,731: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d764ecbc-c8d9-4659-91fe-806db4b11edd] received 2024-04-15T02:00:10.744623130Z [2024-04-15 02:00:10,744: INFO/ForkPoolWorker-15] [d764ecbc-c8d9-4659-91fe-806db4b11edd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:00:11.104319072Z [2024-04-15 02:00:11,101: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:00:12.471811868Z [2024-04-15 02:00:12,471: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:00:12.475115823Z [2024-04-15 02:00:12,474: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:00:12.510090015Z [2024-04-15 02:00:12,509: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:00:12.511034176Z [2024-04-15 02:00:12,510: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:00:12.511218122Z [2024-04-15 02:00:12,511: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:00:12.511434142Z [2024-04-15 02:00:12,511: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:00:12.511597207Z [2024-04-15 02:00:12,511: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:00:12.512056696Z [2024-04-15 02:00:12,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:00:12.512216481Z [2024-04-15 02:00:12,512: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:00:12.616804420Z [2024-04-15 02:00:12,616: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:00:13.337070525Z [2024-04-15 02:00:13,336: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d764ecbc-c8d9-4659-91fe-806db4b11edd] succeeded in 2.603323358000125s: None 2024-04-15T02:01:00.526896181Z [2024-04-15 02:01:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e708ed92-c58c-47bf-a2f0-bb1bd988cf1b] received 2024-04-15T02:01:00.531295617Z [2024-04-15 02:01:00,531: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b27a1b82-12ff-4bbd-8f92-125dfdde8959] received 2024-04-15T02:01:00.545541680Z [2024-04-15 02:01:00,545: INFO/ForkPoolWorker-16] [b27a1b82-12ff-4bbd-8f92-125dfdde8959] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:01:00.549948659Z [2024-04-15 02:01:00,549: INFO/ForkPoolWorker-15] [e708ed92-c58c-47bf-a2f0-bb1bd988cf1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:01:00.936625392Z [2024-04-15 02:01:00,933: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:01:01.013561483Z [2024-04-15 02:01:01,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:01:02.627363307Z [2024-04-15 02:01:02,627: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:01:02.644626062Z [2024-04-15 02:01:02,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:01:02.703451444Z [2024-04-15 02:01:02,703: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:01:02.706897153Z [2024-04-15 02:01:02,706: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:01:02.707897050Z [2024-04-15 02:01:02,706: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:01:02.709083913Z [2024-04-15 02:01:02,708: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:01:02.711229189Z [2024-04-15 02:01:02,711: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:01:02.711579642Z [2024-04-15 02:01:02,711: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:01:02.712078845Z [2024-04-15 02:01:02,711: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:01:02.757452525Z [2024-04-15 02:01:02,757: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:01:02.761480806Z [2024-04-15 02:01:02,761: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:01:02.785427393Z [2024-04-15 02:01:02,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:01:02.790206429Z [2024-04-15 02:01:02,789: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:01:02.796631698Z [2024-04-15 02:01:02,796: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:01:02.797209595Z [2024-04-15 02:01:02,796: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:01:02.797324265Z [2024-04-15 02:01:02,797: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:01:02.797650340Z [2024-04-15 02:01:02,797: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:01:02.798169480Z [2024-04-15 02:01:02,798: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:01:02.832360844Z [2024-04-15 02:01:02,831: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:01:02.962977692Z [2024-04-15 02:01:02,962: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:01:05.435458257Z [2024-04-15 02:01:05,435: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e708ed92-c58c-47bf-a2f0-bb1bd988cf1b] succeeded in 4.900582754999959s: None 2024-04-15T02:01:06.195988306Z [2024-04-15 02:01:06,195: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b27a1b82-12ff-4bbd-8f92-125dfdde8959] succeeded in 5.658426202000101s: None 2024-04-15T02:02:00.329036631Z [2024-04-15 02:02:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[682cf948-5f2e-40cd-aaf3-5fa9a8c98966] received 2024-04-15T02:02:00.336535662Z [2024-04-15 02:02:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1db94506-0206-4807-9809-5a7637f7152d] received 2024-04-15T02:02:00.348461327Z [2024-04-15 02:02:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ef3069-1bee-4d69-8ffd-34906d8f4d7b] received 2024-04-15T02:02:00.348779989Z [2024-04-15 02:02:00,348: INFO/ForkPoolWorker-16] [1db94506-0206-4807-9809-5a7637f7152d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:02:00.351433262Z [2024-04-15 02:02:00,351: INFO/ForkPoolWorker-15] [682cf948-5f2e-40cd-aaf3-5fa9a8c98966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:02:00.359709044Z [2024-04-15 02:02:00,359: INFO/ForkPoolWorker-1] [c5ef3069-1bee-4d69-8ffd-34906d8f4d7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:02:00.708577569Z [2024-04-15 02:02:00,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:02:00.714748976Z [2024-04-15 02:02:00,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:02:00.832926206Z [2024-04-15 02:02:00,824: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:02:01.118781348Z [2024-04-15 02:02:01,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:02:01.707671432Z [2024-04-15 02:02:01,707: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1db94506-0206-4807-9809-5a7637f7152d] succeeded in 1.3681480759996703s: None 2024-04-15T02:02:02.724323412Z [2024-04-15 02:02:02,724: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:02:02.727490289Z [2024-04-15 02:02:02,727: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:02:02.784081272Z [2024-04-15 02:02:02,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:02:02.786726122Z [2024-04-15 02:02:02,785: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:02:02.786821018Z [2024-04-15 02:02:02,786: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:02:02.786954922Z [2024-04-15 02:02:02,786: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:02:02.787020497Z [2024-04-15 02:02:02,786: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:02:02.787263029Z [2024-04-15 02:02:02,787: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:02:02.789288428Z [2024-04-15 02:02:02,789: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:02:02.917961669Z [2024-04-15 02:02:02,913: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:02:02.921622767Z [2024-04-15 02:02:02,920: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:02:02.942033860Z [2024-04-15 02:02:02,939: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:02:03.017789175Z [2024-04-15 02:02:03,017: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:02:03.019214519Z [2024-04-15 02:02:03,019: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:02:03.021107555Z [2024-04-15 02:02:03,019: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:02:03.021389813Z [2024-04-15 02:02:03,021: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:02:03.021547886Z [2024-04-15 02:02:03,021: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:02:03.022094055Z [2024-04-15 02:02:03,021: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:02:03.022258706Z [2024-04-15 02:02:03,022: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:02:03.114629758Z [2024-04-15 02:02:03,114: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:02:04.444141600Z [2024-04-15 02:02:04,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[682cf948-5f2e-40cd-aaf3-5fa9a8c98966] succeeded in 4.111503410000296s: None 2024-04-15T02:02:05.418799794Z [2024-04-15 02:02:05,418: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c5ef3069-1bee-4d69-8ffd-34906d8f4d7b] succeeded in 5.067347598000197s: None 2024-04-15T02:03:01.004825044Z [2024-04-15 02:03:01,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13f44473-2f04-496d-8799-3ee795ac7f10] received 2024-04-15T02:03:01.014451440Z [2024-04-15 02:03:01,014: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c2c657a-6082-440b-96ab-cfd09ba76c58] received 2024-04-15T02:03:01.022104702Z [2024-04-15 02:03:01,021: INFO/ForkPoolWorker-15] [13f44473-2f04-496d-8799-3ee795ac7f10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:03:01.029521644Z [2024-04-15 02:03:01,029: INFO/ForkPoolWorker-16] [7c2c657a-6082-440b-96ab-cfd09ba76c58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:03:01.425302556Z [2024-04-15 02:03:01,422: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:03:01.605336950Z [2024-04-15 02:03:01,601: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:03:02.986194206Z [2024-04-15 02:03:02,983: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:03:02.987895286Z [2024-04-15 02:03:02,986: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:03:03.045821846Z [2024-04-15 02:03:03,045: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:03:03.057973862Z [2024-04-15 02:03:03,056: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:03:03.057993625Z [2024-04-15 02:03:03,057: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:03:03.059701917Z [2024-04-15 02:03:03,057: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:03:03.059708319Z [2024-04-15 02:03:03,057: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:03:03.059711976Z [2024-04-15 02:03:03,057: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:03:03.059719246Z [2024-04-15 02:03:03,057: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:03:03.140238297Z [2024-04-15 02:03:03,139: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:03:03.143672256Z [2024-04-15 02:03:03,143: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:03:03.165476654Z [2024-04-15 02:03:03,165: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:03:03.191232558Z [2024-04-15 02:03:03,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:03:03.193487330Z [2024-04-15 02:03:03,193: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:03:03.193614236Z [2024-04-15 02:03:03,193: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:03:03.193853285Z [2024-04-15 02:03:03,193: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:03:03.193861558Z [2024-04-15 02:03:03,193: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:03:03.195019529Z [2024-04-15 02:03:03,194: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:03:03.196383781Z [2024-04-15 02:03:03,196: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:03:03.308021085Z [2024-04-15 02:03:03,307: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:03:05.829104170Z [2024-04-15 02:03:05,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13f44473-2f04-496d-8799-3ee795ac7f10] succeeded in 4.821572366000055s: None 2024-04-15T02:03:06.311067465Z [2024-04-15 02:03:06,310: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c2c657a-6082-440b-96ab-cfd09ba76c58] succeeded in 5.2934688899999855s: None 2024-04-15T02:04:00.395073313Z [2024-04-15 02:04:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579bc06f-ba3f-4d43-8c31-bb339e48a2ab] received 2024-04-15T02:04:00.411180878Z [2024-04-15 02:04:00,410: INFO/ForkPoolWorker-15] [579bc06f-ba3f-4d43-8c31-bb339e48a2ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:04:00.418272634Z [2024-04-15 02:04:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79c12507-058e-47a6-98dd-75b153d082ac] received 2024-04-15T02:04:00.442131262Z [2024-04-15 02:04:00,441: INFO/ForkPoolWorker-16] [79c12507-058e-47a6-98dd-75b153d082ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:04:00.473344746Z [2024-04-15 02:04:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[155a2f98-7afa-46d6-be4d-db9909ae3045] received 2024-04-15T02:04:00.512553120Z [2024-04-15 02:04:00,512: INFO/ForkPoolWorker-1] [155a2f98-7afa-46d6-be4d-db9909ae3045] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:04:00.862953768Z [2024-04-15 02:04:00,850: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:04:00.911719639Z [2024-04-15 02:04:00,908: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:04:00.988241477Z [2024-04-15 02:04:00,978: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:04:01.331427947Z [2024-04-15 02:04:01,331: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:04:02.129989961Z [2024-04-15 02:04:02,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[579bc06f-ba3f-4d43-8c31-bb339e48a2ab] succeeded in 1.730050322000352s: None 2024-04-15T02:04:02.858003545Z [2024-04-15 02:04:02,853: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:04:02.858019178Z [2024-04-15 02:04:02,856: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:04:02.976354139Z [2024-04-15 02:04:02,974: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:04:02.982045986Z [2024-04-15 02:04:02,976: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:04:02.982068266Z [2024-04-15 02:04:02,976: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:04:02.982072267Z [2024-04-15 02:04:02,976: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:04:02.982076170Z [2024-04-15 02:04:02,976: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:04:02.982079324Z [2024-04-15 02:04:02,977: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:04:02.982082443Z [2024-04-15 02:04:02,977: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:04:03.038286621Z [2024-04-15 02:04:03,037: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:04:03.041550939Z [2024-04-15 02:04:03,041: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:04:03.091899878Z [2024-04-15 02:04:03,091: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:04:03.094222462Z [2024-04-15 02:04:03,094: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:04:03.094380768Z [2024-04-15 02:04:03,094: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:04:03.094557251Z [2024-04-15 02:04:03,094: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:04:03.094668766Z [2024-04-15 02:04:03,094: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:04:03.095038981Z [2024-04-15 02:04:03,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:04:03.095164770Z [2024-04-15 02:04:03,095: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:04:03.122272063Z [2024-04-15 02:04:03,121: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:04:03.232554433Z [2024-04-15 02:04:03,232: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:04:05.112467636Z [2024-04-15 02:04:05,111: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[155a2f98-7afa-46d6-be4d-db9909ae3045] succeeded in 4.63337348999994s: None 2024-04-15T02:04:05.564112983Z [2024-04-15 02:04:05,563: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[79c12507-058e-47a6-98dd-75b153d082ac] succeeded in 5.141108743000132s: None 2024-04-15T02:05:00.739672421Z [2024-04-15 02:05:00,739: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14b5a4f4-881e-496a-9909-6070678c4499] received 2024-04-15T02:05:00.748888054Z [2024-04-15 02:05:00,748: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cac04ea-d06e-4f93-b07f-a12f9c69a7f7] received 2024-04-15T02:05:00.750914003Z [2024-04-15 02:05:00,750: INFO/ForkPoolWorker-15] [14b5a4f4-881e-496a-9909-6070678c4499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:00.761260736Z [2024-04-15 02:05:00,761: INFO/ForkPoolWorker-16] [3cac04ea-d06e-4f93-b07f-a12f9c69a7f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:05:00.763972020Z [2024-04-15 02:05:00,763: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ae66130-9950-41ab-b043-d8b58d511ba4] received 2024-04-15T02:05:00.774826726Z [2024-04-15 02:05:00,773: INFO/ForkPoolWorker-1] [7ae66130-9950-41ab-b043-d8b58d511ba4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:05:01.274783184Z [2024-04-15 02:05:01,267: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:05:01.328850854Z [2024-04-15 02:05:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:05:01.388203306Z [2024-04-15 02:05:01,384: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:05:03.538231699Z [2024-04-15 02:05:03,537: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:05:03.558505973Z [2024-04-15 02:05:03,557: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:03.635491872Z [2024-04-15 02:05:03,635: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:05:03.636926018Z [2024-04-15 02:05:03,636: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:03.637250745Z [2024-04-15 02:05:03,637: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:03.637408697Z [2024-04-15 02:05:03,637: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:03.637509574Z [2024-04-15 02:05:03,637: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:05:03.637834888Z [2024-04-15 02:05:03,637: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:05:03.638271226Z [2024-04-15 02:05:03,638: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:03.663513865Z [2024-04-15 02:05:03,663: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:05:03.667297034Z [2024-04-15 02:05:03,666: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:03.726320436Z [2024-04-15 02:05:03,726: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:05:03.728056738Z [2024-04-15 02:05:03,727: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:03.728073781Z [2024-04-15 02:05:03,727: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:03.728283445Z [2024-04-15 02:05:03,728: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:03.728297155Z [2024-04-15 02:05:03,728: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:05:03.728979127Z [2024-04-15 02:05:03,728: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:05:03.729014803Z [2024-04-15 02:05:03,728: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:03.772156915Z [2024-04-15 02:05:03,771: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:03.871828724Z [2024-04-15 02:05:03,865: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:04.056600340Z [2024-04-15 02:05:04,056: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:05:04.060048376Z [2024-04-15 02:05:04,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:04.175036595Z [2024-04-15 02:05:04,174: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:05:04.181029609Z [2024-04-15 02:05:04,180: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:04.181201103Z [2024-04-15 02:05:04,180: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:04.181413194Z [2024-04-15 02:05:04,181: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:04.181877512Z [2024-04-15 02:05:04,181: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:05:04.184252534Z [2024-04-15 02:05:04,184: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:05:04.184442396Z [2024-04-15 02:05:04,184: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:04.333498478Z [2024-04-15 02:05:04,333: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:05.144329091Z [2024-04-15 02:05:05,143: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14b5a4f4-881e-496a-9909-6070678c4499] succeeded in 4.401072841999849s: None 2024-04-15T02:05:05.781306325Z [2024-04-15 02:05:05,780: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ae66130-9950-41ab-b043-d8b58d511ba4] succeeded in 5.013818616000208s: None 2024-04-15T02:05:05.985172009Z [2024-04-15 02:05:05,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61a9d98f-36a7-4d34-9e4f-54b6197bf08f] received 2024-04-15T02:05:06.006924709Z [2024-04-15 02:05:06,006: INFO/ForkPoolWorker-15] [61a9d98f-36a7-4d34-9e4f-54b6197bf08f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:06.284227470Z [2024-04-15 02:05:06,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cac04ea-d06e-4f93-b07f-a12f9c69a7f7] succeeded in 5.531999727999846s: None 2024-04-15T02:05:06.321063911Z [2024-04-15 02:05:06,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:05:07.658747753Z [2024-04-15 02:05:07,658: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:05:07.663445037Z [2024-04-15 02:05:07,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:07.692222004Z [2024-04-15 02:05:07,691: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:05:07.694903563Z [2024-04-15 02:05:07,694: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:07.695005633Z [2024-04-15 02:05:07,694: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:07.695304013Z [2024-04-15 02:05:07,695: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:07.695706520Z [2024-04-15 02:05:07,695: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:05:07.696064503Z [2024-04-15 02:05:07,695: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:05:07.696203030Z [2024-04-15 02:05:07,696: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:07.782648516Z [2024-04-15 02:05:07,782: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:08.346496451Z [2024-04-15 02:05:08,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5deb2ebc-4875-48ea-bfae-f6f8b498c851] received 2024-04-15T02:05:08.377571848Z [2024-04-15 02:05:08,377: INFO/ForkPoolWorker-16] [5deb2ebc-4875-48ea-bfae-f6f8b498c851] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:05:08.378767775Z [2024-04-15 02:05:08,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61a9d98f-36a7-4d34-9e4f-54b6197bf08f] succeeded in 2.3852703649999967s: None 2024-04-15T02:05:08.709230805Z [2024-04-15 02:05:08,706: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:05:10.042530110Z [2024-04-15 02:05:10,042: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:05:10.045711878Z [2024-04-15 02:05:10,045: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:10.086156822Z [2024-04-15 02:05:10,085: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:05:10.089128745Z [2024-04-15 02:05:10,088: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:10.089143696Z [2024-04-15 02:05:10,089: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:10.089247230Z [2024-04-15 02:05:10,089: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:10.090310452Z [2024-04-15 02:05:10,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:05:10.090548311Z [2024-04-15 02:05:10,090: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:05:10.090882015Z [2024-04-15 02:05:10,090: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:10.250984284Z [2024-04-15 02:05:10,250: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:10.881712738Z [2024-04-15 02:05:10,881: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5deb2ebc-4875-48ea-bfae-f6f8b498c851] succeeded in 2.5267203109997354s: None 2024-04-15T02:05:12.144278211Z [2024-04-15 02:05:12,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4417a12b-7bf8-4dd9-914f-194d2887c43d] received 2024-04-15T02:05:12.174228732Z [2024-04-15 02:05:12,173: INFO/ForkPoolWorker-15] [4417a12b-7bf8-4dd9-914f-194d2887c43d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:05:12.495777234Z [2024-04-15 02:05:12,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:05:13.941833457Z [2024-04-15 02:05:13,941: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:05:13.948677459Z [2024-04-15 02:05:13,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:05:13.984067819Z [2024-04-15 02:05:13,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:05:13.984950046Z [2024-04-15 02:05:13,984: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:05:13.984976986Z [2024-04-15 02:05:13,984: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:05:13.985133959Z [2024-04-15 02:05:13,984: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:05:13.985191774Z [2024-04-15 02:05:13,985: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:05:13.985697783Z [2024-04-15 02:05:13,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:05:13.985795429Z [2024-04-15 02:05:13,985: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:05:14.084793883Z [2024-04-15 02:05:14,084: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:05:14.674031407Z [2024-04-15 02:05:14,673: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4417a12b-7bf8-4dd9-914f-194d2887c43d] succeeded in 2.525570990000233s: None 2024-04-15T02:06:00.722423017Z [2024-04-15 02:06:00,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4dc481a-37d4-4f0d-a8b0-2bc943a717fa] received 2024-04-15T02:06:00.727437779Z [2024-04-15 02:06:00,727: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bd7a2fb-0089-4112-988b-f6f959536493] received 2024-04-15T02:06:00.731044628Z [2024-04-15 02:06:00,730: INFO/ForkPoolWorker-15] [c4dc481a-37d4-4f0d-a8b0-2bc943a717fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:06:00.731113491Z [2024-04-15 02:06:00,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35248ffe-32f3-4519-919d-93be02a007f2] received 2024-04-15T02:06:00.742730284Z [2024-04-15 02:06:00,742: INFO/ForkPoolWorker-16] [0bd7a2fb-0089-4112-988b-f6f959536493] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:06:00.750858183Z [2024-04-15 02:06:00,749: INFO/ForkPoolWorker-1] [35248ffe-32f3-4519-919d-93be02a007f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:06:01.196424374Z [2024-04-15 02:06:01,190: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:06:01.275439363Z [2024-04-15 02:06:01,270: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:06:01.338069972Z [2024-04-15 02:06:01,332: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:06:01.640609054Z [2024-04-15 02:06:01,640: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:06:02.568083247Z [2024-04-15 02:06:02,567: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[35248ffe-32f3-4519-919d-93be02a007f2] succeeded in 1.8341461559998606s: None 2024-04-15T02:06:03.203354925Z [2024-04-15 02:06:03,202: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:06:03.207048339Z [2024-04-15 02:06:03,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:06:03.258271790Z [2024-04-15 02:06:03,258: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:06:03.263879283Z [2024-04-15 02:06:03,263: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:06:03.263977465Z [2024-04-15 02:06:03,263: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:06:03.264146889Z [2024-04-15 02:06:03,263: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:06:03.264311246Z [2024-04-15 02:06:03,264: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:06:03.264557228Z [2024-04-15 02:06:03,264: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:06:03.266198818Z [2024-04-15 02:06:03,265: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:06:03.419063214Z [2024-04-15 02:06:03,418: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:06:03.825087646Z [2024-04-15 02:06:03,824: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:06:03.845306529Z [2024-04-15 02:06:03,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:06:03.907652143Z [2024-04-15 02:06:03,907: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:06:03.909140607Z [2024-04-15 02:06:03,908: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:06:03.909613614Z [2024-04-15 02:06:03,909: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:06:03.909623451Z [2024-04-15 02:06:03,909: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:06:03.909627000Z [2024-04-15 02:06:03,909: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:06:03.909954778Z [2024-04-15 02:06:03,909: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:06:03.910387448Z [2024-04-15 02:06:03,910: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:06:04.037124308Z [2024-04-15 02:06:04,036: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:06:05.909860961Z [2024-04-15 02:06:05,908: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4dc481a-37d4-4f0d-a8b0-2bc943a717fa] succeeded in 5.183343797999896s: None 2024-04-15T02:06:06.699801207Z [2024-04-15 02:06:06,699: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0bd7a2fb-0089-4112-988b-f6f959536493] succeeded in 5.970340138000211s: None 2024-04-15T02:07:00.341722430Z [2024-04-15 02:07:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c62e5b11-3761-475a-b25e-4ac1f8f016b6] received 2024-04-15T02:07:00.354960369Z [2024-04-15 02:07:00,354: INFO/ForkPoolWorker-15] [c62e5b11-3761-475a-b25e-4ac1f8f016b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:07:00.360502830Z [2024-04-15 02:07:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d871427-974a-4973-b184-fbdde8beb057] received 2024-04-15T02:07:00.370229762Z [2024-04-15 02:07:00,369: INFO/ForkPoolWorker-16] [4d871427-974a-4973-b184-fbdde8beb057] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:07:00.677630933Z [2024-04-15 02:07:00,674: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:07:00.708869702Z [2024-04-15 02:07:00,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:07:02.019112003Z [2024-04-15 02:07:02,018: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:07:02.022757879Z [2024-04-15 02:07:02,022: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:07:02.063235949Z [2024-04-15 02:07:02,062: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:07:02.064055751Z [2024-04-15 02:07:02,063: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:07:02.064087606Z [2024-04-15 02:07:02,063: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:07:02.064186443Z [2024-04-15 02:07:02,064: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:07:02.064240152Z [2024-04-15 02:07:02,064: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:07:02.064405266Z [2024-04-15 02:07:02,064: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:07:02.064462906Z [2024-04-15 02:07:02,064: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:07:02.161150831Z [2024-04-15 02:07:02,160: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:07:02.202691654Z [2024-04-15 02:07:02,202: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:07:02.205763654Z [2024-04-15 02:07:02,205: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:07:02.270184069Z [2024-04-15 02:07:02,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:07:02.271492208Z [2024-04-15 02:07:02,271: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:07:02.271598684Z [2024-04-15 02:07:02,271: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:07:02.271815402Z [2024-04-15 02:07:02,271: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:07:02.271880590Z [2024-04-15 02:07:02,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:07:02.272147197Z [2024-04-15 02:07:02,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:07:02.272616430Z [2024-04-15 02:07:02,272: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:07:02.359029482Z [2024-04-15 02:07:02,358: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:07:04.106016258Z [2024-04-15 02:07:04,105: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c62e5b11-3761-475a-b25e-4ac1f8f016b6] succeeded in 3.7618517480000264s: None 2024-04-15T02:07:04.166278611Z [2024-04-15 02:07:04,165: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d871427-974a-4973-b184-fbdde8beb057] succeeded in 3.802847724000003s: None 2024-04-15T02:08:00.818208871Z [2024-04-15 02:08:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d0d6f49-3143-4dc2-bb34-4e82052e0805] received 2024-04-15T02:08:00.832014528Z [2024-04-15 02:08:00,828: INFO/ForkPoolWorker-15] [6d0d6f49-3143-4dc2-bb34-4e82052e0805] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:08:00.832043768Z [2024-04-15 02:08:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87703644-ca4f-4f02-ad60-748ad5b247b9] received 2024-04-15T02:08:00.832047171Z [2024-04-15 02:08:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[110b3b75-3b89-400f-8996-71c6592d645c] received 2024-04-15T02:08:00.871530140Z [2024-04-15 02:08:00,871: INFO/ForkPoolWorker-16] [87703644-ca4f-4f02-ad60-748ad5b247b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:08:00.875181862Z [2024-04-15 02:08:00,874: INFO/ForkPoolWorker-1] [110b3b75-3b89-400f-8996-71c6592d645c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:08:01.271348799Z [2024-04-15 02:08:01,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:08:01.283939554Z [2024-04-15 02:08:01,279: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:08:01.582438737Z [2024-04-15 02:08:01,582: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:08:01.621427466Z [2024-04-15 02:08:01,617: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:08:02.628891792Z [2024-04-15 02:08:02,628: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[110b3b75-3b89-400f-8996-71c6592d645c] succeeded in 1.793510132999927s: None 2024-04-15T02:08:03.167220155Z [2024-04-15 02:08:03,166: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:08:03.171922287Z [2024-04-15 02:08:03,170: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:08:03.226121024Z [2024-04-15 02:08:03,225: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:08:03.229359237Z [2024-04-15 02:08:03,229: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:08:03.229486417Z [2024-04-15 02:08:03,229: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:08:03.229659267Z [2024-04-15 02:08:03,229: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:08:03.229723383Z [2024-04-15 02:08:03,229: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:08:03.230338570Z [2024-04-15 02:08:03,230: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:08:03.230391344Z [2024-04-15 02:08:03,230: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:08:03.321293452Z [2024-04-15 02:08:03,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:08:03.574189135Z [2024-04-15 02:08:03,573: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:08:03.578780770Z [2024-04-15 02:08:03,578: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:08:03.636923123Z [2024-04-15 02:08:03,636: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:08:03.638993640Z [2024-04-15 02:08:03,638: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:08:03.639510619Z [2024-04-15 02:08:03,638: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:08:03.639831810Z [2024-04-15 02:08:03,639: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:08:03.639997792Z [2024-04-15 02:08:03,639: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:08:03.640277946Z [2024-04-15 02:08:03,640: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:08:03.640406633Z [2024-04-15 02:08:03,640: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:08:03.750780710Z [2024-04-15 02:08:03,750: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:08:05.405246679Z [2024-04-15 02:08:05,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d0d6f49-3143-4dc2-bb34-4e82052e0805] succeeded in 4.5834253180000815s: None 2024-04-15T02:08:05.721861403Z [2024-04-15 02:08:05,720: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[87703644-ca4f-4f02-ad60-748ad5b247b9] succeeded in 4.886379466999642s: None 2024-04-15T02:09:01.159152925Z [2024-04-15 02:09:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c6e2cda-f38a-4ab7-b7d1-6382efd71396] received 2024-04-15T02:09:01.175281208Z [2024-04-15 02:09:01,174: INFO/ForkPoolWorker-15] [6c6e2cda-f38a-4ab7-b7d1-6382efd71396] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:09:01.181329838Z [2024-04-15 02:09:01,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6673d4f8-15b6-47a1-bc44-faaaadcf20a4] received 2024-04-15T02:09:01.196435763Z [2024-04-15 02:09:01,196: INFO/ForkPoolWorker-16] [6673d4f8-15b6-47a1-bc44-faaaadcf20a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:09:01.610191819Z [2024-04-15 02:09:01,604: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:09:01.623144553Z [2024-04-15 02:09:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:09:03.316444863Z [2024-04-15 02:09:03,316: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:09:03.320788058Z [2024-04-15 02:09:03,320: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:09:03.373208913Z [2024-04-15 02:09:03,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:09:03.377414392Z [2024-04-15 02:09:03,376: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:09:03.377579258Z [2024-04-15 02:09:03,377: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:09:03.377770516Z [2024-04-15 02:09:03,377: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:09:03.377928402Z [2024-04-15 02:09:03,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:09:03.379049150Z [2024-04-15 02:09:03,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:09:03.379241211Z [2024-04-15 02:09:03,379: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:09:03.428386649Z [2024-04-15 02:09:03,427: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:09:03.433380413Z [2024-04-15 02:09:03,432: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:09:03.471987699Z [2024-04-15 02:09:03,471: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:09:03.500984129Z [2024-04-15 02:09:03,499: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:09:03.504583879Z [2024-04-15 02:09:03,504: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:09:03.504696105Z [2024-04-15 02:09:03,504: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:09:03.504897228Z [2024-04-15 02:09:03,504: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:09:03.506275238Z [2024-04-15 02:09:03,506: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:09:03.506615498Z [2024-04-15 02:09:03,506: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:09:03.507067570Z [2024-04-15 02:09:03,506: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:09:03.602646180Z [2024-04-15 02:09:03,602: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:09:05.079883600Z [2024-04-15 02:09:05,079: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c6e2cda-f38a-4ab7-b7d1-6382efd71396] succeeded in 3.917190001000108s: None 2024-04-15T02:09:05.607090079Z [2024-04-15 02:09:05,606: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6673d4f8-15b6-47a1-bc44-faaaadcf20a4] succeeded in 4.420481899999686s: None 2024-04-15T02:10:00.293136564Z [2024-04-15 02:10:00,292: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97521446-f4b4-42f0-9a93-a764d7f44eeb] received 2024-04-15T02:10:00.297119797Z [2024-04-15 02:10:00,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65c37729-0f71-4384-a555-bb06cfa95076] received 2024-04-15T02:10:00.301834251Z [2024-04-15 02:10:00,301: INFO/ForkPoolWorker-15] [97521446-f4b4-42f0-9a93-a764d7f44eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:00.308381439Z [2024-04-15 02:10:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a267581a-fd60-43cf-9cba-fa2158b9f828] received 2024-04-15T02:10:00.310989242Z [2024-04-15 02:10:00,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fd3890d-6007-4eab-9477-90399a29d8d5] received 2024-04-15T02:10:00.320876050Z [2024-04-15 02:10:00,320: INFO/ForkPoolWorker-16] [65c37729-0f71-4384-a555-bb06cfa95076] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:10:00.334517659Z [2024-04-15 02:10:00,334: INFO/ForkPoolWorker-2] [9fd3890d-6007-4eab-9477-90399a29d8d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:10:00.352205538Z [2024-04-15 02:10:00,349: INFO/ForkPoolWorker-1] [a267581a-fd60-43cf-9cba-fa2158b9f828] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:10:00.681709934Z [2024-04-15 02:10:00,678: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:10:00.735066000Z [2024-04-15 02:10:00,730: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:10:00.835719218Z [2024-04-15 02:10:00,786: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:10:00.899834844Z [2024-04-15 02:10:00,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:10:01.608700554Z [2024-04-15 02:10:01,608: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:02.951371489Z [2024-04-15 02:10:02,950: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[65c37729-0f71-4384-a555-bb06cfa95076] succeeded in 2.648475908999899s: None 2024-04-15T02:10:03.003666608Z [2024-04-15 02:10:03,003: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:10:03.008022306Z [2024-04-15 02:10:03,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:03.087374843Z [2024-04-15 02:10:03,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:10:03.090282918Z [2024-04-15 02:10:03,090: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:03.090838715Z [2024-04-15 02:10:03,090: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:03.091047707Z [2024-04-15 02:10:03,090: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:03.091205098Z [2024-04-15 02:10:03,091: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:10:03.091595075Z [2024-04-15 02:10:03,091: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:10:03.091775802Z [2024-04-15 02:10:03,091: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:03.266448660Z [2024-04-15 02:10:03,266: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:03.280419698Z [2024-04-15 02:10:03,280: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:10:03.283799612Z [2024-04-15 02:10:03,283: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:03.345601778Z [2024-04-15 02:10:03,345: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:10:03.347405017Z [2024-04-15 02:10:03,347: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:03.347467784Z [2024-04-15 02:10:03,347: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:03.347612376Z [2024-04-15 02:10:03,347: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:03.347703790Z [2024-04-15 02:10:03,347: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:10:03.348257788Z [2024-04-15 02:10:03,348: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:10:03.348288196Z [2024-04-15 02:10:03,348: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:03.469950174Z [2024-04-15 02:10:03,469: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:03.479573004Z [2024-04-15 02:10:03,479: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:10:03.486591815Z [2024-04-15 02:10:03,486: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:03.531071943Z [2024-04-15 02:10:03,530: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:10:03.554223817Z [2024-04-15 02:10:03,553: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:03.554393980Z [2024-04-15 02:10:03,554: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:03.554640223Z [2024-04-15 02:10:03,554: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:03.554799088Z [2024-04-15 02:10:03,554: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:10:03.555150143Z [2024-04-15 02:10:03,555: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:10:03.555314361Z [2024-04-15 02:10:03,555: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:03.707707381Z [2024-04-15 02:10:03,707: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:04.125695139Z [2024-04-15 02:10:04,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97521446-f4b4-42f0-9a93-a764d7f44eeb] succeeded in 3.8308207199997923s: None 2024-04-15T02:10:04.368895485Z [2024-04-15 02:10:04,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea1e5e06-c268-4d22-b836-63b266092588] received 2024-04-15T02:10:04.379693161Z [2024-04-15 02:10:04,379: INFO/ForkPoolWorker-15] [ea1e5e06-c268-4d22-b836-63b266092588] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:04.729218402Z [2024-04-15 02:10:04,726: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:10:05.282020158Z [2024-04-15 02:10:05,281: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a267581a-fd60-43cf-9cba-fa2158b9f828] succeeded in 4.968793785999878s: None 2024-04-15T02:10:06.071278996Z [2024-04-15 02:10:06,070: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9fd3890d-6007-4eab-9477-90399a29d8d5] succeeded in 5.756680332000087s: None 2024-04-15T02:10:06.073572251Z [2024-04-15 02:10:06,073: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:10:06.076895886Z [2024-04-15 02:10:06,076: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:06.113317330Z [2024-04-15 02:10:06,113: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:10:06.114758393Z [2024-04-15 02:10:06,114: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:06.114836052Z [2024-04-15 02:10:06,114: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:06.114966104Z [2024-04-15 02:10:06,114: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:06.115037466Z [2024-04-15 02:10:06,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:10:06.115255810Z [2024-04-15 02:10:06,115: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:10:06.115305678Z [2024-04-15 02:10:06,115: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:06.206766092Z [2024-04-15 02:10:06,206: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:06.817029758Z [2024-04-15 02:10:06,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ea1e5e06-c268-4d22-b836-63b266092588] succeeded in 2.4458076239998263s: None 2024-04-15T02:10:06.819749430Z [2024-04-15 02:10:06,819: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f22d97d-c814-4049-820c-a3c390449485] received 2024-04-15T02:10:06.829193403Z [2024-04-15 02:10:06,828: INFO/ForkPoolWorker-15] [5f22d97d-c814-4049-820c-a3c390449485] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:10:07.150924168Z [2024-04-15 02:10:07,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:10:08.402963027Z [2024-04-15 02:10:08,402: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:10:08.407516446Z [2024-04-15 02:10:08,407: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:08.430354083Z [2024-04-15 02:10:08,430: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:10:08.431450053Z [2024-04-15 02:10:08,431: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:08.431498826Z [2024-04-15 02:10:08,431: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:08.431727086Z [2024-04-15 02:10:08,431: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:08.431786076Z [2024-04-15 02:10:08,431: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:10:08.432044845Z [2024-04-15 02:10:08,431: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:10:08.432161428Z [2024-04-15 02:10:08,432: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:08.521836544Z [2024-04-15 02:10:08,521: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:09.079173092Z [2024-04-15 02:10:09,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5f22d97d-c814-4049-820c-a3c390449485] succeeded in 2.2559972359999847s: None 2024-04-15T02:10:09.464637272Z [2024-04-15 02:10:09,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[386dabf3-5c71-41ab-b7ec-20bbc979c316] received 2024-04-15T02:10:09.481433635Z [2024-04-15 02:10:09,481: INFO/ForkPoolWorker-15] [386dabf3-5c71-41ab-b7ec-20bbc979c316] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:10:09.920588245Z [2024-04-15 02:10:09,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:10:11.225368997Z [2024-04-15 02:10:11,225: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:10:11.228426818Z [2024-04-15 02:10:11,228: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:10:11.250176518Z [2024-04-15 02:10:11,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:10:11.253032720Z [2024-04-15 02:10:11,252: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:10:11.253386917Z [2024-04-15 02:10:11,253: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:10:11.253621143Z [2024-04-15 02:10:11,253: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:10:11.253755645Z [2024-04-15 02:10:11,253: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:10:11.255686041Z [2024-04-15 02:10:11,253: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:10:11.260109930Z [2024-04-15 02:10:11,259: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:10:11.356961084Z [2024-04-15 02:10:11,356: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:10:11.955319180Z [2024-04-15 02:10:11,954: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[386dabf3-5c71-41ab-b7ec-20bbc979c316] succeeded in 2.484702051000113s: None 2024-04-15T02:11:00.214835198Z [2024-04-15 02:11:00,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d43674d0-fd0f-4726-8b55-4db56252126a] received 2024-04-15T02:11:00.233848939Z [2024-04-15 02:11:00,233: INFO/ForkPoolWorker-15] [d43674d0-fd0f-4726-8b55-4db56252126a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:11:00.259028072Z [2024-04-15 02:11:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d6db426-f66f-48e5-86bb-2bf4fdf35536] received 2024-04-15T02:11:00.283123334Z [2024-04-15 02:11:00,282: INFO/ForkPoolWorker-16] [9d6db426-f66f-48e5-86bb-2bf4fdf35536] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:11:00.584020188Z [2024-04-15 02:11:00,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:11:00.605460906Z [2024-04-15 02:11:00,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:11:02.245044893Z [2024-04-15 02:11:02,244: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:11:02.249704777Z [2024-04-15 02:11:02,249: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:11:02.323601833Z [2024-04-15 02:11:02,323: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:11:02.337442831Z [2024-04-15 02:11:02,337: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:11:02.347175041Z [2024-04-15 02:11:02,346: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:11:02.359894705Z [2024-04-15 02:11:02,358: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:11:02.360050272Z [2024-04-15 02:11:02,359: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:11:02.360415616Z [2024-04-15 02:11:02,360: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:11:02.362932353Z [2024-04-15 02:11:02,362: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:11:02.520195696Z [2024-04-15 02:11:02,519: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:11:02.523844919Z [2024-04-15 02:11:02,523: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:11:02.541119704Z [2024-04-15 02:11:02,540: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:11:02.630611597Z [2024-04-15 02:11:02,630: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:11:02.635123612Z [2024-04-15 02:11:02,634: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:11:02.635140012Z [2024-04-15 02:11:02,635: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:11:02.635256829Z [2024-04-15 02:11:02,635: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:11:02.635390276Z [2024-04-15 02:11:02,635: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:11:02.635491468Z [2024-04-15 02:11:02,635: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:11:02.635537407Z [2024-04-15 02:11:02,635: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:11:02.787639591Z [2024-04-15 02:11:02,787: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:11:04.553712966Z [2024-04-15 02:11:04,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d43674d0-fd0f-4726-8b55-4db56252126a] succeeded in 4.335526800000025s: None 2024-04-15T02:11:05.061542040Z [2024-04-15 02:11:05,061: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d6db426-f66f-48e5-86bb-2bf4fdf35536] succeeded in 4.797736485000314s: None 2024-04-15T02:12:01.249998315Z [2024-04-15 02:12:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb896d22-f068-49d2-8bcb-008dc985ced1] received 2024-04-15T02:12:01.271418751Z [2024-04-15 02:12:01,271: INFO/ForkPoolWorker-15] [eb896d22-f068-49d2-8bcb-008dc985ced1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:12:01.275772603Z [2024-04-15 02:12:01,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee9b34ad-661b-42ad-a5d9-b93366fb977e] received 2024-04-15T02:12:01.288616495Z [2024-04-15 02:12:01,287: INFO/ForkPoolWorker-16] [ee9b34ad-661b-42ad-a5d9-b93366fb977e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:12:01.293583759Z [2024-04-15 02:12:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eab48ce-9d72-4ac1-9447-b6dec3f6b6b5] received 2024-04-15T02:12:01.305822848Z [2024-04-15 02:12:01,305: INFO/ForkPoolWorker-1] [4eab48ce-9d72-4ac1-9447-b6dec3f6b6b5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:12:01.940285701Z [2024-04-15 02:12:01,932: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:12:02.121155853Z [2024-04-15 02:12:02,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:12:02.132777508Z [2024-04-15 02:12:02,128: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:12:02.448758630Z [2024-04-15 02:12:02,448: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:12:03.310122899Z [2024-04-15 02:12:03,307: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4eab48ce-9d72-4ac1-9447-b6dec3f6b6b5] succeeded in 2.0117826159998913s: None 2024-04-15T02:12:04.119910715Z [2024-04-15 02:12:04,119: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:12:04.123242799Z [2024-04-15 02:12:04,122: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:12:04.152670601Z [2024-04-15 02:12:04,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:12:04.155558418Z [2024-04-15 02:12:04,155: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:12:04.155690553Z [2024-04-15 02:12:04,155: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:12:04.155985695Z [2024-04-15 02:12:04,155: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:12:04.156142744Z [2024-04-15 02:12:04,155: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:12:04.156533235Z [2024-04-15 02:12:04,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:12:04.156686545Z [2024-04-15 02:12:04,156: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:12:04.202741855Z [2024-04-15 02:12:04,202: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:12:04.207910671Z [2024-04-15 02:12:04,207: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:12:04.243337028Z [2024-04-15 02:12:04,243: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:12:04.248918280Z [2024-04-15 02:12:04,248: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:12:04.250110865Z [2024-04-15 02:12:04,248: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:12:04.252401188Z [2024-04-15 02:12:04,250: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:12:04.252514239Z [2024-04-15 02:12:04,252: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:12:04.253326001Z [2024-04-15 02:12:04,252: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:12:04.253485102Z [2024-04-15 02:12:04,253: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:12:04.255266005Z [2024-04-15 02:12:04,255: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:12:04.356818299Z [2024-04-15 02:12:04,356: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:12:05.813099197Z [2024-04-15 02:12:05,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb896d22-f068-49d2-8bcb-008dc985ced1] succeeded in 4.559451834999891s: None 2024-04-15T02:12:06.114534062Z [2024-04-15 02:12:06,114: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee9b34ad-661b-42ad-a5d9-b93366fb977e] succeeded in 4.83567504299981s: None 2024-04-15T02:13:00.920266938Z [2024-04-15 02:13:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30eea77f-ac84-427b-84ab-e2b6f4a95a29] received 2024-04-15T02:13:00.932576323Z [2024-04-15 02:13:00,932: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[372d698c-c37e-48db-aeae-efac482d169e] received 2024-04-15T02:13:00.937331333Z [2024-04-15 02:13:00,937: INFO/ForkPoolWorker-15] [30eea77f-ac84-427b-84ab-e2b6f4a95a29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:13:00.949627029Z [2024-04-15 02:13:00,949: INFO/ForkPoolWorker-16] [372d698c-c37e-48db-aeae-efac482d169e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:13:01.364892757Z [2024-04-15 02:13:01,361: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:13:01.381966460Z [2024-04-15 02:13:01,379: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:13:03.174679576Z [2024-04-15 02:13:03,174: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:13:03.178482949Z [2024-04-15 02:13:03,178: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:13:03.204896488Z [2024-04-15 02:13:03,201: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:13:03.209865840Z [2024-04-15 02:13:03,208: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:13:03.222372476Z [2024-04-15 02:13:03,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:13:03.224913810Z [2024-04-15 02:13:03,224: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:13:03.224928395Z [2024-04-15 02:13:03,224: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:13:03.225019052Z [2024-04-15 02:13:03,224: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:13:03.225048152Z [2024-04-15 02:13:03,224: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:13:03.225250679Z [2024-04-15 02:13:03,225: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:13:03.225281301Z [2024-04-15 02:13:03,225: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:13:03.245977583Z [2024-04-15 02:13:03,245: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:13:03.247254977Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:13:03.247265792Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:13:03.247389440Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:13:03.247414973Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:13:03.248025626Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:13:03.248033373Z [2024-04-15 02:13:03,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:13:03.352755810Z [2024-04-15 02:13:03,352: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:13:03.356666425Z [2024-04-15 02:13:03,356: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:13:05.284797035Z [2024-04-15 02:13:05,284: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30eea77f-ac84-427b-84ab-e2b6f4a95a29] succeeded in 4.360295986999972s: None 2024-04-15T02:13:05.500352755Z [2024-04-15 02:13:05,500: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[372d698c-c37e-48db-aeae-efac482d169e] succeeded in 4.565159899000264s: None 2024-04-15T02:14:00.419771251Z [2024-04-15 02:14:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ee19320-a63f-4d41-abf9-b6f3dca65b08] received 2024-04-15T02:14:00.424476853Z [2024-04-15 02:14:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b428750f-1b11-46fa-adf1-dc463eda06a7] received 2024-04-15T02:14:00.428886565Z [2024-04-15 02:14:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8512eec5-73ff-4664-958f-af1a46ced946] received 2024-04-15T02:14:00.438548655Z [2024-04-15 02:14:00,437: INFO/ForkPoolWorker-15] [0ee19320-a63f-4d41-abf9-b6f3dca65b08] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:14:00.443610811Z [2024-04-15 02:14:00,443: INFO/ForkPoolWorker-16] [b428750f-1b11-46fa-adf1-dc463eda06a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:14:00.448523108Z [2024-04-15 02:14:00,448: INFO/ForkPoolWorker-1] [8512eec5-73ff-4664-958f-af1a46ced946] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:14:00.822038816Z [2024-04-15 02:14:00,816: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:14:00.859063889Z [2024-04-15 02:14:00,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:14:00.876406102Z [2024-04-15 02:14:00,871: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:14:01.276914804Z [2024-04-15 02:14:01,276: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:14:02.437783234Z [2024-04-15 02:14:02,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ee19320-a63f-4d41-abf9-b6f3dca65b08] succeeded in 2.0139680620000036s: None 2024-04-15T02:14:02.928720952Z [2024-04-15 02:14:02,926: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:14:02.936486470Z [2024-04-15 02:14:02,932: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:14:03.060659115Z [2024-04-15 02:14:03,053: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:14:03.060686050Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:14:03.060690280Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:14:03.060698594Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:14:03.060702742Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:14:03.060722177Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:14:03.060725397Z [2024-04-15 02:14:03,057: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:14:03.229105128Z [2024-04-15 02:14:03,228: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:14:03.599295920Z [2024-04-15 02:14:03,598: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:14:03.603396711Z [2024-04-15 02:14:03,602: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:14:03.644659575Z [2024-04-15 02:14:03,644: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:14:03.645839885Z [2024-04-15 02:14:03,645: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:14:03.646025811Z [2024-04-15 02:14:03,645: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:14:03.646279520Z [2024-04-15 02:14:03,646: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:14:03.646431369Z [2024-04-15 02:14:03,646: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:14:03.646783867Z [2024-04-15 02:14:03,646: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:14:03.646938131Z [2024-04-15 02:14:03,646: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:14:03.758911007Z [2024-04-15 02:14:03,758: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:14:05.054264919Z [2024-04-15 02:14:05,053: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b428750f-1b11-46fa-adf1-dc463eda06a7] succeeded in 4.620462168999893s: None 2024-04-15T02:14:05.703923610Z [2024-04-15 02:14:05,703: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8512eec5-73ff-4664-958f-af1a46ced946] succeeded in 5.271135494000191s: None 2024-04-15T02:15:00.471968322Z [2024-04-15 02:15:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1d910f1-a071-42a4-a898-200fe68e1ced] received 2024-04-15T02:15:00.474130556Z [2024-04-15 02:15:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df53a60a-e287-4438-998e-eec2ab337776] received 2024-04-15T02:15:00.484822973Z [2024-04-15 02:15:00,484: INFO/ForkPoolWorker-16] [df53a60a-e287-4438-998e-eec2ab337776] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:15:00.486963949Z [2024-04-15 02:15:00,486: INFO/ForkPoolWorker-15] [f1d910f1-a071-42a4-a898-200fe68e1ced] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:00.491100665Z [2024-04-15 02:15:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15b854fb-f83e-4f06-acb2-758cd242602b] received 2024-04-15T02:15:00.509501785Z [2024-04-15 02:15:00,509: INFO/ForkPoolWorker-1] [15b854fb-f83e-4f06-acb2-758cd242602b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:15:00.866926124Z [2024-04-15 02:15:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:15:01.025059465Z [2024-04-15 02:15:01,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:15:01.166929584Z [2024-04-15 02:15:01,163: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:15:03.071636866Z [2024-04-15 02:15:03,071: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:15:03.074975050Z [2024-04-15 02:15:03,074: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:03.134328537Z [2024-04-15 02:15:03,134: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:15:03.138182966Z [2024-04-15 02:15:03,137: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:03.138840794Z [2024-04-15 02:15:03,138: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:03.138991257Z [2024-04-15 02:15:03,138: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:03.139175460Z [2024-04-15 02:15:03,139: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:15:03.140088673Z [2024-04-15 02:15:03,139: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:15:03.140105338Z [2024-04-15 02:15:03,140: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:03.359479388Z [2024-04-15 02:15:03,359: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:03.563249711Z [2024-04-15 02:15:03,562: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:15:03.580610051Z [2024-04-15 02:15:03,580: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:03.604020176Z [2024-04-15 02:15:03,603: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:15:03.609876483Z [2024-04-15 02:15:03,608: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:03.657114125Z [2024-04-15 02:15:03,656: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:15:03.659589604Z [2024-04-15 02:15:03,659: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:03.660051430Z [2024-04-15 02:15:03,659: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:03.660221539Z [2024-04-15 02:15:03,660: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:03.660310894Z [2024-04-15 02:15:03,660: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:15:03.660580862Z [2024-04-15 02:15:03,660: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:15:03.660650017Z [2024-04-15 02:15:03,660: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:03.678871797Z [2024-04-15 02:15:03,678: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:15:03.680191320Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:03.680255036Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:03.680431901Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:03.680518442Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:15:03.680771820Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:15:03.680844215Z [2024-04-15 02:15:03,680: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:03.791235032Z [2024-04-15 02:15:03,791: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:03.869994013Z [2024-04-15 02:15:03,866: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:04.691251166Z [2024-04-15 02:15:04,690: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f1d910f1-a071-42a4-a898-200fe68e1ced] succeeded in 4.216703731000052s: None 2024-04-15T02:15:05.350045474Z [2024-04-15 02:15:05,349: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15b854fb-f83e-4f06-acb2-758cd242602b] succeeded in 4.856688499000029s: None 2024-04-15T02:15:05.518392684Z [2024-04-15 02:15:05,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a07ef77-2763-488b-bb53-1227e1d02eeb] received 2024-04-15T02:15:05.531009030Z [2024-04-15 02:15:05,530: INFO/ForkPoolWorker-15] [5a07ef77-2763-488b-bb53-1227e1d02eeb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:05.891859698Z [2024-04-15 02:15:05,891: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df53a60a-e287-4438-998e-eec2ab337776] succeeded in 5.416002785999808s: None 2024-04-15T02:15:05.927110395Z [2024-04-15 02:15:05,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:15:07.205578846Z [2024-04-15 02:15:07,205: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:15:07.212589289Z [2024-04-15 02:15:07,211: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:07.240741089Z [2024-04-15 02:15:07,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:15:07.241864202Z [2024-04-15 02:15:07,241: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:07.241877791Z [2024-04-15 02:15:07,241: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:07.242077503Z [2024-04-15 02:15:07,241: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:07.242088835Z [2024-04-15 02:15:07,242: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:15:07.242279962Z [2024-04-15 02:15:07,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:15:07.242290179Z [2024-04-15 02:15:07,242: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:07.329859374Z [2024-04-15 02:15:07,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:07.936945482Z [2024-04-15 02:15:07,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b12ccd9-bdf5-459b-9062-68ef54504d31] received 2024-04-15T02:15:07.942994660Z [2024-04-15 02:15:07,942: INFO/ForkPoolWorker-16] [9b12ccd9-bdf5-459b-9062-68ef54504d31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:15:07.977686442Z [2024-04-15 02:15:07,977: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a07ef77-2763-488b-bb53-1227e1d02eeb] succeeded in 2.457160047000343s: None 2024-04-15T02:15:08.216059358Z [2024-04-15 02:15:08,212: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:15:09.453679103Z [2024-04-15 02:15:09,453: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:15:09.469241615Z [2024-04-15 02:15:09,468: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:09.503888747Z [2024-04-15 02:15:09,503: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:15:09.505284061Z [2024-04-15 02:15:09,505: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:09.505441505Z [2024-04-15 02:15:09,505: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:09.505638219Z [2024-04-15 02:15:09,505: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:09.505798572Z [2024-04-15 02:15:09,505: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:15:09.506156720Z [2024-04-15 02:15:09,506: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:15:09.506338827Z [2024-04-15 02:15:09,506: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:09.601963247Z [2024-04-15 02:15:09,601: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:10.211581799Z [2024-04-15 02:15:10,210: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b12ccd9-bdf5-459b-9062-68ef54504d31] succeeded in 2.272984054999597s: None 2024-04-15T02:15:10.504172534Z [2024-04-15 02:15:10,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30906bf8-5463-47a2-ad54-bf0e2831e14b] received 2024-04-15T02:15:10.515520155Z [2024-04-15 02:15:10,515: INFO/ForkPoolWorker-15] [30906bf8-5463-47a2-ad54-bf0e2831e14b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:15:10.874315656Z [2024-04-15 02:15:10,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:15:12.333565784Z [2024-04-15 02:15:12,333: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:15:12.336892657Z [2024-04-15 02:15:12,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:12.371427490Z [2024-04-15 02:15:12,371: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:15:12.374421662Z [2024-04-15 02:15:12,374: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:15:12.374709047Z [2024-04-15 02:15:12,374: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:15:12.375037331Z [2024-04-15 02:15:12,374: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:15:12.375232486Z [2024-04-15 02:15:12,375: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:15:12.375557789Z [2024-04-15 02:15:12,375: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:15:12.375818438Z [2024-04-15 02:15:12,375: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:15:12.487613800Z [2024-04-15 02:15:12,486: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:13.109519190Z [2024-04-15 02:15:13,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[30906bf8-5463-47a2-ad54-bf0e2831e14b] succeeded in 2.603276079999887s: None 2024-04-15T02:15:51.114063036Z [2024-04-15 02:15:51,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72e07d33-a090-4601-ab8f-04b75c7a70ca] received 2024-04-15T02:15:51.124436626Z [2024-04-15 02:15:51,124: INFO/ForkPoolWorker-15] [72e07d33-a090-4601-ab8f-04b75c7a70ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:15:51.445599235Z [2024-04-15 02:15:51,441: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:15:51.660230452Z [2024-04-15 02:15:51,659: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-15T02:15:51.664047444Z [2024-04-15 02:15:51,663: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:15:51.707225987Z [2024-04-15 02:15:51,707: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:15:51.708214478Z [2024-04-15 02:15:51,708: INFO/ForkPoolWorker-15] Read SDNC 401daba8-8d62-4977-8378-2331cffeb528 (epa_03) 2024-04-15T02:15:51.708315050Z [2024-04-15 02:15:51,708: INFO/ForkPoolWorker-15] [{'_id': '401daba8-8d62-4977-8378-2331cffeb528', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-15T02:15:51.708394127Z [2024-04-15 02:15:51,708: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-15T02:15:51.708624320Z [2024-04-15 02:15:51,708: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 2024-04-15T02:15:51.829139572Z [2024-04-15 02:15:51,824: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:15:52.430596528Z [2024-04-15 02:15:52,430: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[72e07d33-a090-4601-ab8f-04b75c7a70ca] succeeded in 1.3143641460001163s: None 2024-04-15T02:16:00.321553843Z [2024-04-15 02:16:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ddb8b45-b779-4e0e-8dae-9967b2d012e9] received 2024-04-15T02:16:00.331446551Z [2024-04-15 02:16:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62338402-e332-4ac9-ab95-d1946731a388] received 2024-04-15T02:16:00.333019872Z [2024-04-15 02:16:00,332: INFO/ForkPoolWorker-15] [2ddb8b45-b779-4e0e-8dae-9967b2d012e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:16:00.333522556Z [2024-04-15 02:16:00,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c60361b2-a888-4895-9838-dba267338d3a] received 2024-04-15T02:16:00.348925353Z [2024-04-15 02:16:00,348: INFO/ForkPoolWorker-16] [62338402-e332-4ac9-ab95-d1946731a388] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:16:00.355440173Z [2024-04-15 02:16:00,355: INFO/ForkPoolWorker-1] [c60361b2-a888-4895-9838-dba267338d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:16:00.362592802Z [2024-04-15 02:16:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1691584-937b-446a-bf2c-d0c123bc4838] received 2024-04-15T02:16:00.375124090Z [2024-04-15 02:16:00,374: INFO/ForkPoolWorker-2] [a1691584-937b-446a-bf2c-d0c123bc4838] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:16:00.760187199Z [2024-04-15 02:16:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:16:00.821617228Z [2024-04-15 02:16:00,814: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:16:00.861986249Z [2024-04-15 02:16:00,850: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:16:00.876025258Z [2024-04-15 02:16:00,861: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:16:01.130522314Z [2024-04-15 02:16:01,130: INFO/ForkPoolWorker-16] Getting SDNC list 2024-04-15T02:16:01.135070031Z [2024-04-15 02:16:01,134: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:16:01.236176198Z [2024-04-15 02:16:01,235: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:16:01.236504957Z [2024-04-15 02:16:01,236: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:16:01.250378370Z [2024-04-15 02:16:01,250: INFO/ForkPoolWorker-16] Read SDNC 401daba8-8d62-4977-8378-2331cffeb528 (epa_03) 2024-04-15T02:16:01.250416341Z [2024-04-15 02:16:01,250: INFO/ForkPoolWorker-16] [{'_id': '401daba8-8d62-4977-8378-2331cffeb528', 'name': 'epa_03', 'type': 'onos_vpls'}] 2024-04-15T02:16:01.250924203Z [2024-04-15 02:16:01,250: INFO/ForkPoolWorker-16] Getting SDNC list OK 2024-04-15T02:16:01.262594880Z [2024-04-15 02:16:01,262: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_401daba8-8d62-4977-8378-2331cffeb528 2024-04-15T02:16:01.459391757Z [2024-04-15 02:16:01,459: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:16:02.426999132Z [2024-04-15 02:16:02,426: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c60361b2-a888-4895-9838-dba267338d3a] succeeded in 2.083913790999759s: None 2024-04-15T02:16:02.573166974Z [2024-04-15 02:16:02,572: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[62338402-e332-4ac9-ab95-d1946731a388] succeeded in 2.2378588179999497s: None 2024-04-15T02:16:02.987356179Z [2024-04-15 02:16:02,987: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:16:03.000080664Z [2024-04-15 02:16:02,995: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:16:03.084851635Z [2024-04-15 02:16:03,084: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:16:03.086138082Z [2024-04-15 02:16:03,085: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:16:03.086264660Z [2024-04-15 02:16:03,086: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:16:03.086436754Z [2024-04-15 02:16:03,086: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:16:03.086543564Z [2024-04-15 02:16:03,086: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:16:03.086877164Z [2024-04-15 02:16:03,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:16:03.087046580Z [2024-04-15 02:16:03,086: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:16:03.098602049Z [2024-04-15 02:16:03,098: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:16:03.101671726Z [2024-04-15 02:16:03,101: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:16:03.177520925Z [2024-04-15 02:16:03,177: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:16:03.179040980Z [2024-04-15 02:16:03,178: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:16:03.179072877Z [2024-04-15 02:16:03,178: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:16:03.179237925Z [2024-04-15 02:16:03,179: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:16:03.183152403Z [2024-04-15 02:16:03,179: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:16:03.183588735Z [2024-04-15 02:16:03,183: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:16:03.185560818Z [2024-04-15 02:16:03,183: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:16:03.201291327Z [2024-04-15 02:16:03,201: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:16:03.301019700Z [2024-04-15 02:16:03,300: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:16:05.763058912Z [2024-04-15 02:16:05,762: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2ddb8b45-b779-4e0e-8dae-9967b2d012e9] succeeded in 5.43827722900005s: None 2024-04-15T02:16:06.148803798Z [2024-04-15 02:16:06,148: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a1691584-937b-446a-bf2c-d0c123bc4838] succeeded in 5.78309893200003s: None 2024-04-15T02:17:01.168752925Z [2024-04-15 02:17:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d161c39-1102-41fe-928c-a988cf3642e4] received 2024-04-15T02:17:01.181236625Z [2024-04-15 02:17:01,180: INFO/ForkPoolWorker-15] [9d161c39-1102-41fe-928c-a988cf3642e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:17:01.189066101Z [2024-04-15 02:17:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4994b4a8-6458-4c43-a52a-6cf64fb5aed9] received 2024-04-15T02:17:01.199244268Z [2024-04-15 02:17:01,199: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9758cb5-d763-4dca-8db4-56b48e339655] received 2024-04-15T02:17:01.200326720Z [2024-04-15 02:17:01,200: INFO/ForkPoolWorker-16] [4994b4a8-6458-4c43-a52a-6cf64fb5aed9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:17:01.212563376Z [2024-04-15 02:17:01,212: INFO/ForkPoolWorker-1] [e9758cb5-d763-4dca-8db4-56b48e339655] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:17:01.589279143Z [2024-04-15 02:17:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:01.651232643Z [2024-04-15 02:17:01,647: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:17:01.743785478Z [2024-04-15 02:17:01,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:17:01.834224023Z [2024-04-15 02:17:01,829: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-15T02:17:01.844601591Z [2024-04-15 02:17:01,844: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:01.948091704Z [2024-04-15 02:17:01,947: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:17:01.949018851Z [2024-04-15 02:17:01,948: INFO/ForkPoolWorker-15] [] 2024-04-15T02:17:01.949462342Z [2024-04-15 02:17:01,948: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-15T02:17:01.952302510Z [2024-04-15 02:17:01,951: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:01.954077356Z [2024-04-15 02:17:01,952: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:01.954090514Z [2024-04-15 02:17:01,953: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-15T02:17:01.956987525Z [2024-04-15 02:17:01,956: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:02.029458868Z [2024-04-15 02:17:02,029: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:17:02.044523356Z [2024-04-15 02:17:02,044: INFO/ForkPoolWorker-15] [] 2024-04-15T02:17:02.044726025Z [2024-04-15 02:17:02,044: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-15T02:17:02.045652163Z [2024-04-15 02:17:02,045: ERROR/ForkPoolWorker-15] [9d161c39-1102-41fe-928c-a988cf3642e4] Failed to execute task Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:17:02.045662566Z Traceback (most recent call last): 2024-04-15T02:17:02.045685717Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:17:02.045689386Z args.func(args) 2024-04-15T02:17:02.045693314Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:17:02.045718627Z return func(*args, **kwargs) 2024-04-15T02:17:02.045722635Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:17:02.045725446Z return f(*args, **kwargs) 2024-04-15T02:17:02.045728268Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:17:02.045731035Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:17:02.045733775Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:17:02.045736463Z raise AirflowException( 2024-04-15T02:17:02.045739910Z airflow.exceptions.AirflowException: Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:17:02.066940707Z [2024-04-15 02:17:02,066: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d161c39-1102-41fe-928c-a988cf3642e4] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9d161c39-1102-41fe-928c-a988cf3642e4') 2024-04-15T02:17:02.066954155Z Traceback (most recent call last): 2024-04-15T02:17:02.066957785Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:17:02.066960656Z R = retval = fun(*args, **kwargs) 2024-04-15T02:17:02.066963467Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:17:02.066966422Z return self.run(*args, **kwargs) 2024-04-15T02:17:02.066969726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:17:02.066973195Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:17:02.066975977Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:17:02.066979125Z raise AirflowException(msg) 2024-04-15T02:17:02.067015019Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 9d161c39-1102-41fe-928c-a988cf3642e4 2024-04-15T02:17:03.366294526Z [2024-04-15 02:17:03,365: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:17:03.372069073Z [2024-04-15 02:17:03,371: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:03.399489976Z [2024-04-15 02:17:03,399: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:17:03.402824057Z [2024-04-15 02:17:03,402: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:17:03.403984553Z [2024-04-15 02:17:03,403: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:17:03.404458692Z [2024-04-15 02:17:03,404: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:17:03.404574980Z [2024-04-15 02:17:03,404: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:17:03.405592850Z [2024-04-15 02:17:03,404: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:17:03.405771173Z [2024-04-15 02:17:03,405: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:17:03.501467434Z [2024-04-15 02:17:03,501: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:17:03.508445528Z [2024-04-15 02:17:03,508: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:17:03.512242663Z [2024-04-15 02:17:03,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:03.569447049Z [2024-04-15 02:17:03,569: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:17:03.572778366Z [2024-04-15 02:17:03,572: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:17:03.572811563Z [2024-04-15 02:17:03,572: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:17:03.572893984Z [2024-04-15 02:17:03,572: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:17:03.572908762Z [2024-04-15 02:17:03,572: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:17:03.573159967Z [2024-04-15 02:17:03,573: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:17:03.573167622Z [2024-04-15 02:17:03,573: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:17:03.656448916Z [2024-04-15 02:17:03,656: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:17:05.648150994Z [2024-04-15 02:17:05,647: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4994b4a8-6458-4c43-a52a-6cf64fb5aed9] succeeded in 4.456756858999597s: None 2024-04-15T02:17:05.757639264Z [2024-04-15 02:17:05,757: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9758cb5-d763-4dca-8db4-56b48e339655] succeeded in 4.551687662999939s: None 2024-04-15T02:17:13.622264341Z [2024-04-15 02:17:13,622: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65114347-98cc-42c7-af64-ead7f0d25fb3] received 2024-04-15T02:17:13.630064722Z [2024-04-15 02:17:13,629: INFO/ForkPoolWorker-15] [65114347-98cc-42c7-af64-ead7f0d25fb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py'] 2024-04-15T02:17:14.039071361Z [2024-04-15 02:17:14,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:14.255814894Z [2024-04-15 02:17:14,255: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-15T02:17:14.260029103Z [2024-04-15 02:17:14,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:14.299168928Z [2024-04-15 02:17:14,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:17:14.302402076Z [2024-04-15 02:17:14,302: INFO/ForkPoolWorker-15] [] 2024-04-15T02:17:14.302572716Z [2024-04-15 02:17:14,302: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-15T02:17:14.304864985Z [2024-04-15 02:17:14,304: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:14.305358555Z [2024-04-15 02:17:14,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py 2024-04-15T02:17:14.306461988Z [2024-04-15 02:17:14,306: INFO/ForkPoolWorker-15] Getting SDNC list 2024-04-15T02:17:14.311592965Z [2024-04-15 02:17:14,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:17:14.338518994Z [2024-04-15 02:17:14,338: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:17:14.339417773Z [2024-04-15 02:17:14,339: INFO/ForkPoolWorker-15] [] 2024-04-15T02:17:14.339431526Z [2024-04-15 02:17:14,339: INFO/ForkPoolWorker-15] Getting SDNC list OK 2024-04-15T02:17:14.340109624Z [2024-04-15 02:17:14,339: ERROR/ForkPoolWorker-15] [65114347-98cc-42c7-af64-ead7f0d25fb3] Failed to execute task Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:17:14.340116074Z Traceback (most recent call last): 2024-04-15T02:17:14.340119726Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:17:14.340123179Z args.func(args) 2024-04-15T02:17:14.340126965Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:17:14.340130532Z return func(*args, **kwargs) 2024-04-15T02:17:14.340133712Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:17:14.340136702Z return f(*args, **kwargs) 2024-04-15T02:17:14.340139685Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:17:14.340142635Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:17:14.340145621Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:17:14.340148693Z raise AirflowException( 2024-04-15T02:17:14.340152799Z airflow.exceptions.AirflowException: Dag 'sdnc_status_401daba8-8d62-4977-8378-2331cffeb528' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:17:14.374508504Z [2024-04-15 02:17:14,373: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65114347-98cc-42c7-af64-ead7f0d25fb3] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 65114347-98cc-42c7-af64-ead7f0d25fb3') 2024-04-15T02:17:14.374526036Z Traceback (most recent call last): 2024-04-15T02:17:14.374531061Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:17:14.374590470Z R = retval = fun(*args, **kwargs) 2024-04-15T02:17:14.374595355Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:17:14.374599530Z return self.run(*args, **kwargs) 2024-04-15T02:17:14.374604375Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:17:14.374608757Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:17:14.374612952Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:17:14.374617127Z raise AirflowException(msg) 2024-04-15T02:17:14.374621653Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 65114347-98cc-42c7-af64-ead7f0d25fb3 2024-04-15T02:18:01.024797373Z [2024-04-15 02:18:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c156579a-9145-44da-9e82-741b5e55f6ff] received 2024-04-15T02:18:01.027874621Z [2024-04-15 02:18:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9c4d266-45df-422a-b880-b3a26ea194b4] received 2024-04-15T02:18:01.046253642Z [2024-04-15 02:18:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d12ffcf-5e4f-4380-bb3e-a139af40c0a7] received 2024-04-15T02:18:01.052837059Z [2024-04-15 02:18:01,052: INFO/ForkPoolWorker-15] [c156579a-9145-44da-9e82-741b5e55f6ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:18:01.057803983Z [2024-04-15 02:18:01,057: INFO/ForkPoolWorker-16] [e9c4d266-45df-422a-b880-b3a26ea194b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:18:01.058677044Z [2024-04-15 02:18:01,058: INFO/ForkPoolWorker-1] [5d12ffcf-5e4f-4380-bb3e-a139af40c0a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:18:01.594147844Z [2024-04-15 02:18:01,587: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:18:01.685346353Z [2024-04-15 02:18:01,681: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:18:01.919061527Z [2024-04-15 02:18:01,888: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:18:01.998819036Z [2024-04-15 02:18:01,995: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:18:02.922568428Z [2024-04-15 02:18:02,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c156579a-9145-44da-9e82-741b5e55f6ff] succeeded in 1.8931147019998207s: None 2024-04-15T02:18:03.439867831Z [2024-04-15 02:18:03,439: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:18:03.443357556Z [2024-04-15 02:18:03,442: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:18:03.475415464Z [2024-04-15 02:18:03,475: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:18:03.490927051Z [2024-04-15 02:18:03,490: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:18:03.491293606Z [2024-04-15 02:18:03,491: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:18:03.491613852Z [2024-04-15 02:18:03,491: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:18:03.491817357Z [2024-04-15 02:18:03,491: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:18:03.492292876Z [2024-04-15 02:18:03,492: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:18:03.492670969Z [2024-04-15 02:18:03,492: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:18:03.601199143Z [2024-04-15 02:18:03,600: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:18:03.787333881Z [2024-04-15 02:18:03,786: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:18:03.797213582Z [2024-04-15 02:18:03,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:18:03.884329609Z [2024-04-15 02:18:03,884: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:18:03.886353981Z [2024-04-15 02:18:03,885: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:18:03.886386779Z [2024-04-15 02:18:03,886: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:18:03.886503718Z [2024-04-15 02:18:03,886: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:18:03.886536976Z [2024-04-15 02:18:03,886: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:18:03.886718001Z [2024-04-15 02:18:03,886: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:18:03.886746884Z [2024-04-15 02:18:03,886: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:18:04.013199609Z [2024-04-15 02:18:04,012: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:18:05.291966797Z [2024-04-15 02:18:05,291: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e9c4d266-45df-422a-b880-b3a26ea194b4] succeeded in 4.261442583000189s: None 2024-04-15T02:18:05.884527694Z [2024-04-15 02:18:05,883: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d12ffcf-5e4f-4380-bb3e-a139af40c0a7] succeeded in 4.835977468000237s: None 2024-04-15T02:19:00.475378813Z [2024-04-15 02:19:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d210331c-d1d5-448e-8ba2-47ac14967932] received 2024-04-15T02:19:00.480799330Z [2024-04-15 02:19:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b9e7aff-32e0-41c3-8ef3-dba11fe560e7] received 2024-04-15T02:19:00.491898840Z [2024-04-15 02:19:00,491: INFO/ForkPoolWorker-15] [d210331c-d1d5-448e-8ba2-47ac14967932] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:19:00.493265196Z [2024-04-15 02:19:00,492: INFO/ForkPoolWorker-16] [6b9e7aff-32e0-41c3-8ef3-dba11fe560e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:19:00.826606800Z [2024-04-15 02:19:00,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:19:00.829758048Z [2024-04-15 02:19:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:19:02.400874809Z [2024-04-15 02:19:02,400: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:19:02.404479302Z [2024-04-15 02:19:02,404: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:19:02.483040753Z [2024-04-15 02:19:02,482: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:19:02.491170557Z [2024-04-15 02:19:02,490: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:19:02.491321071Z [2024-04-15 02:19:02,491: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:19:02.491523906Z [2024-04-15 02:19:02,491: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:19:02.491679733Z [2024-04-15 02:19:02,491: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:19:02.492097670Z [2024-04-15 02:19:02,491: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:19:02.492279860Z [2024-04-15 02:19:02,492: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:19:02.493767196Z [2024-04-15 02:19:02,493: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:19:02.497060513Z [2024-04-15 02:19:02,496: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:19:02.614761572Z [2024-04-15 02:19:02,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:19:02.619000223Z [2024-04-15 02:19:02,618: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:19:02.619030893Z [2024-04-15 02:19:02,618: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:19:02.619247445Z [2024-04-15 02:19:02,618: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:19:02.619534865Z [2024-04-15 02:19:02,619: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:19:02.619815559Z [2024-04-15 02:19:02,619: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:19:02.619869488Z [2024-04-15 02:19:02,619: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:19:02.670794620Z [2024-04-15 02:19:02,670: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:19:02.760156213Z [2024-04-15 02:19:02,759: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:19:04.430666091Z [2024-04-15 02:19:04,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b9e7aff-32e0-41c3-8ef3-dba11fe560e7] succeeded in 3.946904480000285s: None 2024-04-15T02:19:05.252805869Z [2024-04-15 02:19:05,252: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d210331c-d1d5-448e-8ba2-47ac14967932] succeeded in 4.773202383999887s: None 2024-04-15T02:20:00.523161904Z [2024-04-15 02:20:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0ae9a57-1a3d-4095-8ef5-620d03e520f2] received 2024-04-15T02:20:00.527561531Z [2024-04-15 02:20:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01d4e27a-389a-4fbb-ae2c-3027f9be18dc] received 2024-04-15T02:20:00.532505105Z [2024-04-15 02:20:00,532: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd930016-886b-4149-9b56-b3baf196b292] received 2024-04-15T02:20:00.537038237Z [2024-04-15 02:20:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3c48da3-7fb8-433e-b1cb-55e533eb0d40] received 2024-04-15T02:20:00.544768022Z [2024-04-15 02:20:00,544: INFO/ForkPoolWorker-15] [d0ae9a57-1a3d-4095-8ef5-620d03e520f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:20:00.546748946Z [2024-04-15 02:20:00,546: INFO/ForkPoolWorker-16] [01d4e27a-389a-4fbb-ae2c-3027f9be18dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:00.547877296Z [2024-04-15 02:20:00,547: INFO/ForkPoolWorker-1] [fd930016-886b-4149-9b56-b3baf196b292] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:20:00.558837881Z [2024-04-15 02:20:00,558: INFO/ForkPoolWorker-2] [d3c48da3-7fb8-433e-b1cb-55e533eb0d40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:20:01.121117580Z [2024-04-15 02:20:01,117: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:20:01.146542523Z [2024-04-15 02:20:01,141: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:20:01.299662362Z [2024-04-15 02:20:01,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:20:01.773214534Z [2024-04-15 02:20:01,769: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:20:02.209884867Z [2024-04-15 02:20:02,205: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:03.303064801Z [2024-04-15 02:20:03,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fd930016-886b-4149-9b56-b3baf196b292] succeeded in 2.7659908420000647s: None 2024-04-15T02:20:03.640256277Z [2024-04-15 02:20:03,639: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:20:03.643603604Z [2024-04-15 02:20:03,643: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:03.686158774Z [2024-04-15 02:20:03,685: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:20:03.689973605Z [2024-04-15 02:20:03,689: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:03.705327236Z [2024-04-15 02:20:03,705: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:20:03.706541667Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:03.706594910Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:03.706674403Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:03.706720645Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:20:03.706931698Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:20:03.706968653Z [2024-04-15 02:20:03,706: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:03.727697062Z [2024-04-15 02:20:03,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:20:03.729055763Z [2024-04-15 02:20:03,728: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:03.729291335Z [2024-04-15 02:20:03,729: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:03.729517375Z [2024-04-15 02:20:03,729: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:03.729680598Z [2024-04-15 02:20:03,729: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:20:03.731296839Z [2024-04-15 02:20:03,729: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:20:03.732191240Z [2024-04-15 02:20:03,731: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:03.752570051Z [2024-04-15 02:20:03,752: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:20:03.756599803Z [2024-04-15 02:20:03,756: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:03.790032508Z [2024-04-15 02:20:03,789: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:03.802228859Z [2024-04-15 02:20:03,802: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:20:03.803264676Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:03.803298431Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:03.803413186Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:03.803445113Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:20:03.803694586Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:20:03.803770238Z [2024-04-15 02:20:03,803: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:03.924676859Z [2024-04-15 02:20:03,924: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:03.972960855Z [2024-04-15 02:20:03,972: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:04.823987050Z [2024-04-15 02:20:04,816: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01d4e27a-389a-4fbb-ae2c-3027f9be18dc] succeeded in 4.286339677000342s: None 2024-04-15T02:20:05.418476834Z [2024-04-15 02:20:05,418: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d0ae9a57-1a3d-4095-8ef5-620d03e520f2] succeeded in 4.8913037470001655s: None 2024-04-15T02:20:05.522258438Z [2024-04-15 02:20:05,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7423bf4b-5e7f-4ff5-81c5-61a47e24f359] received 2024-04-15T02:20:05.533094735Z [2024-04-15 02:20:05,532: INFO/ForkPoolWorker-15] [7423bf4b-5e7f-4ff5-81c5-61a47e24f359] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:05.866998741Z [2024-04-15 02:20:05,862: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:20:07.000405469Z [2024-04-15 02:20:07,000: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3c48da3-7fb8-433e-b1cb-55e533eb0d40] succeeded in 6.460774426999706s: None 2024-04-15T02:20:07.049459480Z [2024-04-15 02:20:07,049: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:20:07.053786832Z [2024-04-15 02:20:07,052: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:07.074875711Z [2024-04-15 02:20:07,074: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:20:07.076453038Z [2024-04-15 02:20:07,076: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:07.076823944Z [2024-04-15 02:20:07,076: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:07.077426583Z [2024-04-15 02:20:07,077: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:07.077714569Z [2024-04-15 02:20:07,077: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:20:07.078031154Z [2024-04-15 02:20:07,077: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:20:07.078598032Z [2024-04-15 02:20:07,078: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:07.153559307Z [2024-04-15 02:20:07,153: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:07.783443592Z [2024-04-15 02:20:07,783: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7423bf4b-5e7f-4ff5-81c5-61a47e24f359] succeeded in 2.259415203000117s: None 2024-04-15T02:20:07.924585267Z [2024-04-15 02:20:07,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc26174e-4332-4e2c-91df-8492e9c623cf] received 2024-04-15T02:20:07.933666149Z [2024-04-15 02:20:07,933: INFO/ForkPoolWorker-15] [dc26174e-4332-4e2c-91df-8492e9c623cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:20:08.226354666Z [2024-04-15 02:20:08,223: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:20:09.597544560Z [2024-04-15 02:20:09,597: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:20:09.605139543Z [2024-04-15 02:20:09,604: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:09.654932551Z [2024-04-15 02:20:09,654: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:20:09.657572105Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:09.657605065Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:09.657710584Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:09.657734167Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:20:09.657986919Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:20:09.657994982Z [2024-04-15 02:20:09,657: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:09.780495874Z [2024-04-15 02:20:09,780: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:10.379124492Z [2024-04-15 02:20:10,378: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc26174e-4332-4e2c-91df-8492e9c623cf] succeeded in 2.4514830050002274s: None 2024-04-15T02:20:10.725117068Z [2024-04-15 02:20:10,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f4510c5-c234-48cb-9cf3-bf0ecdf4cdb8] received 2024-04-15T02:20:10.732626508Z [2024-04-15 02:20:10,732: INFO/ForkPoolWorker-15] [0f4510c5-c234-48cb-9cf3-bf0ecdf4cdb8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:20:11.048683510Z [2024-04-15 02:20:11,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:20:12.367046801Z [2024-04-15 02:20:12,366: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:20:12.370665279Z [2024-04-15 02:20:12,370: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:20:12.408909812Z [2024-04-15 02:20:12,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:20:12.411262793Z [2024-04-15 02:20:12,410: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:20:12.414087406Z [2024-04-15 02:20:12,411: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:20:12.414455508Z [2024-04-15 02:20:12,414: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:20:12.415270093Z [2024-04-15 02:20:12,414: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:20:12.415716262Z [2024-04-15 02:20:12,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:20:12.416232059Z [2024-04-15 02:20:12,416: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:20:12.518814091Z [2024-04-15 02:20:12,518: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:20:13.186952916Z [2024-04-15 02:20:13,186: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0f4510c5-c234-48cb-9cf3-bf0ecdf4cdb8] succeeded in 2.4595989630001895s: None 2024-04-15T02:21:00.418186725Z [2024-04-15 02:21:00,417: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[744e5d1c-b302-4390-933b-37e810baef50] received 2024-04-15T02:21:00.425818962Z [2024-04-15 02:21:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3dd7a8c-3828-459d-b5a1-af8f05ef441c] received 2024-04-15T02:21:00.434392221Z [2024-04-15 02:21:00,434: INFO/ForkPoolWorker-15] [744e5d1c-b302-4390-933b-37e810baef50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:21:00.440321599Z [2024-04-15 02:21:00,440: INFO/ForkPoolWorker-16] [c3dd7a8c-3828-459d-b5a1-af8f05ef441c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:21:00.715835491Z [2024-04-15 02:21:00,712: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:21:00.780344920Z [2024-04-15 02:21:00,775: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:21:02.344913392Z [2024-04-15 02:21:02,344: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:21:02.348503794Z [2024-04-15 02:21:02,348: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:21:02.425283447Z [2024-04-15 02:21:02,425: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:21:02.445084117Z [2024-04-15 02:21:02,444: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:21:02.445230130Z [2024-04-15 02:21:02,445: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:21:02.445827493Z [2024-04-15 02:21:02,445: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:21:02.445964598Z [2024-04-15 02:21:02,445: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:21:02.446277482Z [2024-04-15 02:21:02,446: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:21:02.446782708Z [2024-04-15 02:21:02,446: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:21:02.455382152Z [2024-04-15 02:21:02,455: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:21:02.461999431Z [2024-04-15 02:21:02,461: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:21:02.547386502Z [2024-04-15 02:21:02,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:21:02.549608536Z [2024-04-15 02:21:02,549: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:21:02.549624095Z [2024-04-15 02:21:02,549: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:21:02.549733786Z [2024-04-15 02:21:02,549: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:21:02.549810761Z [2024-04-15 02:21:02,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:21:02.550731409Z [2024-04-15 02:21:02,550: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:21:02.550743128Z [2024-04-15 02:21:02,550: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:21:02.605817151Z [2024-04-15 02:21:02,605: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:21:02.658352627Z [2024-04-15 02:21:02,658: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:21:04.275477771Z [2024-04-15 02:21:04,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[744e5d1c-b302-4390-933b-37e810baef50] succeeded in 3.85119487799966s: None 2024-04-15T02:21:04.769726778Z [2024-04-15 02:21:04,769: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3dd7a8c-3828-459d-b5a1-af8f05ef441c] succeeded in 4.340456638000433s: None 2024-04-15T02:22:00.401866001Z [2024-04-15 02:22:00,401: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3898e891-c38b-429f-b6d0-655c20e287df] received 2024-04-15T02:22:00.405691883Z [2024-04-15 02:22:00,405: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[285d2971-6f4b-4ddf-9a1a-29e68c85bbdb] received 2024-04-15T02:22:00.414482197Z [2024-04-15 02:22:00,414: INFO/ForkPoolWorker-15] [3898e891-c38b-429f-b6d0-655c20e287df] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:22:00.415529816Z [2024-04-15 02:22:00,415: INFO/ForkPoolWorker-16] [285d2971-6f4b-4ddf-9a1a-29e68c85bbdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:22:00.421474759Z [2024-04-15 02:22:00,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2664176a-8f06-46a6-ab6f-423515e3f0d6] received 2024-04-15T02:22:00.441455388Z [2024-04-15 02:22:00,440: INFO/ForkPoolWorker-1] [2664176a-8f06-46a6-ab6f-423515e3f0d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:22:00.869462995Z [2024-04-15 02:22:00,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:22:00.963552725Z [2024-04-15 02:22:00,959: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:22:00.985660561Z [2024-04-15 02:22:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:22:01.417883734Z [2024-04-15 02:22:01,417: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:22:02.228668349Z [2024-04-15 02:22:02,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3898e891-c38b-429f-b6d0-655c20e287df] succeeded in 1.8227340809999077s: None 2024-04-15T02:22:03.051615298Z [2024-04-15 02:22:03,051: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:22:03.054841346Z [2024-04-15 02:22:03,054: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:22:03.095541430Z [2024-04-15 02:22:03,095: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:22:03.096639811Z [2024-04-15 02:22:03,096: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:22:03.096655630Z [2024-04-15 02:22:03,096: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:22:03.096865424Z [2024-04-15 02:22:03,096: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:22:03.096903447Z [2024-04-15 02:22:03,096: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:22:03.097703131Z [2024-04-15 02:22:03,097: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:22:03.097720440Z [2024-04-15 02:22:03,097: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:22:03.165724612Z [2024-04-15 02:22:03,165: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:22:03.169691756Z [2024-04-15 02:22:03,169: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:22:03.199680049Z [2024-04-15 02:22:03,199: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:22:03.201747357Z [2024-04-15 02:22:03,201: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:22:03.201957214Z [2024-04-15 02:22:03,201: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:22:03.202158735Z [2024-04-15 02:22:03,201: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:22:03.202347552Z [2024-04-15 02:22:03,202: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:22:03.202722007Z [2024-04-15 02:22:03,202: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:22:03.202906138Z [2024-04-15 02:22:03,202: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:22:03.208244611Z [2024-04-15 02:22:03,208: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:22:03.316756616Z [2024-04-15 02:22:03,316: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:22:04.810113805Z [2024-04-15 02:22:04,808: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2664176a-8f06-46a6-ab6f-423515e3f0d6] succeeded in 4.383607490000031s: None 2024-04-15T02:22:05.579271405Z [2024-04-15 02:22:05,578: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[285d2971-6f4b-4ddf-9a1a-29e68c85bbdb] succeeded in 5.171124717000112s: None 2024-04-15T02:23:00.181849308Z [2024-04-15 02:23:00,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f56b6e99-ffd3-4987-8bd7-a194c8d7801a] received 2024-04-15T02:23:00.190421442Z [2024-04-15 02:23:00,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72343148-eb61-4cd5-b365-ff9de07ae078] received 2024-04-15T02:23:00.196135006Z [2024-04-15 02:23:00,195: INFO/ForkPoolWorker-15] [f56b6e99-ffd3-4987-8bd7-a194c8d7801a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:23:00.216677695Z [2024-04-15 02:23:00,216: INFO/ForkPoolWorker-16] [72343148-eb61-4cd5-b365-ff9de07ae078] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:23:00.521381570Z [2024-04-15 02:23:00,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:23:00.570759678Z [2024-04-15 02:23:00,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:23:02.059392437Z [2024-04-15 02:23:02,059: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:23:02.062821541Z [2024-04-15 02:23:02,062: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:23:02.118167441Z [2024-04-15 02:23:02,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:23:02.121618892Z [2024-04-15 02:23:02,121: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:23:02.123550150Z [2024-04-15 02:23:02,123: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:23:02.124766526Z [2024-04-15 02:23:02,124: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:23:02.128142572Z [2024-04-15 02:23:02,127: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:23:02.128219261Z [2024-04-15 02:23:02,128: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:23:02.128523584Z [2024-04-15 02:23:02,128: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:23:02.128612790Z [2024-04-15 02:23:02,128: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:23:02.128654509Z [2024-04-15 02:23:02,127: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:23:02.195614795Z [2024-04-15 02:23:02,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:23:02.202339767Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:23:02.202366029Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:23:02.202588297Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:23:02.202636278Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:23:02.202890902Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:23:02.202908601Z [2024-04-15 02:23:02,202: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:23:02.259554218Z [2024-04-15 02:23:02,259: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:23:02.322048945Z [2024-04-15 02:23:02,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:23:04.226058502Z [2024-04-15 02:23:04,225: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[72343148-eb61-4cd5-b365-ff9de07ae078] succeeded in 4.032619929000248s: None 2024-04-15T02:23:04.743300110Z [2024-04-15 02:23:04,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f56b6e99-ffd3-4987-8bd7-a194c8d7801a] succeeded in 4.558298462000039s: None 2024-04-15T02:24:00.408323937Z [2024-04-15 02:24:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f636a9f-1398-48ef-a4cc-1f1e4f839617] received 2024-04-15T02:24:00.413896290Z [2024-04-15 02:24:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69e51fff-3827-4c34-9924-b3c40db650bc] received 2024-04-15T02:24:00.425602057Z [2024-04-15 02:24:00,425: INFO/ForkPoolWorker-16] [69e51fff-3827-4c34-9924-b3c40db650bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:24:00.431806738Z [2024-04-15 02:24:00,431: INFO/ForkPoolWorker-15] [9f636a9f-1398-48ef-a4cc-1f1e4f839617] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:24:00.432386656Z [2024-04-15 02:24:00,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eae1d988-fda1-44f3-985c-979ec6d11f07] received 2024-04-15T02:24:00.443737743Z [2024-04-15 02:24:00,443: INFO/ForkPoolWorker-1] [eae1d988-fda1-44f3-985c-979ec6d11f07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:24:00.845966058Z [2024-04-15 02:24:00,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:24:00.868982448Z [2024-04-15 02:24:00,863: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:24:00.902135107Z [2024-04-15 02:24:00,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:24:01.265936513Z [2024-04-15 02:24:01,265: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:24:02.115211667Z [2024-04-15 02:24:02,114: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9f636a9f-1398-48ef-a4cc-1f1e4f839617] succeeded in 1.701566565000121s: None 2024-04-15T02:24:02.451584980Z [2024-04-15 02:24:02,451: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:24:02.456214612Z [2024-04-15 02:24:02,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:24:02.496231966Z [2024-04-15 02:24:02,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:24:02.497565841Z [2024-04-15 02:24:02,497: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:24:02.497786060Z [2024-04-15 02:24:02,497: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:24:02.498046643Z [2024-04-15 02:24:02,497: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:24:02.498190258Z [2024-04-15 02:24:02,498: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:24:02.498464948Z [2024-04-15 02:24:02,498: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:24:02.498750668Z [2024-04-15 02:24:02,498: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:24:02.600544446Z [2024-04-15 02:24:02,600: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:24:02.685872261Z [2024-04-15 02:24:02,685: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:24:02.689741467Z [2024-04-15 02:24:02,689: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:24:02.736905645Z [2024-04-15 02:24:02,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:24:02.737845239Z [2024-04-15 02:24:02,737: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:24:02.737917850Z [2024-04-15 02:24:02,737: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:24:02.738603913Z [2024-04-15 02:24:02,738: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:24:02.738664954Z [2024-04-15 02:24:02,738: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:24:02.739350644Z [2024-04-15 02:24:02,738: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:24:02.739359482Z [2024-04-15 02:24:02,738: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:24:02.888115808Z [2024-04-15 02:24:02,887: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:24:04.457134359Z [2024-04-15 02:24:04,456: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eae1d988-fda1-44f3-985c-979ec6d11f07] succeeded in 4.022045329999855s: None 2024-04-15T02:24:05.514342093Z [2024-04-15 02:24:05,513: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69e51fff-3827-4c34-9924-b3c40db650bc] succeeded in 5.098237593000249s: None 2024-04-15T02:25:00.810549074Z [2024-04-15 02:25:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db55352b-ce07-4b70-b57f-efed72b10c2e] received 2024-04-15T02:25:00.826707774Z [2024-04-15 02:25:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af529fbf-71c4-4112-9bdf-c524c1c6367d] received 2024-04-15T02:25:00.826739538Z [2024-04-15 02:25:00,821: INFO/ForkPoolWorker-15] [db55352b-ce07-4b70-b57f-efed72b10c2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:25:00.854836427Z [2024-04-15 02:25:00,851: INFO/ForkPoolWorker-16] [af529fbf-71c4-4112-9bdf-c524c1c6367d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:00.854855286Z [2024-04-15 02:25:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d695780-3d23-485b-b008-0c436c0feccb] received 2024-04-15T02:25:00.862547083Z [2024-04-15 02:25:00,862: INFO/ForkPoolWorker-1] [5d695780-3d23-485b-b008-0c436c0feccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:25:01.250133592Z [2024-04-15 02:25:01,246: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:25:01.493451505Z [2024-04-15 02:25:01,490: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:25:01.545310567Z [2024-04-15 02:25:01,535: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:25:03.308565524Z [2024-04-15 02:25:03,308: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:25:03.312221577Z [2024-04-15 02:25:03,311: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:03.348075935Z [2024-04-15 02:25:03,347: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:25:03.354880587Z [2024-04-15 02:25:03,354: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:03.355017861Z [2024-04-15 02:25:03,354: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:03.355207884Z [2024-04-15 02:25:03,355: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:03.355327063Z [2024-04-15 02:25:03,355: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:25:03.355653666Z [2024-04-15 02:25:03,355: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:25:03.355832809Z [2024-04-15 02:25:03,355: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:03.460123977Z [2024-04-15 02:25:03,459: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:03.605372538Z [2024-04-15 02:25:03,604: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:25:03.608927305Z [2024-04-15 02:25:03,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:03.642761179Z [2024-04-15 02:25:03,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:25:03.644048279Z [2024-04-15 02:25:03,643: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:03.644071125Z [2024-04-15 02:25:03,643: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:03.644239331Z [2024-04-15 02:25:03,644: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:03.644337108Z [2024-04-15 02:25:03,644: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:25:03.644492453Z [2024-04-15 02:25:03,644: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:25:03.644628624Z [2024-04-15 02:25:03,644: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:03.748135254Z [2024-04-15 02:25:03,747: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:03.861986836Z [2024-04-15 02:25:03,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:25:03.866488660Z [2024-04-15 02:25:03,865: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:03.910235702Z [2024-04-15 02:25:03,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:25:03.914626110Z [2024-04-15 02:25:03,914: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:03.914667594Z [2024-04-15 02:25:03,914: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:03.915062678Z [2024-04-15 02:25:03,914: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:03.915247394Z [2024-04-15 02:25:03,915: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:25:03.915461857Z [2024-04-15 02:25:03,915: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:25:03.915481043Z [2024-04-15 02:25:03,915: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:04.002924607Z [2024-04-15 02:25:04,002: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:04.716333976Z [2024-04-15 02:25:04,715: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af529fbf-71c4-4112-9bdf-c524c1c6367d] succeeded in 3.8881249999999454s: None 2024-04-15T02:25:04.796450303Z [2024-04-15 02:25:04,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6a6d875-9542-41b0-b9bd-63fc32460e7d] received 2024-04-15T02:25:04.820554070Z [2024-04-15 02:25:04,811: INFO/ForkPoolWorker-16] [f6a6d875-9542-41b0-b9bd-63fc32460e7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:05.148708728Z [2024-04-15 02:25:05,145: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:25:05.188946969Z [2024-04-15 02:25:05,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db55352b-ce07-4b70-b57f-efed72b10c2e] succeeded in 4.375608691999787s: None 2024-04-15T02:25:05.721594906Z [2024-04-15 02:25:05,721: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5d695780-3d23-485b-b008-0c436c0feccb] succeeded in 4.8644518750002135s: None 2024-04-15T02:25:06.417176184Z [2024-04-15 02:25:06,416: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:25:06.420401775Z [2024-04-15 02:25:06,419: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:06.458078064Z [2024-04-15 02:25:06,457: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:25:06.459324908Z [2024-04-15 02:25:06,459: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:06.459584530Z [2024-04-15 02:25:06,459: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:06.459873088Z [2024-04-15 02:25:06,459: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:06.460114959Z [2024-04-15 02:25:06,459: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:25:06.460458199Z [2024-04-15 02:25:06,460: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:25:06.460695191Z [2024-04-15 02:25:06,460: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:06.547346748Z [2024-04-15 02:25:06,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:07.154439712Z [2024-04-15 02:25:07,153: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6a6d875-9542-41b0-b9bd-63fc32460e7d] succeeded in 2.352310428999772s: None 2024-04-15T02:25:07.206392567Z [2024-04-15 02:25:07,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7e83959-336d-4058-ba16-5472e5bf4bfc] received 2024-04-15T02:25:07.215959268Z [2024-04-15 02:25:07,215: INFO/ForkPoolWorker-15] [b7e83959-336d-4058-ba16-5472e5bf4bfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:25:07.513993381Z [2024-04-15 02:25:07,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:25:08.792411776Z [2024-04-15 02:25:08,792: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:25:08.796600822Z [2024-04-15 02:25:08,796: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:08.815957706Z [2024-04-15 02:25:08,815: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:25:08.817738884Z [2024-04-15 02:25:08,817: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:08.817753086Z [2024-04-15 02:25:08,817: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:08.817852642Z [2024-04-15 02:25:08,817: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:08.818176860Z [2024-04-15 02:25:08,818: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:25:08.818320933Z [2024-04-15 02:25:08,818: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:25:08.818346282Z [2024-04-15 02:25:08,818: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:08.889846064Z [2024-04-15 02:25:08,889: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:09.477675259Z [2024-04-15 02:25:09,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7e83959-336d-4058-ba16-5472e5bf4bfc] succeeded in 2.2694883949998257s: None 2024-04-15T02:25:09.937546354Z [2024-04-15 02:25:09,936: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e20eb8b-1246-4c94-a922-0b76bd839ead] received 2024-04-15T02:25:09.953940958Z [2024-04-15 02:25:09,953: INFO/ForkPoolWorker-15] [1e20eb8b-1246-4c94-a922-0b76bd839ead] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:25:10.486184483Z [2024-04-15 02:25:10,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:25:12.191105561Z [2024-04-15 02:25:12,190: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:25:12.194398213Z [2024-04-15 02:25:12,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:25:12.236582775Z [2024-04-15 02:25:12,236: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:25:12.237858651Z [2024-04-15 02:25:12,237: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:25:12.238043717Z [2024-04-15 02:25:12,237: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:25:12.238331243Z [2024-04-15 02:25:12,238: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:25:12.238526184Z [2024-04-15 02:25:12,238: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:25:12.238891120Z [2024-04-15 02:25:12,238: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:25:12.239458305Z [2024-04-15 02:25:12,239: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:25:12.313433231Z [2024-04-15 02:25:12,313: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:25:13.035470104Z [2024-04-15 02:25:13,034: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e20eb8b-1246-4c94-a922-0b76bd839ead] succeeded in 3.0923735840001427s: None 2024-04-15T02:26:00.638526031Z [2024-04-15 02:26:00,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[893918e9-426a-4cfd-ab58-fabd9ac25926] received 2024-04-15T02:26:00.655202449Z [2024-04-15 02:26:00,654: INFO/ForkPoolWorker-15] [893918e9-426a-4cfd-ab58-fabd9ac25926] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:26:00.673215745Z [2024-04-15 02:26:00,672: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21544d85-8f20-4fe4-a07c-94e4a7807a17] received 2024-04-15T02:26:00.683718399Z [2024-04-15 02:26:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b51edc8-f8a3-4ff6-a129-a200f00e1c3a] received 2024-04-15T02:26:00.700131569Z [2024-04-15 02:26:00,699: INFO/ForkPoolWorker-16] [21544d85-8f20-4fe4-a07c-94e4a7807a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:26:00.700152077Z [2024-04-15 02:26:00,699: INFO/ForkPoolWorker-1] [3b51edc8-f8a3-4ff6-a129-a200f00e1c3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:26:01.241387082Z [2024-04-15 02:26:01,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:26:01.288959596Z [2024-04-15 02:26:01,272: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:26:01.357269433Z [2024-04-15 02:26:01,352: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:26:01.698085624Z [2024-04-15 02:26:01,697: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:26:02.729403435Z [2024-04-15 02:26:02,728: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[21544d85-8f20-4fe4-a07c-94e4a7807a17] succeeded in 2.05134502600049s: None 2024-04-15T02:26:03.355621465Z [2024-04-15 02:26:03,355: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:26:03.359061138Z [2024-04-15 02:26:03,358: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:26:03.413181515Z [2024-04-15 02:26:03,412: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:26:03.415321043Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:26:03.415337501Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:26:03.415450131Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:26:03.415489183Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:26:03.415750150Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:26:03.415794806Z [2024-04-15 02:26:03,415: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:26:03.522390239Z [2024-04-15 02:26:03,522: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:26:03.703925498Z [2024-04-15 02:26:03,703: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:26:03.707482364Z [2024-04-15 02:26:03,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:26:03.748881364Z [2024-04-15 02:26:03,748: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:26:03.750602035Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:26:03.750646685Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:26:03.750746795Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:26:03.750796131Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:26:03.750970878Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:26:03.750996669Z [2024-04-15 02:26:03,750: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:26:03.865121799Z [2024-04-15 02:26:03,837: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:26:05.188521604Z [2024-04-15 02:26:05,188: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3b51edc8-f8a3-4ff6-a129-a200f00e1c3a] succeeded in 4.501944434000507s: None 2024-04-15T02:26:05.868435182Z [2024-04-15 02:26:05,868: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[893918e9-426a-4cfd-ab58-fabd9ac25926] succeeded in 5.224214374999974s: None 2024-04-15T02:27:00.404776499Z [2024-04-15 02:27:00,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87048418-de78-4110-889b-e067ca5a25c8] received 2024-04-15T02:27:00.408455533Z [2024-04-15 02:27:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf048ea-cf42-4849-a50e-69559b3d0fd3] received 2024-04-15T02:27:00.424516712Z [2024-04-15 02:27:00,424: INFO/ForkPoolWorker-16] [4cf048ea-cf42-4849-a50e-69559b3d0fd3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:27:00.428416496Z [2024-04-15 02:27:00,428: INFO/ForkPoolWorker-15] [87048418-de78-4110-889b-e067ca5a25c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:27:00.739867999Z [2024-04-15 02:27:00,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:27:00.745727197Z [2024-04-15 02:27:00,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:27:02.253602359Z [2024-04-15 02:27:02,253: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:27:02.256953067Z [2024-04-15 02:27:02,256: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:27:02.306074375Z [2024-04-15 02:27:02,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:27:02.309093166Z [2024-04-15 02:27:02,308: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:27:02.311521135Z [2024-04-15 02:27:02,309: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:27:02.311790023Z [2024-04-15 02:27:02,311: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:27:02.311983781Z [2024-04-15 02:27:02,311: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:27:02.313130488Z [2024-04-15 02:27:02,312: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:27:02.313870110Z [2024-04-15 02:27:02,313: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:27:02.342716513Z [2024-04-15 02:27:02,342: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:27:02.347677841Z [2024-04-15 02:27:02,347: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:27:02.410918182Z [2024-04-15 02:27:02,410: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:27:02.412078253Z [2024-04-15 02:27:02,411: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:27:02.412207463Z [2024-04-15 02:27:02,412: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:27:02.412359370Z [2024-04-15 02:27:02,412: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:27:02.412445599Z [2024-04-15 02:27:02,412: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:27:02.412666293Z [2024-04-15 02:27:02,412: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:27:02.412782108Z [2024-04-15 02:27:02,412: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:27:02.474345425Z [2024-04-15 02:27:02,474: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:27:02.540672952Z [2024-04-15 02:27:02,540: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:27:04.650346347Z [2024-04-15 02:27:04,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4cf048ea-cf42-4849-a50e-69559b3d0fd3] succeeded in 4.233482856999217s: None 2024-04-15T02:27:05.299648849Z [2024-04-15 02:27:05,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87048418-de78-4110-889b-e067ca5a25c8] succeeded in 4.885897264999585s: None 2024-04-15T02:28:00.343042342Z [2024-04-15 02:28:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5182ed0-80a0-4208-afcf-461902930132] received 2024-04-15T02:28:00.355656572Z [2024-04-15 02:28:00,355: INFO/ForkPoolWorker-15] [c5182ed0-80a0-4208-afcf-461902930132] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:28:00.366545033Z [2024-04-15 02:28:00,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3ef7acd-7e1f-4e76-9b7f-c51cce802cb9] received 2024-04-15T02:28:00.369209281Z [2024-04-15 02:28:00,369: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f740f772-c976-4c45-a820-39c1328a458d] received 2024-04-15T02:28:00.377735337Z [2024-04-15 02:28:00,377: INFO/ForkPoolWorker-16] [b3ef7acd-7e1f-4e76-9b7f-c51cce802cb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:28:00.385972923Z [2024-04-15 02:28:00,385: INFO/ForkPoolWorker-1] [f740f772-c976-4c45-a820-39c1328a458d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:28:00.859222188Z [2024-04-15 02:28:00,844: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:28:00.884432984Z [2024-04-15 02:28:00,880: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:28:01.085283746Z [2024-04-15 02:28:01,082: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:28:01.298204794Z [2024-04-15 02:28:01,297: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:28:02.267601156Z [2024-04-15 02:28:02,267: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5182ed0-80a0-4208-afcf-461902930132] succeeded in 1.9215274400003182s: None 2024-04-15T02:28:03.123416064Z [2024-04-15 02:28:03,123: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:28:03.130180108Z [2024-04-15 02:28:03,129: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:28:03.193565597Z [2024-04-15 02:28:03,193: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:28:03.202387731Z [2024-04-15 02:28:03,202: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:28:03.202402190Z [2024-04-15 02:28:03,202: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:28:03.202525605Z [2024-04-15 02:28:03,202: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:28:03.202557704Z [2024-04-15 02:28:03,202: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:28:03.207573693Z [2024-04-15 02:28:03,207: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:28:03.207628692Z [2024-04-15 02:28:03,207: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:28:03.307560264Z [2024-04-15 02:28:03,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:28:03.483452941Z [2024-04-15 02:28:03,483: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:28:03.488407486Z [2024-04-15 02:28:03,487: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:28:03.536143059Z [2024-04-15 02:28:03,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:28:03.537601728Z [2024-04-15 02:28:03,537: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:28:03.543815528Z [2024-04-15 02:28:03,543: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:28:03.544934665Z [2024-04-15 02:28:03,544: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:28:03.546393681Z [2024-04-15 02:28:03,546: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:28:03.547408075Z [2024-04-15 02:28:03,547: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:28:03.547538015Z [2024-04-15 02:28:03,547: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:28:03.699072802Z [2024-04-15 02:28:03,698: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:28:05.031298919Z [2024-04-15 02:28:05,030: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f740f772-c976-4c45-a820-39c1328a458d] succeeded in 4.658072324000386s: None 2024-04-15T02:28:05.730133974Z [2024-04-15 02:28:05,729: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b3ef7acd-7e1f-4e76-9b7f-c51cce802cb9] succeeded in 5.362003845999425s: None 2024-04-15T02:29:00.523718030Z [2024-04-15 02:29:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ea14b9-863b-4bb2-bcf3-bd414a5ca3db] received 2024-04-15T02:29:00.534806419Z [2024-04-15 02:29:00,534: INFO/ForkPoolWorker-15] [e6ea14b9-863b-4bb2-bcf3-bd414a5ca3db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:29:00.539952430Z [2024-04-15 02:29:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52422288-6b1f-4e79-b3e4-3f86533b80ea] received 2024-04-15T02:29:00.559404971Z [2024-04-15 02:29:00,559: INFO/ForkPoolWorker-16] [52422288-6b1f-4e79-b3e4-3f86533b80ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:29:00.893791904Z [2024-04-15 02:29:00,890: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:29:00.919666980Z [2024-04-15 02:29:00,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:29:02.382013345Z [2024-04-15 02:29:02,381: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:29:02.385826165Z [2024-04-15 02:29:02,385: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:29:02.428045046Z [2024-04-15 02:29:02,427: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:29:02.430360382Z [2024-04-15 02:29:02,430: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:29:02.430549772Z [2024-04-15 02:29:02,430: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:29:02.430848047Z [2024-04-15 02:29:02,430: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:29:02.430938526Z [2024-04-15 02:29:02,430: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:29:02.431182017Z [2024-04-15 02:29:02,431: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:29:02.432010981Z [2024-04-15 02:29:02,431: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:29:02.548617621Z [2024-04-15 02:29:02,548: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:29:02.596530191Z [2024-04-15 02:29:02,596: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:29:02.599950229Z [2024-04-15 02:29:02,599: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:29:02.657453224Z [2024-04-15 02:29:02,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:29:02.659710477Z [2024-04-15 02:29:02,659: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:29:02.659918074Z [2024-04-15 02:29:02,659: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:29:02.660120583Z [2024-04-15 02:29:02,659: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:29:02.660248672Z [2024-04-15 02:29:02,660: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:29:02.660517777Z [2024-04-15 02:29:02,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:29:02.660657427Z [2024-04-15 02:29:02,660: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:29:02.808039448Z [2024-04-15 02:29:02,807: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:29:05.194818682Z [2024-04-15 02:29:05,194: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e6ea14b9-863b-4bb2-bcf3-bd414a5ca3db] succeeded in 4.669447815999774s: None 2024-04-15T02:29:05.344249468Z [2024-04-15 02:29:05,343: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[52422288-6b1f-4e79-b3e4-3f86533b80ea] succeeded in 4.796353196999917s: None 2024-04-15T02:30:00.794932049Z [2024-04-15 02:30:00,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74e22b96-8f5f-4c4b-a02d-2fef4cbf10e5] received 2024-04-15T02:30:00.799499273Z [2024-04-15 02:30:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ca488e8-d7a8-473f-8cad-826d1e748089] received 2024-04-15T02:30:00.812747428Z [2024-04-15 02:30:00,810: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0bffee8-4eba-4d28-8e94-cdba4af8318a] received 2024-04-15T02:30:00.821696676Z [2024-04-15 02:30:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33c62b33-9c42-4518-b177-ea817573dfa6] received 2024-04-15T02:30:00.825697814Z [2024-04-15 02:30:00,824: INFO/ForkPoolWorker-15] [74e22b96-8f5f-4c4b-a02d-2fef4cbf10e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:30:00.834243904Z [2024-04-15 02:30:00,829: INFO/ForkPoolWorker-1] [f0bffee8-4eba-4d28-8e94-cdba4af8318a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:00.834261788Z [2024-04-15 02:30:00,832: INFO/ForkPoolWorker-16] [8ca488e8-d7a8-473f-8cad-826d1e748089] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:30:00.854435598Z [2024-04-15 02:30:00,848: INFO/ForkPoolWorker-2] [33c62b33-9c42-4518-b177-ea817573dfa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:30:01.336412227Z [2024-04-15 02:30:01,332: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:30:01.550068490Z [2024-04-15 02:30:01,546: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:30:01.661563079Z [2024-04-15 02:30:01,657: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:30:01.766154847Z [2024-04-15 02:30:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:30:02.111673430Z [2024-04-15 02:30:02,111: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:03.186199833Z [2024-04-15 02:30:03,185: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[33c62b33-9c42-4518-b177-ea817573dfa6] succeeded in 2.362199936000252s: None 2024-04-15T02:30:03.659385637Z [2024-04-15 02:30:03,659: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:30:03.662745720Z [2024-04-15 02:30:03,662: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:03.703323927Z [2024-04-15 02:30:03,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:30:03.704534863Z [2024-04-15 02:30:03,704: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:03.704560208Z [2024-04-15 02:30:03,704: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:03.704673726Z [2024-04-15 02:30:03,704: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:03.704691139Z [2024-04-15 02:30:03,704: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:30:03.704924432Z [2024-04-15 02:30:03,704: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:30:03.706005893Z [2024-04-15 02:30:03,705: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:03.923419793Z [2024-04-15 02:30:03,922: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:04.327968918Z [2024-04-15 02:30:04,324: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:30:04.332319111Z [2024-04-15 02:30:04,331: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:04.369123093Z [2024-04-15 02:30:04,368: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:30:04.372470025Z [2024-04-15 02:30:04,372: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:04.372529729Z [2024-04-15 02:30:04,372: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:04.373201736Z [2024-04-15 02:30:04,372: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:04.373329013Z [2024-04-15 02:30:04,373: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:30:04.374583268Z [2024-04-15 02:30:04,373: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:30:04.374968471Z [2024-04-15 02:30:04,374: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:04.395638768Z [2024-04-15 02:30:04,395: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:30:04.399802047Z [2024-04-15 02:30:04,399: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:04.460699440Z [2024-04-15 02:30:04,460: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:30:04.462235662Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:04.462292680Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:04.462450280Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:04.462459897Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:30:04.462811064Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:30:04.462841132Z [2024-04-15 02:30:04,462: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:04.519998491Z [2024-04-15 02:30:04,519: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:04.558769222Z [2024-04-15 02:30:04,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:05.349825022Z [2024-04-15 02:30:05,349: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f0bffee8-4eba-4d28-8e94-cdba4af8318a] succeeded in 4.533461590000115s: None 2024-04-15T02:30:05.646304466Z [2024-04-15 02:30:05,645: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8ca488e8-d7a8-473f-8cad-826d1e748089] succeeded in 4.843638585000008s: None 2024-04-15T02:30:05.925258723Z [2024-04-15 02:30:05,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c4fe240-c9b2-40ce-96cf-7440e8f49f05] received 2024-04-15T02:30:05.935638777Z [2024-04-15 02:30:05,935: INFO/ForkPoolWorker-16] [2c4fe240-c9b2-40ce-96cf-7440e8f49f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:06.230043255Z [2024-04-15 02:30:06,226: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:30:06.599263189Z [2024-04-15 02:30:06,598: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74e22b96-8f5f-4c4b-a02d-2fef4cbf10e5] succeeded in 5.789748696999595s: None 2024-04-15T02:30:07.476865739Z [2024-04-15 02:30:07,476: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:30:07.480008052Z [2024-04-15 02:30:07,479: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:07.509369751Z [2024-04-15 02:30:07,509: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:30:07.512525266Z [2024-04-15 02:30:07,512: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:07.512673542Z [2024-04-15 02:30:07,512: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:07.512864495Z [2024-04-15 02:30:07,512: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:07.512994850Z [2024-04-15 02:30:07,512: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:30:07.513399489Z [2024-04-15 02:30:07,513: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:30:07.513530687Z [2024-04-15 02:30:07,513: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:07.602619513Z [2024-04-15 02:30:07,602: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:08.262409604Z [2024-04-15 02:30:08,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b76ee690-0b4d-453c-bd6c-3308106d773a] received 2024-04-15T02:30:08.275942687Z [2024-04-15 02:30:08,275: INFO/ForkPoolWorker-15] [b76ee690-0b4d-453c-bd6c-3308106d773a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:30:08.324404482Z [2024-04-15 02:30:08,323: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c4fe240-c9b2-40ce-96cf-7440e8f49f05] succeeded in 2.3949509650001346s: None 2024-04-15T02:30:08.623984739Z [2024-04-15 02:30:08,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:30:10.084238408Z [2024-04-15 02:30:10,083: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:30:10.089052928Z [2024-04-15 02:30:10,088: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:10.166701478Z [2024-04-15 02:30:10,165: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:30:10.169438166Z [2024-04-15 02:30:10,169: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:10.169576957Z [2024-04-15 02:30:10,169: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:10.171024074Z [2024-04-15 02:30:10,169: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:10.171180742Z [2024-04-15 02:30:10,171: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:30:10.171499182Z [2024-04-15 02:30:10,171: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:30:10.171616541Z [2024-04-15 02:30:10,171: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:10.325392364Z [2024-04-15 02:30:10,325: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:10.988046816Z [2024-04-15 02:30:10,985: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b76ee690-0b4d-453c-bd6c-3308106d773a] succeeded in 2.7214645880003445s: None 2024-04-15T02:30:11.514396222Z [2024-04-15 02:30:11,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c16e97f-64b1-49f6-8438-2f30c9014533] received 2024-04-15T02:30:11.529087412Z [2024-04-15 02:30:11,528: INFO/ForkPoolWorker-15] [5c16e97f-64b1-49f6-8438-2f30c9014533] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:30:11.919278274Z [2024-04-15 02:30:11,915: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:30:13.240798451Z [2024-04-15 02:30:13,240: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:30:13.244000959Z [2024-04-15 02:30:13,243: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:30:13.270177721Z [2024-04-15 02:30:13,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:30:13.271471802Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:30:13.271529424Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:30:13.271671946Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:30:13.271688266Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:30:13.272045074Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:30:13.272067050Z [2024-04-15 02:30:13,271: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:30:13.348485652Z [2024-04-15 02:30:13,348: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:30:14.006177363Z [2024-04-15 02:30:14,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c16e97f-64b1-49f6-8438-2f30c9014533] succeeded in 2.4861753530003625s: None 2024-04-15T02:31:01.028935737Z [2024-04-15 02:31:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[820679ee-f769-4e42-afcd-18dc5a0ef6ca] received 2024-04-15T02:31:01.039719547Z [2024-04-15 02:31:01,039: INFO/ForkPoolWorker-15] [820679ee-f769-4e42-afcd-18dc5a0ef6ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:31:01.049242506Z [2024-04-15 02:31:01,049: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a692f655-cc29-4216-a7af-6fbc81cdccbc] received 2024-04-15T02:31:01.059016284Z [2024-04-15 02:31:01,058: INFO/ForkPoolWorker-16] [a692f655-cc29-4216-a7af-6fbc81cdccbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:31:01.554070143Z [2024-04-15 02:31:01,551: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:31:01.600751002Z [2024-04-15 02:31:01,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:31:03.054332656Z [2024-04-15 02:31:03,054: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:31:03.058689578Z [2024-04-15 02:31:03,058: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:31:03.087084209Z [2024-04-15 02:31:03,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:31:03.088112532Z [2024-04-15 02:31:03,087: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:31:03.088153414Z [2024-04-15 02:31:03,088: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:31:03.088264430Z [2024-04-15 02:31:03,088: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:31:03.088299487Z [2024-04-15 02:31:03,088: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:31:03.088450643Z [2024-04-15 02:31:03,088: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:31:03.088485589Z [2024-04-15 02:31:03,088: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:31:03.205674245Z [2024-04-15 02:31:03,205: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:31:03.329164760Z [2024-04-15 02:31:03,328: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:31:03.333961742Z [2024-04-15 02:31:03,333: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:31:03.374808739Z [2024-04-15 02:31:03,374: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:31:03.376127163Z [2024-04-15 02:31:03,375: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:31:03.376149356Z [2024-04-15 02:31:03,376: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:31:03.381561793Z [2024-04-15 02:31:03,381: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:31:03.381596273Z [2024-04-15 02:31:03,381: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:31:03.381893033Z [2024-04-15 02:31:03,381: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:31:03.382043432Z [2024-04-15 02:31:03,381: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:31:03.513381303Z [2024-04-15 02:31:03,513: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:31:05.048412774Z [2024-04-15 02:31:05,048: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a692f655-cc29-4216-a7af-6fbc81cdccbc] succeeded in 3.997857140000633s: None 2024-04-15T02:31:06.674971190Z [2024-04-15 02:31:06,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[820679ee-f769-4e42-afcd-18dc5a0ef6ca] succeeded in 5.643383412999356s: None 2024-04-15T02:32:00.271347219Z [2024-04-15 02:32:00,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5412744c-95b1-4336-ad08-3353e6336fa1] received 2024-04-15T02:32:00.273337564Z [2024-04-15 02:32:00,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24b1132c-3ee2-4555-834d-caf17ecf0b59] received 2024-04-15T02:32:00.278335385Z [2024-04-15 02:32:00,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8895252f-d74e-48eb-b418-b7a67aa586e2] received 2024-04-15T02:32:00.283784050Z [2024-04-15 02:32:00,283: INFO/ForkPoolWorker-15] [5412744c-95b1-4336-ad08-3353e6336fa1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:32:00.294297827Z [2024-04-15 02:32:00,294: INFO/ForkPoolWorker-16] [24b1132c-3ee2-4555-834d-caf17ecf0b59] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:32:00.297425789Z [2024-04-15 02:32:00,296: INFO/ForkPoolWorker-1] [8895252f-d74e-48eb-b418-b7a67aa586e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:32:00.635024013Z [2024-04-15 02:32:00,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:32:00.646754004Z [2024-04-15 02:32:00,643: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:32:00.708049652Z [2024-04-15 02:32:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:32:01.011230631Z [2024-04-15 02:32:01,011: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:32:02.012704673Z [2024-04-15 02:32:02,012: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24b1132c-3ee2-4555-834d-caf17ecf0b59] succeeded in 1.7373705909994897s: None 2024-04-15T02:32:02.403347526Z [2024-04-15 02:32:02,403: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:32:02.407242838Z [2024-04-15 02:32:02,406: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:32:02.446324397Z [2024-04-15 02:32:02,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:32:02.450808802Z [2024-04-15 02:32:02,449: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:32:02.469015376Z [2024-04-15 02:32:02,468: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:32:02.471512653Z [2024-04-15 02:32:02,471: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:32:02.471645494Z [2024-04-15 02:32:02,471: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:32:02.471827452Z [2024-04-15 02:32:02,471: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:32:02.471887568Z [2024-04-15 02:32:02,471: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:32:02.472222819Z [2024-04-15 02:32:02,472: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:32:02.472298772Z [2024-04-15 02:32:02,472: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:32:02.514520385Z [2024-04-15 02:32:02,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:32:02.516921070Z [2024-04-15 02:32:02,516: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:32:02.517437021Z [2024-04-15 02:32:02,517: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:32:02.517569513Z [2024-04-15 02:32:02,517: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:32:02.517579828Z [2024-04-15 02:32:02,517: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:32:02.517846654Z [2024-04-15 02:32:02,517: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:32:02.517854146Z [2024-04-15 02:32:02,517: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:32:02.626497657Z [2024-04-15 02:32:02,626: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:32:02.639113566Z [2024-04-15 02:32:02,638: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:32:04.310282252Z [2024-04-15 02:32:04,309: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8895252f-d74e-48eb-b418-b7a67aa586e2] succeeded in 4.030391039999813s: None 2024-04-15T02:32:04.716314956Z [2024-04-15 02:32:04,715: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5412744c-95b1-4336-ad08-3353e6336fa1] succeeded in 4.440922247000344s: None 2024-04-15T02:33:00.514573433Z [2024-04-15 02:33:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49eb54db-6ea5-4920-bb25-79d084f10f3d] received 2024-04-15T02:33:00.526588820Z [2024-04-15 02:33:00,526: INFO/ForkPoolWorker-15] [49eb54db-6ea5-4920-bb25-79d084f10f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:33:00.528188379Z [2024-04-15 02:33:00,527: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[827b88f3-fd07-4fa6-be04-0cdd06b25a2f] received 2024-04-15T02:33:00.536277682Z [2024-04-15 02:33:00,535: INFO/ForkPoolWorker-16] [827b88f3-fd07-4fa6-be04-0cdd06b25a2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:33:00.902538945Z [2024-04-15 02:33:00,898: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:33:00.916118385Z [2024-04-15 02:33:00,905: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:33:02.516000970Z [2024-04-15 02:33:02,515: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:33:02.519230399Z [2024-04-15 02:33:02,518: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:33:02.603796056Z [2024-04-15 02:33:02,603: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:33:02.614487006Z [2024-04-15 02:33:02,614: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:33:02.614618648Z [2024-04-15 02:33:02,614: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:33:02.614821932Z [2024-04-15 02:33:02,614: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:33:02.614951729Z [2024-04-15 02:33:02,614: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:33:02.615271582Z [2024-04-15 02:33:02,615: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:33:02.615435469Z [2024-04-15 02:33:02,615: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:33:02.740326187Z [2024-04-15 02:33:02,740: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:33:02.750172172Z [2024-04-15 02:33:02,749: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:33:02.751031101Z [2024-04-15 02:33:02,750: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:33:02.829095481Z [2024-04-15 02:33:02,827: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:33:02.835732373Z [2024-04-15 02:33:02,828: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:33:02.835754359Z [2024-04-15 02:33:02,828: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:33:02.835760817Z [2024-04-15 02:33:02,828: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:33:02.835764886Z [2024-04-15 02:33:02,828: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:33:02.835767852Z [2024-04-15 02:33:02,828: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:33:02.835770761Z [2024-04-15 02:33:02,829: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:33:03.008576132Z [2024-04-15 02:33:03,008: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:33:04.311701976Z [2024-04-15 02:33:04,311: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[827b88f3-fd07-4fa6-be04-0cdd06b25a2f] succeeded in 3.78132909299984s: None 2024-04-15T02:33:05.281867832Z [2024-04-15 02:33:05,281: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49eb54db-6ea5-4920-bb25-79d084f10f3d] succeeded in 4.764307442000245s: None 2024-04-15T02:34:00.674061954Z [2024-04-15 02:34:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36bd6783-11a5-43ef-bce9-32eb3cbc740f] received 2024-04-15T02:34:00.677086397Z [2024-04-15 02:34:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50dac2b3-c7a8-4730-a93a-3fc16c8f2458] received 2024-04-15T02:34:00.685776955Z [2024-04-15 02:34:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42a1b88f-01a2-466d-ab5c-355f669adac5] received 2024-04-15T02:34:00.686573452Z [2024-04-15 02:34:00,686: INFO/ForkPoolWorker-15] [36bd6783-11a5-43ef-bce9-32eb3cbc740f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:34:00.696637486Z [2024-04-15 02:34:00,696: INFO/ForkPoolWorker-1] [42a1b88f-01a2-466d-ab5c-355f669adac5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:34:00.709120804Z [2024-04-15 02:34:00,708: INFO/ForkPoolWorker-16] [50dac2b3-c7a8-4730-a93a-3fc16c8f2458] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:34:01.106571890Z [2024-04-15 02:34:01,103: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:34:01.178612134Z [2024-04-15 02:34:01,171: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:34:01.205664269Z [2024-04-15 02:34:01,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:34:01.660476821Z [2024-04-15 02:34:01,660: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:34:02.951523115Z [2024-04-15 02:34:02,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36bd6783-11a5-43ef-bce9-32eb3cbc740f] succeeded in 2.2716594520006765s: None 2024-04-15T02:34:03.190118601Z [2024-04-15 02:34:03,189: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:34:03.198497199Z [2024-04-15 02:34:03,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:34:03.254417189Z [2024-04-15 02:34:03,253: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:34:03.258428252Z [2024-04-15 02:34:03,258: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:34:03.262481376Z [2024-04-15 02:34:03,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:34:03.268536425Z [2024-04-15 02:34:03,268: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:34:03.268790779Z [2024-04-15 02:34:03,268: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:34:03.269017986Z [2024-04-15 02:34:03,268: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:34:03.269158048Z [2024-04-15 02:34:03,269: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:34:03.269465483Z [2024-04-15 02:34:03,269: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:34:03.269678110Z [2024-04-15 02:34:03,269: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:34:03.293294038Z [2024-04-15 02:34:03,293: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:34:03.296306645Z [2024-04-15 02:34:03,296: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:34:03.296396769Z [2024-04-15 02:34:03,296: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:34:03.296611842Z [2024-04-15 02:34:03,296: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:34:03.296685483Z [2024-04-15 02:34:03,296: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:34:03.296942527Z [2024-04-15 02:34:03,296: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:34:03.297219415Z [2024-04-15 02:34:03,297: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:34:03.416676226Z [2024-04-15 02:34:03,416: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:34:03.453429345Z [2024-04-15 02:34:03,452: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:34:05.068199853Z [2024-04-15 02:34:05,067: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42a1b88f-01a2-466d-ab5c-355f669adac5] succeeded in 4.37871038799949s: None 2024-04-15T02:34:05.570077790Z [2024-04-15 02:34:05,569: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50dac2b3-c7a8-4730-a93a-3fc16c8f2458] succeeded in 4.8842544059998545s: None 2024-04-15T02:35:00.508666203Z [2024-04-15 02:35:00,507: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7550a345-8cdc-42fe-838c-3865d891f5c3] received 2024-04-15T02:35:00.514389022Z [2024-04-15 02:35:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[046844b7-ffe2-47a6-856e-a694c3060038] received 2024-04-15T02:35:00.519385428Z [2024-04-15 02:35:00,519: INFO/ForkPoolWorker-15] [7550a345-8cdc-42fe-838c-3865d891f5c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:00.522841556Z [2024-04-15 02:35:00,522: INFO/ForkPoolWorker-16] [046844b7-ffe2-47a6-856e-a694c3060038] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:35:00.528690253Z [2024-04-15 02:35:00,528: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17cab90c-cc6c-44ba-9cd3-bfc043c9b906] received 2024-04-15T02:35:00.542251918Z [2024-04-15 02:35:00,541: INFO/ForkPoolWorker-1] [17cab90c-cc6c-44ba-9cd3-bfc043c9b906] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:35:00.985704967Z [2024-04-15 02:35:00,980: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:35:00.991092117Z [2024-04-15 02:35:00,982: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:35:01.059557056Z [2024-04-15 02:35:01,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:35:03.089197373Z [2024-04-15 02:35:03,088: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:35:03.094271565Z [2024-04-15 02:35:03,093: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:03.175475427Z [2024-04-15 02:35:03,175: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:35:03.176577846Z [2024-04-15 02:35:03,176: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:03.176628397Z [2024-04-15 02:35:03,176: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:03.176701076Z [2024-04-15 02:35:03,176: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:03.176729547Z [2024-04-15 02:35:03,176: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:35:03.176923253Z [2024-04-15 02:35:03,176: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:35:03.177382275Z [2024-04-15 02:35:03,177: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:03.355370851Z [2024-04-15 02:35:03,355: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:35:03.358570790Z [2024-04-15 02:35:03,358: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:35:03.359868928Z [2024-04-15 02:35:03,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:03.364243301Z [2024-04-15 02:35:03,363: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:03.381682240Z [2024-04-15 02:35:03,381: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:03.419759733Z [2024-04-15 02:35:03,419: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:35:03.433992454Z [2024-04-15 02:35:03,433: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:03.434139161Z [2024-04-15 02:35:03,434: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:03.434338496Z [2024-04-15 02:35:03,434: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:03.434927582Z [2024-04-15 02:35:03,434: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:35:03.435627746Z [2024-04-15 02:35:03,435: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:35:03.435808100Z [2024-04-15 02:35:03,435: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:03.439672852Z [2024-04-15 02:35:03,439: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:35:03.443003849Z [2024-04-15 02:35:03,442: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:03.443139084Z [2024-04-15 02:35:03,442: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:03.443352870Z [2024-04-15 02:35:03,443: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:03.443471239Z [2024-04-15 02:35:03,443: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:35:03.443719800Z [2024-04-15 02:35:03,443: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:35:03.443838155Z [2024-04-15 02:35:03,443: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:03.536728121Z [2024-04-15 02:35:03,536: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:03.574654336Z [2024-04-15 02:35:03,573: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:04.411988780Z [2024-04-15 02:35:04,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7550a345-8cdc-42fe-838c-3865d891f5c3] succeeded in 3.9004666740001994s: None 2024-04-15T02:35:04.661838372Z [2024-04-15 02:35:04,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb395055-59eb-4d64-bcc4-57638858d8ac] received 2024-04-15T02:35:04.676541842Z [2024-04-15 02:35:04,676: INFO/ForkPoolWorker-15] [eb395055-59eb-4d64-bcc4-57638858d8ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:05.111833702Z [2024-04-15 02:35:05,108: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:35:05.171058485Z [2024-04-15 02:35:05,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[046844b7-ffe2-47a6-856e-a694c3060038] succeeded in 4.65491117900001s: None 2024-04-15T02:35:05.850573730Z [2024-04-15 02:35:05,850: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17cab90c-cc6c-44ba-9cd3-bfc043c9b906] succeeded in 5.317729223000242s: None 2024-04-15T02:35:06.462851651Z [2024-04-15 02:35:06,462: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:35:06.466954464Z [2024-04-15 02:35:06,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:06.489281818Z [2024-04-15 02:35:06,489: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:35:06.491588810Z [2024-04-15 02:35:06,491: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:06.491710585Z [2024-04-15 02:35:06,491: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:06.491879039Z [2024-04-15 02:35:06,491: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:06.491992401Z [2024-04-15 02:35:06,491: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:35:06.492190379Z [2024-04-15 02:35:06,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:35:06.492316473Z [2024-04-15 02:35:06,492: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:06.601973427Z [2024-04-15 02:35:06,601: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:07.134060324Z [2024-04-15 02:35:07,133: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9893102c-92de-4cec-8e70-9461a79a2705] received 2024-04-15T02:35:07.146896936Z [2024-04-15 02:35:07,146: INFO/ForkPoolWorker-16] [9893102c-92de-4cec-8e70-9461a79a2705] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:35:07.222289018Z [2024-04-15 02:35:07,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb395055-59eb-4d64-bcc4-57638858d8ac] succeeded in 2.5582959029998165s: None 2024-04-15T02:35:07.471089344Z [2024-04-15 02:35:07,466: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:35:09.034137018Z [2024-04-15 02:35:09,031: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:35:09.035932130Z [2024-04-15 02:35:09,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:09.086275384Z [2024-04-15 02:35:09,086: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:35:09.090277060Z [2024-04-15 02:35:09,089: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:09.090427181Z [2024-04-15 02:35:09,090: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:09.090579913Z [2024-04-15 02:35:09,090: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:09.090674736Z [2024-04-15 02:35:09,090: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:35:09.090918434Z [2024-04-15 02:35:09,090: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:35:09.091418882Z [2024-04-15 02:35:09,091: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:09.221065956Z [2024-04-15 02:35:09,220: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:09.862461504Z [2024-04-15 02:35:09,862: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9893102c-92de-4cec-8e70-9461a79a2705] succeeded in 2.7263498530001016s: None 2024-04-15T02:35:10.868768851Z [2024-04-15 02:35:10,868: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb855d2b-27f2-4653-a1cb-b68729766f92] received 2024-04-15T02:35:10.881983592Z [2024-04-15 02:35:10,880: INFO/ForkPoolWorker-15] [eb855d2b-27f2-4653-a1cb-b68729766f92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:35:11.236297237Z [2024-04-15 02:35:11,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:35:12.736225632Z [2024-04-15 02:35:12,735: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:35:12.740203997Z [2024-04-15 02:35:12,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:35:12.762699317Z [2024-04-15 02:35:12,762: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:35:12.763740521Z [2024-04-15 02:35:12,763: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:35:12.763769647Z [2024-04-15 02:35:12,763: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:35:12.763966986Z [2024-04-15 02:35:12,763: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:35:12.764071292Z [2024-04-15 02:35:12,763: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:35:12.764434666Z [2024-04-15 02:35:12,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:35:12.764551119Z [2024-04-15 02:35:12,764: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:35:12.904851703Z [2024-04-15 02:35:12,904: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:35:13.522509295Z [2024-04-15 02:35:13,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb855d2b-27f2-4653-a1cb-b68729766f92] succeeded in 2.6515239280006426s: None 2024-04-15T02:36:00.671617731Z [2024-04-15 02:36:00,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7bc6d8e-c54d-4f23-bfbf-16211033e738] received 2024-04-15T02:36:00.674623816Z [2024-04-15 02:36:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[653db9c2-72ab-40da-a326-67c392b297bb] received 2024-04-15T02:36:00.680194750Z [2024-04-15 02:36:00,679: INFO/ForkPoolWorker-16] [653db9c2-72ab-40da-a326-67c392b297bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:36:00.680629621Z [2024-04-15 02:36:00,680: INFO/ForkPoolWorker-15] [b7bc6d8e-c54d-4f23-bfbf-16211033e738] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:36:00.683991218Z [2024-04-15 02:36:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eed0b38e-5494-484e-bc94-b7537144264d] received 2024-04-15T02:36:00.698381674Z [2024-04-15 02:36:00,697: INFO/ForkPoolWorker-1] [eed0b38e-5494-484e-bc94-b7537144264d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:36:01.054189298Z [2024-04-15 02:36:01,051: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:36:01.289946792Z [2024-04-15 02:36:01,281: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:36:01.419145673Z [2024-04-15 02:36:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:36:02.192139887Z [2024-04-15 02:36:02,191: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:36:03.059754252Z [2024-04-15 02:36:03,059: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7bc6d8e-c54d-4f23-bfbf-16211033e738] succeeded in 2.3863406290001876s: None 2024-04-15T02:36:03.295600465Z [2024-04-15 02:36:03,295: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:36:03.303538552Z [2024-04-15 02:36:03,303: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:36:03.370458033Z [2024-04-15 02:36:03,370: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:36:03.374383417Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:36:03.374400746Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:36:03.374491187Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:36:03.374512778Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:36:03.374756898Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:36:03.374767489Z [2024-04-15 02:36:03,374: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:36:03.565884971Z [2024-04-15 02:36:03,565: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:36:03.632273141Z [2024-04-15 02:36:03,631: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:36:03.636032313Z [2024-04-15 02:36:03,635: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:36:03.678295968Z [2024-04-15 02:36:03,678: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:36:03.686465198Z [2024-04-15 02:36:03,686: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:36:03.686556805Z [2024-04-15 02:36:03,686: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:36:03.686695810Z [2024-04-15 02:36:03,686: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:36:03.687127347Z [2024-04-15 02:36:03,686: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:36:03.687614038Z [2024-04-15 02:36:03,687: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:36:03.687839068Z [2024-04-15 02:36:03,687: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:36:03.778351138Z [2024-04-15 02:36:03,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:36:05.301036973Z [2024-04-15 02:36:05,300: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eed0b38e-5494-484e-bc94-b7537144264d] succeeded in 4.609121666000647s: None 2024-04-15T02:36:05.822666839Z [2024-04-15 02:36:05,822: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[653db9c2-72ab-40da-a326-67c392b297bb] succeeded in 5.1468592080000235s: None 2024-04-15T02:37:00.510635964Z [2024-04-15 02:37:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0311fdc-b4f7-437c-8802-9946b558aea6] received 2024-04-15T02:37:00.514933962Z [2024-04-15 02:37:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3aa6ebe-6d8e-4343-8840-327c70efdffa] received 2024-04-15T02:37:00.520748107Z [2024-04-15 02:37:00,520: INFO/ForkPoolWorker-15] [c0311fdc-b4f7-437c-8802-9946b558aea6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:37:00.528027200Z [2024-04-15 02:37:00,527: INFO/ForkPoolWorker-16] [e3aa6ebe-6d8e-4343-8840-327c70efdffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:37:00.861848643Z [2024-04-15 02:37:00,857: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:37:00.865008471Z [2024-04-15 02:37:00,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:37:02.602209335Z [2024-04-15 02:37:02,601: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:37:02.607226477Z [2024-04-15 02:37:02,606: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:37:02.718973824Z [2024-04-15 02:37:02,718: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:37:02.720541175Z [2024-04-15 02:37:02,720: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:37:02.725794166Z [2024-04-15 02:37:02,725: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:37:02.725995440Z [2024-04-15 02:37:02,725: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:37:02.726017156Z [2024-04-15 02:37:02,725: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:37:02.726752311Z [2024-04-15 02:37:02,726: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:37:02.726784622Z [2024-04-15 02:37:02,726: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:37:02.824274147Z [2024-04-15 02:37:02,823: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:37:02.839815862Z [2024-04-15 02:37:02,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:37:02.922145931Z [2024-04-15 02:37:02,917: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:37:02.928433347Z [2024-04-15 02:37:02,928: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:37:02.930334055Z [2024-04-15 02:37:02,930: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:37:02.931108949Z [2024-04-15 02:37:02,930: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:37:02.931126186Z [2024-04-15 02:37:02,930: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:37:02.931130335Z [2024-04-15 02:37:02,930: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:37:02.931530278Z [2024-04-15 02:37:02,931: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:37:02.931626569Z [2024-04-15 02:37:02,931: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:37:03.035445443Z [2024-04-15 02:37:03,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:37:05.249711679Z [2024-04-15 02:37:05,249: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0311fdc-b4f7-437c-8802-9946b558aea6] succeeded in 4.73601742000028s: None 2024-04-15T02:37:05.329042658Z [2024-04-15 02:37:05,328: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e3aa6ebe-6d8e-4343-8840-327c70efdffa] succeeded in 4.811538629000097s: None 2024-04-15T02:38:00.990509254Z [2024-04-15 02:38:00,989: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37c58064-0e77-494a-8e84-a13aad90a4d0] received 2024-04-15T02:38:01.012900317Z [2024-04-15 02:38:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75334c84-f041-42dd-b786-bdcaa06fa7ae] received 2024-04-15T02:38:01.027829360Z [2024-04-15 02:38:01,027: INFO/ForkPoolWorker-15] [37c58064-0e77-494a-8e84-a13aad90a4d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:38:01.040001566Z [2024-04-15 02:38:01,039: INFO/ForkPoolWorker-16] [75334c84-f041-42dd-b786-bdcaa06fa7ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:38:01.058768286Z [2024-04-15 02:38:01,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf45cc2c-87b5-4be6-a19e-e49d2c980b65] received 2024-04-15T02:38:01.130189998Z [2024-04-15 02:38:01,124: INFO/ForkPoolWorker-1] [cf45cc2c-87b5-4be6-a19e-e49d2c980b65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:38:01.601511476Z [2024-04-15 02:38:01,597: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:38:01.640042964Z [2024-04-15 02:38:01,636: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:38:01.887598420Z [2024-04-15 02:38:01,880: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:38:02.541508344Z [2024-04-15 02:38:02,541: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:38:03.395901297Z [2024-04-15 02:38:03,395: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37c58064-0e77-494a-8e84-a13aad90a4d0] succeeded in 2.3977079060005053s: None 2024-04-15T02:38:03.588462154Z [2024-04-15 02:38:03,581: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:38:03.592045164Z [2024-04-15 02:38:03,591: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:38:03.763459380Z [2024-04-15 02:38:03,763: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:38:03.766022704Z [2024-04-15 02:38:03,765: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:38:03.766218297Z [2024-04-15 02:38:03,766: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:38:03.766554235Z [2024-04-15 02:38:03,766: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:38:03.766745614Z [2024-04-15 02:38:03,766: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:38:03.767164381Z [2024-04-15 02:38:03,766: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:38:03.767450948Z [2024-04-15 02:38:03,767: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:38:03.968953847Z [2024-04-15 02:38:03,968: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:38:04.085400527Z [2024-04-15 02:38:04,085: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:38:04.089986058Z [2024-04-15 02:38:04,089: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:38:04.143544437Z [2024-04-15 02:38:04,143: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:38:04.149821953Z [2024-04-15 02:38:04,148: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:38:04.155411516Z [2024-04-15 02:38:04,149: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:38:04.155426106Z [2024-04-15 02:38:04,150: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:38:04.155432012Z [2024-04-15 02:38:04,150: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:38:04.155436801Z [2024-04-15 02:38:04,151: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:38:04.155445767Z [2024-04-15 02:38:04,151: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:38:04.301110854Z [2024-04-15 02:38:04,300: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:38:06.094036091Z [2024-04-15 02:38:06,093: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf45cc2c-87b5-4be6-a19e-e49d2c980b65] succeeded in 5.02764272100012s: None 2024-04-15T02:38:06.169475099Z [2024-04-15 02:38:06,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[75334c84-f041-42dd-b786-bdcaa06fa7ae] succeeded in 5.150404351999896s: None 2024-04-15T02:39:01.024833177Z [2024-04-15 02:39:01,024: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55203c9f-de5b-4136-887d-c1451e365028] received 2024-04-15T02:39:01.033993102Z [2024-04-15 02:39:01,033: INFO/ForkPoolWorker-15] [55203c9f-de5b-4136-887d-c1451e365028] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:39:01.057682384Z [2024-04-15 02:39:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0fd145fa-f9f9-4d1c-9d97-be9daeeb4c6b] received 2024-04-15T02:39:01.085370791Z [2024-04-15 02:39:01,085: INFO/ForkPoolWorker-16] [0fd145fa-f9f9-4d1c-9d97-be9daeeb4c6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:39:01.648213730Z [2024-04-15 02:39:01,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:39:01.749929921Z [2024-04-15 02:39:01,743: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:39:03.665053144Z [2024-04-15 02:39:03,664: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:39:03.669303809Z [2024-04-15 02:39:03,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:39:03.706699704Z [2024-04-15 02:39:03,706: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:39:03.714476725Z [2024-04-15 02:39:03,714: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:39:03.714634425Z [2024-04-15 02:39:03,714: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:39:03.714854782Z [2024-04-15 02:39:03,714: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:39:03.715268490Z [2024-04-15 02:39:03,714: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:39:03.715580802Z [2024-04-15 02:39:03,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:39:03.715802444Z [2024-04-15 02:39:03,715: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:39:03.781808887Z [2024-04-15 02:39:03,781: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:39:03.801516863Z [2024-04-15 02:39:03,800: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:39:03.833757693Z [2024-04-15 02:39:03,828: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:39:03.907885504Z [2024-04-15 02:39:03,907: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:39:03.912646089Z [2024-04-15 02:39:03,911: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:39:03.913076916Z [2024-04-15 02:39:03,912: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:39:03.913084023Z [2024-04-15 02:39:03,912: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:39:03.913088454Z [2024-04-15 02:39:03,912: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:39:03.915154505Z [2024-04-15 02:39:03,913: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:39:03.915172583Z [2024-04-15 02:39:03,915: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:39:04.072459346Z [2024-04-15 02:39:04,072: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:39:05.658978618Z [2024-04-15 02:39:05,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0fd145fa-f9f9-4d1c-9d97-be9daeeb4c6b] succeeded in 4.597292729000401s: None 2024-04-15T02:39:05.892114166Z [2024-04-15 02:39:05,891: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55203c9f-de5b-4136-887d-c1451e365028] succeeded in 4.865157445000477s: None 2024-04-15T02:40:01.120981764Z [2024-04-15 02:40:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2da9e3e-fe65-4bee-87a4-065c11d84823] received 2024-04-15T02:40:01.122988639Z [2024-04-15 02:40:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e6fe664-6ba3-4b59-8878-3f75ddb6f28c] received 2024-04-15T02:40:01.141133837Z [2024-04-15 02:40:01,140: INFO/ForkPoolWorker-16] [7e6fe664-6ba3-4b59-8878-3f75ddb6f28c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:40:01.145087419Z [2024-04-15 02:40:01,144: INFO/ForkPoolWorker-15] [d2da9e3e-fe65-4bee-87a4-065c11d84823] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:40:01.194355966Z [2024-04-15 02:40:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39723026-ac5d-4cbe-bbd0-45f7522662f1] received 2024-04-15T02:40:01.204747858Z [2024-04-15 02:40:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea2fa78c-031f-47d1-b04d-fa779921c4e1] received 2024-04-15T02:40:01.239660044Z [2024-04-15 02:40:01,239: INFO/ForkPoolWorker-1] [39723026-ac5d-4cbe-bbd0-45f7522662f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:01.247931730Z [2024-04-15 02:40:01,247: INFO/ForkPoolWorker-2] [ea2fa78c-031f-47d1-b04d-fa779921c4e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:40:01.714653874Z [2024-04-15 02:40:01,710: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:40:01.911179234Z [2024-04-15 02:40:01,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:40:02.131633026Z [2024-04-15 02:40:02,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:40:02.498344720Z [2024-04-15 02:40:02,494: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:40:03.675032566Z [2024-04-15 02:40:03,674: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:04.176537865Z [2024-04-15 02:40:04,176: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:40:04.180279693Z [2024-04-15 02:40:04,179: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:04.282796924Z [2024-04-15 02:40:04,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:40:04.287382504Z [2024-04-15 02:40:04,286: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:04.287978619Z [2024-04-15 02:40:04,287: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:04.289093341Z [2024-04-15 02:40:04,288: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:04.289429955Z [2024-04-15 02:40:04,289: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:40:04.290206813Z [2024-04-15 02:40:04,289: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:40:04.290604590Z [2024-04-15 02:40:04,290: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:04.457775995Z [2024-04-15 02:40:04,457: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:40:04.460226242Z [2024-04-15 02:40:04,460: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:04.462621956Z [2024-04-15 02:40:04,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:04.535666024Z [2024-04-15 02:40:04,535: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:40:04.538150926Z [2024-04-15 02:40:04,537: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:04.539098350Z [2024-04-15 02:40:04,538: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:04.540311507Z [2024-04-15 02:40:04,539: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:04.540476933Z [2024-04-15 02:40:04,540: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:40:04.540767017Z [2024-04-15 02:40:04,540: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:40:04.540872638Z [2024-04-15 02:40:04,540: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:04.648509165Z [2024-04-15 02:40:04,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:40:04.653487754Z [2024-04-15 02:40:04,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:04.719230174Z [2024-04-15 02:40:04,719: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:40:04.720166939Z [2024-04-15 02:40:04,719: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:04.722155901Z [2024-04-15 02:40:04,721: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:04.722290261Z [2024-04-15 02:40:04,722: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:04.722497022Z [2024-04-15 02:40:04,722: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:04.722622870Z [2024-04-15 02:40:04,722: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:40:04.722871005Z [2024-04-15 02:40:04,722: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:40:04.723400091Z [2024-04-15 02:40:04,722: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:04.908460667Z [2024-04-15 02:40:04,906: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:05.363692634Z [2024-04-15 02:40:05,362: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ea2fa78c-031f-47d1-b04d-fa779921c4e1] succeeded in 4.15366292500039s: None 2024-04-15T02:40:05.514735648Z [2024-04-15 02:40:05,514: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39723026-ac5d-4cbe-bbd0-45f7522662f1] succeeded in 4.314980690000084s: None 2024-04-15T02:40:06.396258463Z [2024-04-15 02:40:06,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46ebae40-9450-4bfe-ad13-45bd8524d3c3] received 2024-04-15T02:40:06.413722406Z [2024-04-15 02:40:06,413: INFO/ForkPoolWorker-1] [46ebae40-9450-4bfe-ad13-45bd8524d3c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:06.596982162Z [2024-04-15 02:40:06,596: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e6fe664-6ba3-4b59-8878-3f75ddb6f28c] succeeded in 5.471773930000381s: None 2024-04-15T02:40:06.838616177Z [2024-04-15 02:40:06,835: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:40:07.231315650Z [2024-04-15 02:40:07,230: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d2da9e3e-fe65-4bee-87a4-065c11d84823] succeeded in 6.107752261000314s: None 2024-04-15T02:40:08.344123088Z [2024-04-15 02:40:08,343: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:40:08.347492337Z [2024-04-15 02:40:08,347: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:08.372240636Z [2024-04-15 02:40:08,372: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:40:08.373816486Z [2024-04-15 02:40:08,373: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:08.373997122Z [2024-04-15 02:40:08,373: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:08.374175953Z [2024-04-15 02:40:08,373: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:08.374287255Z [2024-04-15 02:40:08,374: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:40:08.374544755Z [2024-04-15 02:40:08,374: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:40:08.374722738Z [2024-04-15 02:40:08,374: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:08.503033600Z [2024-04-15 02:40:08,502: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:09.213210584Z [2024-04-15 02:40:09,212: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5977f4b1-1491-46aa-a881-98db596ecb11] received 2024-04-15T02:40:09.217012558Z [2024-04-15 02:40:09,216: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46ebae40-9450-4bfe-ad13-45bd8524d3c3] succeeded in 2.8177580319998015s: None 2024-04-15T02:40:09.220522595Z [2024-04-15 02:40:09,220: INFO/ForkPoolWorker-15] [5977f4b1-1491-46aa-a881-98db596ecb11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:40:09.664940611Z [2024-04-15 02:40:09,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:40:11.114013218Z [2024-04-15 02:40:11,113: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:40:11.117850797Z [2024-04-15 02:40:11,117: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:11.138004135Z [2024-04-15 02:40:11,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:40:11.138991192Z [2024-04-15 02:40:11,138: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:11.139020258Z [2024-04-15 02:40:11,138: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:11.139148020Z [2024-04-15 02:40:11,139: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:11.139167487Z [2024-04-15 02:40:11,139: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:40:11.139741392Z [2024-04-15 02:40:11,139: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:40:11.139807330Z [2024-04-15 02:40:11,139: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:11.245445448Z [2024-04-15 02:40:11,245: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:11.713613324Z [2024-04-15 02:40:11,713: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d125656-de76-4744-a7c3-98de3eeeb601] received 2024-04-15T02:40:11.727309289Z [2024-04-15 02:40:11,727: INFO/ForkPoolWorker-16] [2d125656-de76-4744-a7c3-98de3eeeb601] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:40:11.832827943Z [2024-04-15 02:40:11,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5977f4b1-1491-46aa-a881-98db596ecb11] succeeded in 2.618055113999617s: None 2024-04-15T02:40:12.190090337Z [2024-04-15 02:40:12,186: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:40:13.736466617Z [2024-04-15 02:40:13,736: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:40:13.755519559Z [2024-04-15 02:40:13,754: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:40:13.789893312Z [2024-04-15 02:40:13,789: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:40:13.794561679Z [2024-04-15 02:40:13,794: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:40:13.794684990Z [2024-04-15 02:40:13,794: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:40:13.795021858Z [2024-04-15 02:40:13,794: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:40:13.795434865Z [2024-04-15 02:40:13,795: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:40:13.795798130Z [2024-04-15 02:40:13,795: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:40:13.795926970Z [2024-04-15 02:40:13,795: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:40:13.926158240Z [2024-04-15 02:40:13,925: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:40:14.554822266Z [2024-04-15 02:40:14,554: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2d125656-de76-4744-a7c3-98de3eeeb601] succeeded in 2.8356193420004274s: None 2024-04-15T02:41:00.270111170Z [2024-04-15 02:41:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[187f0c35-93aa-44eb-bb0e-9f129136feef] received 2024-04-15T02:41:00.279517681Z [2024-04-15 02:41:00,279: INFO/ForkPoolWorker-15] [187f0c35-93aa-44eb-bb0e-9f129136feef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:41:00.281131028Z [2024-04-15 02:41:00,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b45f1cc2-3bae-4a65-95a8-f08d59659d48] received 2024-04-15T02:41:00.293425200Z [2024-04-15 02:41:00,292: INFO/ForkPoolWorker-16] [b45f1cc2-3bae-4a65-95a8-f08d59659d48] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:41:00.620747100Z [2024-04-15 02:41:00,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:41:00.630103949Z [2024-04-15 02:41:00,626: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:41:02.293007771Z [2024-04-15 02:41:02,292: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:41:02.297551474Z [2024-04-15 02:41:02,296: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:41:02.334793160Z [2024-04-15 02:41:02,334: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:41:02.337682718Z [2024-04-15 02:41:02,337: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:41:02.337802332Z [2024-04-15 02:41:02,337: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:41:02.338641149Z [2024-04-15 02:41:02,337: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:41:02.339141564Z [2024-04-15 02:41:02,338: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:41:02.341372998Z [2024-04-15 02:41:02,340: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:41:02.342528013Z [2024-04-15 02:41:02,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:41:02.343568810Z [2024-04-15 02:41:02,343: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:41:02.343694413Z [2024-04-15 02:41:02,343: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:41:02.398564205Z [2024-04-15 02:41:02,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:41:02.402519246Z [2024-04-15 02:41:02,402: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:41:02.402665631Z [2024-04-15 02:41:02,402: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:41:02.402858749Z [2024-04-15 02:41:02,402: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:41:02.403080614Z [2024-04-15 02:41:02,402: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:41:02.403521255Z [2024-04-15 02:41:02,403: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:41:02.403582014Z [2024-04-15 02:41:02,403: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:41:02.526119024Z [2024-04-15 02:41:02,525: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:41:02.576391065Z [2024-04-15 02:41:02,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:41:04.925737700Z [2024-04-15 02:41:04,925: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b45f1cc2-3bae-4a65-95a8-f08d59659d48] succeeded in 4.639387963000445s: None 2024-04-15T02:41:05.479998532Z [2024-04-15 02:41:05,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[187f0c35-93aa-44eb-bb0e-9f129136feef] succeeded in 5.208155755000007s: None 2024-04-15T02:42:00.638063471Z [2024-04-15 02:42:00,637: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cec44f3d-a71a-428d-94db-00c4842e923c] received 2024-04-15T02:42:00.649845796Z [2024-04-15 02:42:00,649: INFO/ForkPoolWorker-15] [cec44f3d-a71a-428d-94db-00c4842e923c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:42:00.654897720Z [2024-04-15 02:42:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3f81b47-48c1-4c6a-8424-0df67dd35dbf] received 2024-04-15T02:42:00.657636315Z [2024-04-15 02:42:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13c9af2c-25fe-4c64-8882-990a2fcc6e1e] received 2024-04-15T02:42:00.665283437Z [2024-04-15 02:42:00,664: INFO/ForkPoolWorker-1] [13c9af2c-25fe-4c64-8882-990a2fcc6e1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:42:00.669778625Z [2024-04-15 02:42:00,669: INFO/ForkPoolWorker-16] [a3f81b47-48c1-4c6a-8424-0df67dd35dbf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:42:01.078161539Z [2024-04-15 02:42:01,071: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:42:01.086761101Z [2024-04-15 02:42:01,083: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:42:01.233813512Z [2024-04-15 02:42:01,230: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:42:01.729357490Z [2024-04-15 02:42:01,729: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:42:02.721483743Z [2024-04-15 02:42:02,721: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3f81b47-48c1-4c6a-8424-0df67dd35dbf] succeeded in 2.0628142989999105s: None 2024-04-15T02:42:03.140209583Z [2024-04-15 02:42:03,138: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:42:03.145819854Z [2024-04-15 02:42:03,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:42:03.186708717Z [2024-04-15 02:42:03,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:42:03.188328035Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:42:03.188398446Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:42:03.188579819Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:42:03.188631531Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:42:03.188952974Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:42:03.189040100Z [2024-04-15 02:42:03,188: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:42:03.276825304Z [2024-04-15 02:42:03,276: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:42:03.378523540Z [2024-04-15 02:42:03,377: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:42:03.383365370Z [2024-04-15 02:42:03,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:42:03.410332917Z [2024-04-15 02:42:03,410: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:42:03.413685426Z [2024-04-15 02:42:03,413: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:42:03.413771595Z [2024-04-15 02:42:03,413: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:42:03.413980452Z [2024-04-15 02:42:03,413: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:42:03.414069177Z [2024-04-15 02:42:03,413: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:42:03.414309561Z [2024-04-15 02:42:03,414: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:42:03.414382897Z [2024-04-15 02:42:03,414: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:42:03.500895810Z [2024-04-15 02:42:03,500: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:42:05.119842285Z [2024-04-15 02:42:05,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cec44f3d-a71a-428d-94db-00c4842e923c] succeeded in 4.479821440999331s: None 2024-04-15T02:42:05.832534906Z [2024-04-15 02:42:05,831: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13c9af2c-25fe-4c64-8882-990a2fcc6e1e] succeeded in 5.172811253999498s: None 2024-04-15T02:43:00.392212891Z [2024-04-15 02:43:00,391: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fab829d3-67f7-49d5-a0d8-27c3dfdb2755] received 2024-04-15T02:43:00.395505810Z [2024-04-15 02:43:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1463b56b-4c51-4e4a-be7a-04510cd83f66] received 2024-04-15T02:43:00.406530651Z [2024-04-15 02:43:00,406: INFO/ForkPoolWorker-15] [fab829d3-67f7-49d5-a0d8-27c3dfdb2755] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:43:00.410944223Z [2024-04-15 02:43:00,410: INFO/ForkPoolWorker-16] [1463b56b-4c51-4e4a-be7a-04510cd83f66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:43:00.764050117Z [2024-04-15 02:43:00,758: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:43:00.788978040Z [2024-04-15 02:43:00,776: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:43:02.450857394Z [2024-04-15 02:43:02,450: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:43:02.456569485Z [2024-04-15 02:43:02,456: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:43:02.536502972Z [2024-04-15 02:43:02,536: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:43:02.545478867Z [2024-04-15 02:43:02,544: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:43:02.545669023Z [2024-04-15 02:43:02,545: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:43:02.545911621Z [2024-04-15 02:43:02,545: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:43:02.546152072Z [2024-04-15 02:43:02,546: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:43:02.546593649Z [2024-04-15 02:43:02,546: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:43:02.546740000Z [2024-04-15 02:43:02,546: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:43:02.659270117Z [2024-04-15 02:43:02,659: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:43:02.665586717Z [2024-04-15 02:43:02,665: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:43:02.671427939Z [2024-04-15 02:43:02,671: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:43:02.717751528Z [2024-04-15 02:43:02,717: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:43:02.718830680Z [2024-04-15 02:43:02,718: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:43:02.718847185Z [2024-04-15 02:43:02,718: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:43:02.719849989Z [2024-04-15 02:43:02,718: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:43:02.719869696Z [2024-04-15 02:43:02,719: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:43:02.720165937Z [2024-04-15 02:43:02,719: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:43:02.720179492Z [2024-04-15 02:43:02,720: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:43:02.836654102Z [2024-04-15 02:43:02,833: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:43:04.625041231Z [2024-04-15 02:43:04,624: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1463b56b-4c51-4e4a-be7a-04510cd83f66] succeeded in 4.222837394000635s: None 2024-04-15T02:43:05.420395101Z [2024-04-15 02:43:05,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fab829d3-67f7-49d5-a0d8-27c3dfdb2755] succeeded in 5.024741987999732s: None 2024-04-15T02:44:00.286900093Z [2024-04-15 02:44:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95abe8e7-4db8-4b24-bd16-85c832789b41] received 2024-04-15T02:44:00.298282018Z [2024-04-15 02:44:00,298: INFO/ForkPoolWorker-15] [95abe8e7-4db8-4b24-bd16-85c832789b41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:44:00.302323505Z [2024-04-15 02:44:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca966a5d-2ebf-49b4-95cd-4774aab37b68] received 2024-04-15T02:44:00.317338797Z [2024-04-15 02:44:00,317: INFO/ForkPoolWorker-16] [ca966a5d-2ebf-49b4-95cd-4774aab37b68] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:44:00.321472217Z [2024-04-15 02:44:00,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c29c32cd-ee04-43b8-b230-8034da5d82df] received 2024-04-15T02:44:00.361122515Z [2024-04-15 02:44:00,360: INFO/ForkPoolWorker-1] [c29c32cd-ee04-43b8-b230-8034da5d82df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:44:00.644383314Z [2024-04-15 02:44:00,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:44:00.705515358Z [2024-04-15 02:44:00,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:44:00.814110922Z [2024-04-15 02:44:00,808: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:44:01.178859998Z [2024-04-15 02:44:01,178: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:44:02.137163552Z [2024-04-15 02:44:02,136: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca966a5d-2ebf-49b4-95cd-4774aab37b68] succeeded in 1.8298143689999051s: None 2024-04-15T02:44:02.474040355Z [2024-04-15 02:44:02,473: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:44:02.477358852Z [2024-04-15 02:44:02,476: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:44:02.517421647Z [2024-04-15 02:44:02,517: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:44:02.525684333Z [2024-04-15 02:44:02,525: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:44:02.548222637Z [2024-04-15 02:44:02,525: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:44:02.549091228Z [2024-04-15 02:44:02,548: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:44:02.551151278Z [2024-04-15 02:44:02,549: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:44:02.554141605Z [2024-04-15 02:44:02,551: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:44:02.554403743Z [2024-04-15 02:44:02,554: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:44:02.725424418Z [2024-04-15 02:44:02,725: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:44:02.781521955Z [2024-04-15 02:44:02,781: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:44:02.784922571Z [2024-04-15 02:44:02,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:44:02.876638819Z [2024-04-15 02:44:02,875: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:44:02.884146129Z [2024-04-15 02:44:02,883: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:44:02.884163571Z [2024-04-15 02:44:02,883: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:44:02.884169353Z [2024-04-15 02:44:02,883: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:44:02.884173187Z [2024-04-15 02:44:02,883: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:44:02.884183756Z [2024-04-15 02:44:02,883: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:44:02.884187017Z [2024-04-15 02:44:02,884: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:44:03.113307102Z [2024-04-15 02:44:03,113: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:44:05.076922492Z [2024-04-15 02:44:05,076: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95abe8e7-4db8-4b24-bd16-85c832789b41] succeeded in 4.784599798000272s: None 2024-04-15T02:44:05.629757094Z [2024-04-15 02:44:05,629: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c29c32cd-ee04-43b8-b230-8034da5d82df] succeeded in 5.302233997999792s: None 2024-04-15T02:45:01.238785773Z [2024-04-15 02:45:01,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02a4f916-8152-4e5f-b5d2-f5cc263100b1] received 2024-04-15T02:45:01.248925117Z [2024-04-15 02:45:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03c3fe91-d171-44d5-b06b-840ec18d389a] received 2024-04-15T02:45:01.259141741Z [2024-04-15 02:45:01,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15e38c0e-d2c0-447a-8bae-5e9aa41836bc] received 2024-04-15T02:45:01.273963776Z [2024-04-15 02:45:01,273: INFO/ForkPoolWorker-15] [02a4f916-8152-4e5f-b5d2-f5cc263100b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:01.276263591Z [2024-04-15 02:45:01,275: INFO/ForkPoolWorker-1] [15e38c0e-d2c0-447a-8bae-5e9aa41836bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:45:01.279703271Z [2024-04-15 02:45:01,279: INFO/ForkPoolWorker-16] [03c3fe91-d171-44d5-b06b-840ec18d389a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:45:01.935499040Z [2024-04-15 02:45:01,931: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:45:02.008741413Z [2024-04-15 02:45:01,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:45:02.227301232Z [2024-04-15 02:45:02,224: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:45:03.746843139Z [2024-04-15 02:45:03,746: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:45:03.751994650Z [2024-04-15 02:45:03,751: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:03.809632304Z [2024-04-15 02:45:03,805: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:45:03.816828209Z [2024-04-15 02:45:03,814: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:03.818322828Z [2024-04-15 02:45:03,818: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:45:03.819520669Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:03.819611395Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:03.819720337Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:03.819752467Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:45:03.820142800Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:45:03.820153949Z [2024-04-15 02:45:03,819: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:03.915233459Z [2024-04-15 02:45:03,914: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:45:03.916491229Z [2024-04-15 02:45:03,916: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:03.916525698Z [2024-04-15 02:45:03,916: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:03.916790781Z [2024-04-15 02:45:03,916: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:03.916901198Z [2024-04-15 02:45:03,916: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:45:03.917236036Z [2024-04-15 02:45:03,917: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:45:03.917399205Z [2024-04-15 02:45:03,917: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:03.954837486Z [2024-04-15 02:45:03,953: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:45:03.963947175Z [2024-04-15 02:45:03,963: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:03.992890370Z [2024-04-15 02:45:03,992: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:04.033827881Z [2024-04-15 02:45:04,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:45:04.035441460Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:04.035458095Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:04.035567859Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:04.035588382Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:45:04.035799947Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:45:04.035812954Z [2024-04-15 02:45:04,035: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:04.051561322Z [2024-04-15 02:45:04,051: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:04.150940332Z [2024-04-15 02:45:04,150: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:04.831406207Z [2024-04-15 02:45:04,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1450f5-b593-43cb-a00a-ff8284b6e812] received 2024-04-15T02:45:04.896802288Z [2024-04-15 02:45:04,896: INFO/ForkPoolWorker-2] [ad1450f5-b593-43cb-a00a-ff8284b6e812] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:04.936026163Z [2024-04-15 02:45:04,935: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02a4f916-8152-4e5f-b5d2-f5cc263100b1] succeeded in 3.6952208269995026s: None 2024-04-15T02:45:05.199619329Z [2024-04-15 02:45:05,195: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:45:05.688814173Z [2024-04-15 02:45:05,688: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15e38c0e-d2c0-447a-8bae-5e9aa41836bc] succeeded in 4.425932516999637s: None 2024-04-15T02:45:06.415316165Z [2024-04-15 02:45:06,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[03c3fe91-d171-44d5-b06b-840ec18d389a] succeeded in 5.164741644999594s: None 2024-04-15T02:45:06.559969401Z [2024-04-15 02:45:06,559: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:45:06.562881124Z [2024-04-15 02:45:06,562: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:06.595687961Z [2024-04-15 02:45:06,595: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:45:06.596843822Z [2024-04-15 02:45:06,596: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:06.596981680Z [2024-04-15 02:45:06,596: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:06.597163369Z [2024-04-15 02:45:06,596: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:06.597292469Z [2024-04-15 02:45:06,597: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:45:06.597564260Z [2024-04-15 02:45:06,597: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:45:06.597763208Z [2024-04-15 02:45:06,597: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:06.687499295Z [2024-04-15 02:45:06,687: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:07.324008654Z [2024-04-15 02:45:07,323: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ad1450f5-b593-43cb-a00a-ff8284b6e812] succeeded in 2.447077767999872s: None 2024-04-15T02:45:08.295646637Z [2024-04-15 02:45:08,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74ab0bcf-4f38-4fd8-9f03-e30b6dd9ad9c] received 2024-04-15T02:45:08.315386981Z [2024-04-15 02:45:08,314: INFO/ForkPoolWorker-15] [74ab0bcf-4f38-4fd8-9f03-e30b6dd9ad9c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:45:08.631426925Z [2024-04-15 02:45:08,627: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:45:10.051577230Z [2024-04-15 02:45:10,051: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:45:10.056085000Z [2024-04-15 02:45:10,055: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:10.091355704Z [2024-04-15 02:45:10,091: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:45:10.093388723Z [2024-04-15 02:45:10,093: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:10.093581628Z [2024-04-15 02:45:10,093: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:10.093790234Z [2024-04-15 02:45:10,093: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:10.093964637Z [2024-04-15 02:45:10,093: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:45:10.094223704Z [2024-04-15 02:45:10,094: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:45:10.094313740Z [2024-04-15 02:45:10,094: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:10.195555264Z [2024-04-15 02:45:10,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:10.810459007Z [2024-04-15 02:45:10,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[74ab0bcf-4f38-4fd8-9f03-e30b6dd9ad9c] succeeded in 2.5050787819991456s: None 2024-04-15T02:45:11.341298926Z [2024-04-15 02:45:11,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71c79dbe-6630-41f8-b81f-46029d702623] received 2024-04-15T02:45:11.347495279Z [2024-04-15 02:45:11,347: INFO/ForkPoolWorker-15] [71c79dbe-6630-41f8-b81f-46029d702623] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:45:11.690224362Z [2024-04-15 02:45:11,686: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:45:13.176874580Z [2024-04-15 02:45:13,176: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:45:13.189086416Z [2024-04-15 02:45:13,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:45:13.216363764Z [2024-04-15 02:45:13,216: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:45:13.219202541Z [2024-04-15 02:45:13,218: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:45:13.219583351Z [2024-04-15 02:45:13,219: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:45:13.219748587Z [2024-04-15 02:45:13,219: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:45:13.219809263Z [2024-04-15 02:45:13,219: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:45:13.221074961Z [2024-04-15 02:45:13,220: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:45:13.221087449Z [2024-04-15 02:45:13,221: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:45:13.317011447Z [2024-04-15 02:45:13,316: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:45:13.927891615Z [2024-04-15 02:45:13,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71c79dbe-6630-41f8-b81f-46029d702623] succeeded in 2.5848518480006533s: None 2024-04-15T02:46:01.141378796Z [2024-04-15 02:46:01,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[036ad82d-e7b4-4cdb-9602-4b1144446e74] received 2024-04-15T02:46:01.148691742Z [2024-04-15 02:46:01,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dac7b67e-f357-4fea-b0c9-c5a3fbd8312b] received 2024-04-15T02:46:01.152384681Z [2024-04-15 02:46:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b67cc33-8a11-4d7f-819d-ed68f8a94f7b] received 2024-04-15T02:46:01.161764665Z [2024-04-15 02:46:01,161: INFO/ForkPoolWorker-15] [036ad82d-e7b4-4cdb-9602-4b1144446e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:46:01.172897679Z [2024-04-15 02:46:01,172: INFO/ForkPoolWorker-16] [dac7b67e-f357-4fea-b0c9-c5a3fbd8312b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:46:01.175739647Z [2024-04-15 02:46:01,175: INFO/ForkPoolWorker-1] [0b67cc33-8a11-4d7f-819d-ed68f8a94f7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:46:01.557147120Z [2024-04-15 02:46:01,548: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:46:01.714341645Z [2024-04-15 02:46:01,710: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:46:01.858887757Z [2024-04-15 02:46:01,853: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:46:02.154260322Z [2024-04-15 02:46:02,153: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:46:02.986705675Z [2024-04-15 02:46:02,986: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dac7b67e-f357-4fea-b0c9-c5a3fbd8312b] succeeded in 1.8339516759997423s: None 2024-04-15T02:46:03.777748422Z [2024-04-15 02:46:03,777: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:46:03.781936026Z [2024-04-15 02:46:03,781: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:46:03.782641152Z [2024-04-15 02:46:03,782: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:46:03.786135073Z [2024-04-15 02:46:03,785: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:46:03.815406193Z [2024-04-15 02:46:03,814: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:46:03.824950698Z [2024-04-15 02:46:03,819: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:46:03.824968291Z [2024-04-15 02:46:03,820: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:46:03.824972605Z [2024-04-15 02:46:03,820: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:46:03.824976909Z [2024-04-15 02:46:03,820: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:46:03.824980099Z [2024-04-15 02:46:03,820: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:46:03.824983190Z [2024-04-15 02:46:03,820: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:46:03.856760138Z [2024-04-15 02:46:03,855: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:46:03.890206657Z [2024-04-15 02:46:03,889: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:46:03.890316952Z [2024-04-15 02:46:03,890: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:46:03.890473785Z [2024-04-15 02:46:03,890: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:46:03.890543000Z [2024-04-15 02:46:03,890: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:46:03.890819276Z [2024-04-15 02:46:03,890: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:46:03.890862759Z [2024-04-15 02:46:03,890: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:46:04.047044411Z [2024-04-15 02:46:04,046: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:46:04.061380886Z [2024-04-15 02:46:04,061: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:46:05.981331814Z [2024-04-15 02:46:05,980: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b67cc33-8a11-4d7f-819d-ed68f8a94f7b] succeeded in 4.819495989000643s: None 2024-04-15T02:46:06.004871216Z [2024-04-15 02:46:06,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[036ad82d-e7b4-4cdb-9602-4b1144446e74] succeeded in 4.857900558999972s: None 2024-04-15T02:47:00.844732825Z [2024-04-15 02:47:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb1e72fe-3637-44d5-9c77-77824663f5c2] received 2024-04-15T02:47:00.858379594Z [2024-04-15 02:47:00,858: INFO/ForkPoolWorker-15] [eb1e72fe-3637-44d5-9c77-77824663f5c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:47:00.859557863Z [2024-04-15 02:47:00,859: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1457c34-0b30-4d06-890e-f92a3b733dc0] received 2024-04-15T02:47:00.899954493Z [2024-04-15 02:47:00,897: INFO/ForkPoolWorker-16] [c1457c34-0b30-4d06-890e-f92a3b733dc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:47:01.165622612Z [2024-04-15 02:47:01,162: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:47:01.547774874Z [2024-04-15 02:47:01,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:47:02.710416511Z [2024-04-15 02:47:02,710: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:47:02.713823020Z [2024-04-15 02:47:02,713: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:47:02.773747795Z [2024-04-15 02:47:02,773: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:47:02.775182430Z [2024-04-15 02:47:02,774: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:47:02.775321832Z [2024-04-15 02:47:02,775: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:47:02.775565313Z [2024-04-15 02:47:02,775: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:47:02.775753325Z [2024-04-15 02:47:02,775: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:47:02.776058775Z [2024-04-15 02:47:02,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:47:02.776203413Z [2024-04-15 02:47:02,776: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:47:02.948954716Z [2024-04-15 02:47:02,938: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:47:03.448529745Z [2024-04-15 02:47:03,448: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:47:03.454814111Z [2024-04-15 02:47:03,454: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:47:03.484257722Z [2024-04-15 02:47:03,484: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:47:03.485351463Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:47:03.485362560Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:47:03.485387119Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:47:03.485393960Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:47:03.485638281Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:47:03.485645432Z [2024-04-15 02:47:03,485: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:47:03.576464092Z [2024-04-15 02:47:03,576: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:47:05.114512921Z [2024-04-15 02:47:05,114: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eb1e72fe-3637-44d5-9c77-77824663f5c2] succeeded in 4.268651089000741s: None 2024-04-15T02:47:05.308600630Z [2024-04-15 02:47:05,308: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1457c34-0b30-4d06-890e-f92a3b733dc0] succeeded in 4.446594856999582s: None 2024-04-15T02:48:00.489626345Z [2024-04-15 02:48:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[369da96c-269b-43b2-83cf-3a46d51cfd4c] received 2024-04-15T02:48:00.498754064Z [2024-04-15 02:48:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[851141ec-cf61-4a04-877a-e88858097d90] received 2024-04-15T02:48:00.499322213Z [2024-04-15 02:48:00,499: INFO/ForkPoolWorker-15] [369da96c-269b-43b2-83cf-3a46d51cfd4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:48:00.508382660Z [2024-04-15 02:48:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31d29273-5736-44fb-ac4b-098e1d7bcb8a] received 2024-04-15T02:48:00.519429766Z [2024-04-15 02:48:00,519: INFO/ForkPoolWorker-1] [31d29273-5736-44fb-ac4b-098e1d7bcb8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:48:00.520262084Z [2024-04-15 02:48:00,520: INFO/ForkPoolWorker-16] [851141ec-cf61-4a04-877a-e88858097d90] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:48:00.876860848Z [2024-04-15 02:48:00,873: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:48:00.883137886Z [2024-04-15 02:48:00,879: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:48:00.947586577Z [2024-04-15 02:48:00,944: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:48:01.281248497Z [2024-04-15 02:48:01,281: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:48:02.283538614Z [2024-04-15 02:48:02,283: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[851141ec-cf61-4a04-877a-e88858097d90] succeeded in 1.776867898999626s: None 2024-04-15T02:48:02.564934759Z [2024-04-15 02:48:02,564: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:48:02.568239694Z [2024-04-15 02:48:02,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:48:02.636885010Z [2024-04-15 02:48:02,636: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:48:02.638045454Z [2024-04-15 02:48:02,637: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:48:02.638115567Z [2024-04-15 02:48:02,637: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:48:02.638353823Z [2024-04-15 02:48:02,638: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:48:02.639328462Z [2024-04-15 02:48:02,638: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:48:02.639657968Z [2024-04-15 02:48:02,639: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:48:02.640965039Z [2024-04-15 02:48:02,639: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:48:02.749388171Z [2024-04-15 02:48:02,749: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:48:03.101884715Z [2024-04-15 02:48:03,101: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:48:03.105322612Z [2024-04-15 02:48:03,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:48:03.164181360Z [2024-04-15 02:48:03,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:48:03.168011357Z [2024-04-15 02:48:03,167: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:48:03.168168154Z [2024-04-15 02:48:03,167: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:48:03.170514640Z [2024-04-15 02:48:03,168: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:48:03.171748812Z [2024-04-15 02:48:03,171: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:48:03.173003747Z [2024-04-15 02:48:03,172: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:48:03.173189157Z [2024-04-15 02:48:03,173: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:48:03.293566081Z [2024-04-15 02:48:03,293: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:48:04.901182034Z [2024-04-15 02:48:04,900: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31d29273-5736-44fb-ac4b-098e1d7bcb8a] succeeded in 4.388397861000158s: None 2024-04-15T02:48:05.692392617Z [2024-04-15 02:48:05,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[369da96c-269b-43b2-83cf-3a46d51cfd4c] succeeded in 5.201070957999946s: None 2024-04-15T02:49:01.048519933Z [2024-04-15 02:49:01,047: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1454a0b7-d67b-4434-9e6e-e19ebd18faa8] received 2024-04-15T02:49:01.060490857Z [2024-04-15 02:49:01,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c0008bd-f989-43e7-a581-cc5ed9256482] received 2024-04-15T02:49:01.076992374Z [2024-04-15 02:49:01,076: INFO/ForkPoolWorker-16] [0c0008bd-f989-43e7-a581-cc5ed9256482] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:49:01.078444826Z [2024-04-15 02:49:01,076: INFO/ForkPoolWorker-15] [1454a0b7-d67b-4434-9e6e-e19ebd18faa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:49:01.454609648Z [2024-04-15 02:49:01,448: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:49:01.467508885Z [2024-04-15 02:49:01,463: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:49:03.074389685Z [2024-04-15 02:49:03,073: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:49:03.078053984Z [2024-04-15 02:49:03,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:49:03.091507612Z [2024-04-15 02:49:03,091: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:49:03.097475310Z [2024-04-15 02:49:03,096: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:49:03.106946159Z [2024-04-15 02:49:03,106: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:49:03.110248518Z [2024-04-15 02:49:03,109: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:49:03.110292892Z [2024-04-15 02:49:03,110: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:49:03.110516065Z [2024-04-15 02:49:03,110: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:49:03.110550944Z [2024-04-15 02:49:03,110: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:49:03.111145705Z [2024-04-15 02:49:03,110: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:49:03.111270078Z [2024-04-15 02:49:03,111: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:49:03.127445377Z [2024-04-15 02:49:03,127: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:49:03.129055557Z [2024-04-15 02:49:03,128: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:49:03.129114420Z [2024-04-15 02:49:03,129: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:49:03.129251111Z [2024-04-15 02:49:03,129: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:49:03.129302654Z [2024-04-15 02:49:03,129: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:49:03.129546152Z [2024-04-15 02:49:03,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:49:03.129620006Z [2024-04-15 02:49:03,129: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:49:03.195350666Z [2024-04-15 02:49:03,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:49:03.212179323Z [2024-04-15 02:49:03,211: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:49:04.665020604Z [2024-04-15 02:49:04,664: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1454a0b7-d67b-4434-9e6e-e19ebd18faa8] succeeded in 3.6125449640003353s: None 2024-04-15T02:49:05.037661954Z [2024-04-15 02:49:05,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c0008bd-f989-43e7-a581-cc5ed9256482] succeeded in 3.973042157999771s: None 2024-04-15T02:50:00.769274136Z [2024-04-15 02:50:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8aea3dc3-d59c-40f7-b7b8-b17f4dd15105] received 2024-04-15T02:50:00.780556032Z [2024-04-15 02:50:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1362e934-dd82-4d61-9337-122592b5da71] received 2024-04-15T02:50:00.786200773Z [2024-04-15 02:50:00,785: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a38f4735-507c-4866-9690-42f32a08e6a2] received 2024-04-15T02:50:00.790077862Z [2024-04-15 02:50:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75fa4dc4-8a86-48a4-88eb-70680f5644ba] received 2024-04-15T02:50:00.810126353Z [2024-04-15 02:50:00,801: INFO/ForkPoolWorker-15] [8aea3dc3-d59c-40f7-b7b8-b17f4dd15105] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:00.810134662Z [2024-04-15 02:50:00,801: INFO/ForkPoolWorker-1] [a38f4735-507c-4866-9690-42f32a08e6a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:50:00.810138057Z [2024-04-15 02:50:00,803: INFO/ForkPoolWorker-16] [1362e934-dd82-4d61-9337-122592b5da71] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:50:00.810141024Z [2024-04-15 02:50:00,805: INFO/ForkPoolWorker-2] [75fa4dc4-8a86-48a4-88eb-70680f5644ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:50:01.163442889Z [2024-04-15 02:50:01,160: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:50:01.204493804Z [2024-04-15 02:50:01,201: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:50:01.351040717Z [2024-04-15 02:50:01,343: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:50:01.619972101Z [2024-04-15 02:50:01,619: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:01.741229733Z [2024-04-15 02:50:01,737: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:50:02.841828657Z [2024-04-15 02:50:02,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1362e934-dd82-4d61-9337-122592b5da71] succeeded in 2.0574269550006647s: None 2024-04-15T02:50:02.966905709Z [2024-04-15 02:50:02,966: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:50:02.978690234Z [2024-04-15 02:50:02,973: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:03.084356727Z [2024-04-15 02:50:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:50:03.094444492Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:03.094512455Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:03.094575065Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:03.094608618Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:50:03.094895966Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:50:03.094903263Z [2024-04-15 02:50:03,094: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:03.200732864Z [2024-04-15 02:50:03,200: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:03.287914165Z [2024-04-15 02:50:03,287: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:50:03.291985800Z [2024-04-15 02:50:03,291: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:03.353924189Z [2024-04-15 02:50:03,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:50:03.357292312Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:03.357356538Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:03.357497770Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:03.357607680Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:50:03.357922596Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:50:03.358066752Z [2024-04-15 02:50:03,357: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:03.520253500Z [2024-04-15 02:50:03,519: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:03.744876051Z [2024-04-15 02:50:03,744: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:50:03.748073715Z [2024-04-15 02:50:03,747: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:03.794576014Z [2024-04-15 02:50:03,794: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:50:03.796387932Z [2024-04-15 02:50:03,796: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:03.796620073Z [2024-04-15 02:50:03,796: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:03.796939465Z [2024-04-15 02:50:03,796: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:03.797110709Z [2024-04-15 02:50:03,796: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:50:03.797416324Z [2024-04-15 02:50:03,797: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:50:03.797622687Z [2024-04-15 02:50:03,797: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:03.937974696Z [2024-04-15 02:50:03,937: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:04.255423115Z [2024-04-15 02:50:04,254: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8aea3dc3-d59c-40f7-b7b8-b17f4dd15105] succeeded in 3.4718806629998653s: None 2024-04-15T02:50:04.732338827Z [2024-04-15 02:50:04,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[458ad121-5cf8-4679-b27a-02084f9a3877] received 2024-04-15T02:50:04.743524780Z [2024-04-15 02:50:04,743: INFO/ForkPoolWorker-15] [458ad121-5cf8-4679-b27a-02084f9a3877] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:05.088849497Z [2024-04-15 02:50:05,085: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:50:05.130570066Z [2024-04-15 02:50:05,130: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a38f4735-507c-4866-9690-42f32a08e6a2] succeeded in 4.341755125999953s: None 2024-04-15T02:50:05.504337655Z [2024-04-15 02:50:05,503: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[75fa4dc4-8a86-48a4-88eb-70680f5644ba] succeeded in 4.712933481999244s: None 2024-04-15T02:50:06.358570268Z [2024-04-15 02:50:06,358: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:50:06.361969459Z [2024-04-15 02:50:06,361: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:06.387358107Z [2024-04-15 02:50:06,387: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:50:06.388658985Z [2024-04-15 02:50:06,388: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:06.388760142Z [2024-04-15 02:50:06,388: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:06.389220614Z [2024-04-15 02:50:06,388: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:06.389389178Z [2024-04-15 02:50:06,389: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:50:06.389768800Z [2024-04-15 02:50:06,389: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:50:06.390402680Z [2024-04-15 02:50:06,390: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:06.465597563Z [2024-04-15 02:50:06,465: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:07.060366648Z [2024-04-15 02:50:07,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[458ad121-5cf8-4679-b27a-02084f9a3877] succeeded in 2.324809126999753s: None 2024-04-15T02:50:07.421567658Z [2024-04-15 02:50:07,421: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be381803-3f54-434e-ad07-f90881df1b60] received 2024-04-15T02:50:07.437420855Z [2024-04-15 02:50:07,437: INFO/ForkPoolWorker-15] [be381803-3f54-434e-ad07-f90881df1b60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:50:07.700481617Z [2024-04-15 02:50:07,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:50:08.868064224Z [2024-04-15 02:50:08,867: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:50:08.871184132Z [2024-04-15 02:50:08,870: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:08.895676364Z [2024-04-15 02:50:08,895: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:50:08.896653133Z [2024-04-15 02:50:08,896: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:08.896664479Z [2024-04-15 02:50:08,896: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:08.897085987Z [2024-04-15 02:50:08,896: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:08.897095992Z [2024-04-15 02:50:08,897: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:50:08.897275588Z [2024-04-15 02:50:08,897: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:50:08.897302127Z [2024-04-15 02:50:08,897: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:08.974237303Z [2024-04-15 02:50:08,974: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:09.522498209Z [2024-04-15 02:50:09,521: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be381803-3f54-434e-ad07-f90881df1b60] succeeded in 2.0960521150000204s: None 2024-04-15T02:50:09.796530300Z [2024-04-15 02:50:09,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7eb5d42-c674-40c7-be46-30fa800defa6] received 2024-04-15T02:50:09.821678043Z [2024-04-15 02:50:09,821: INFO/ForkPoolWorker-15] [d7eb5d42-c674-40c7-be46-30fa800defa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:50:10.133578439Z [2024-04-15 02:50:10,130: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:50:11.352984852Z [2024-04-15 02:50:11,352: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:50:11.356472494Z [2024-04-15 02:50:11,356: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:50:11.392281278Z [2024-04-15 02:50:11,392: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:50:11.394923045Z [2024-04-15 02:50:11,394: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:50:11.394937569Z [2024-04-15 02:50:11,394: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:50:11.395046465Z [2024-04-15 02:50:11,394: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:50:11.395073253Z [2024-04-15 02:50:11,395: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:50:11.395266080Z [2024-04-15 02:50:11,395: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:50:11.395276961Z [2024-04-15 02:50:11,395: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:50:11.476164999Z [2024-04-15 02:50:11,475: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:12.093228769Z [2024-04-15 02:50:12,092: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7eb5d42-c674-40c7-be46-30fa800defa6] succeeded in 2.2934195879997787s: None 2024-04-15T02:50:25.010171063Z [2024-04-15 02:50:25,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[594732e9-e296-4832-93f3-c02f190ffb17] received 2024-04-15T02:50:25.018919684Z [2024-04-15 02:50:25,018: INFO/ForkPoolWorker-15] [594732e9-e296-4832-93f3-c02f190ffb17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415025023_554907', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T02:50:25.266946569Z [2024-04-15 02:50:25,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-15T02:50:25.557171071Z [2024-04-15 02:50:25,556: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:50:26.125273030Z [2024-04-15 02:50:26,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[594732e9-e296-4832-93f3-c02f190ffb17] succeeded in 1.1129921070005366s: None 2024-04-15T02:51:00.485669594Z [2024-04-15 02:51:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33b0b5b5-4980-46d0-b4d5-599e1e73dd10] received 2024-04-15T02:51:00.487403709Z [2024-04-15 02:51:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27b83160-cbac-45ac-9162-e47d68f7e0da] received 2024-04-15T02:51:00.499910898Z [2024-04-15 02:51:00,499: INFO/ForkPoolWorker-16] [27b83160-cbac-45ac-9162-e47d68f7e0da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:51:00.500046274Z [2024-04-15 02:51:00,499: INFO/ForkPoolWorker-15] [33b0b5b5-4980-46d0-b4d5-599e1e73dd10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:51:00.874038523Z [2024-04-15 02:51:00,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:51:00.881004081Z [2024-04-15 02:51:00,877: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:51:02.345771935Z [2024-04-15 02:51:02,345: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:51:02.349244242Z [2024-04-15 02:51:02,348: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:51:02.391022161Z [2024-04-15 02:51:02,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:51:02.392843745Z [2024-04-15 02:51:02,392: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:51:02.392862864Z [2024-04-15 02:51:02,392: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:51:02.393447609Z [2024-04-15 02:51:02,393: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:51:02.393501731Z [2024-04-15 02:51:02,393: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:51:02.393745399Z [2024-04-15 02:51:02,393: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:51:02.393778072Z [2024-04-15 02:51:02,393: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:51:02.525463470Z [2024-04-15 02:51:02,525: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:51:02.528758704Z [2024-04-15 02:51:02,528: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:51:02.529710797Z [2024-04-15 02:51:02,529: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:51:02.584339850Z [2024-04-15 02:51:02,584: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:51:02.593434743Z [2024-04-15 02:51:02,593: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:51:02.594218736Z [2024-04-15 02:51:02,594: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:51:02.594400910Z [2024-04-15 02:51:02,594: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:51:02.594779743Z [2024-04-15 02:51:02,594: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:51:02.595049713Z [2024-04-15 02:51:02,594: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:51:02.595148358Z [2024-04-15 02:51:02,595: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:51:02.687522768Z [2024-04-15 02:51:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:51:04.581246762Z [2024-04-15 02:51:04,580: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33b0b5b5-4980-46d0-b4d5-599e1e73dd10] succeeded in 4.0920384160008325s: None 2024-04-15T02:51:04.988958186Z [2024-04-15 02:51:04,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27b83160-cbac-45ac-9162-e47d68f7e0da] succeeded in 4.500001356999746s: None 2024-04-15T02:51:51.304070857Z [2024-04-15 02:51:51,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34350364-dddb-49a7-b3f5-c7a89c7b3791] received 2024-04-15T02:51:51.331907628Z [2024-04-15 02:51:51,331: INFO/ForkPoolWorker-15] [34350364-dddb-49a7-b3f5-c7a89c7b3791] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:51:52.254014594Z [2024-04-15 02:51:52,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:51:54.013449918Z [2024-04-15 02:51:54,013: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:51:54.018452872Z [2024-04-15 02:51:54,017: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:51:54.065837268Z [2024-04-15 02:51:54,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:51:54.068381744Z [2024-04-15 02:51:54,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69096336-aa1b-472e-81e3-9574ac63b8bc] received 2024-04-15T02:51:54.070343259Z [2024-04-15 02:51:54,069: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:51:54.070526204Z [2024-04-15 02:51:54,070: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:51:54.070610168Z [2024-04-15 02:51:54,070: INFO/ForkPoolWorker-15] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:51:54.070775784Z [2024-04-15 02:51:54,070: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:51:54.070857035Z [2024-04-15 02:51:54,070: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:51:54.071145694Z [2024-04-15 02:51:54,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:51:54.073545137Z [2024-04-15 02:51:54,073: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:51:54.079870904Z [2024-04-15 02:51:54,079: INFO/ForkPoolWorker-16] [69096336-aa1b-472e-81e3-9574ac63b8bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:51:54.086431204Z [2024-04-15 02:51:54,086: INFO/ForkPoolWorker-15] Creating DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:51:54.215445417Z [2024-04-15 02:51:54,215: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:51:54.427690669Z [2024-04-15 02:51:54,423: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:51:55.618492065Z [2024-04-15 02:51:55,618: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34350364-dddb-49a7-b3f5-c7a89c7b3791] succeeded in 4.3112039679999725s: None 2024-04-15T02:51:55.931439512Z [2024-04-15 02:51:55,930: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:51:55.936119389Z [2024-04-15 02:51:55,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:51:55.988930731Z [2024-04-15 02:51:55,988: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:51:55.990470768Z [2024-04-15 02:51:55,990: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:51:55.990622408Z [2024-04-15 02:51:55,990: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:51:55.990721940Z [2024-04-15 02:51:55,990: INFO/ForkPoolWorker-16] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:51:55.990874963Z [2024-04-15 02:51:55,990: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:51:55.990925887Z [2024-04-15 02:51:55,990: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:51:55.991163073Z [2024-04-15 02:51:55,991: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:51:55.991237329Z [2024-04-15 02:51:55,991: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:51:55.998411275Z [2024-04-15 02:51:55,998: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:51:56.093575955Z [2024-04-15 02:51:56,093: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:51:58.139867137Z [2024-04-15 02:51:58,138: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[69096336-aa1b-472e-81e3-9574ac63b8bc] succeeded in 4.066686334000224s: None 2024-04-15T02:52:00.483244371Z [2024-04-15 02:52:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[69e3dca1-94eb-4a3d-8601-7f1c6af8b8da] received 2024-04-15T02:52:00.484537150Z [2024-04-15 02:52:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[540b615e-0f3a-49de-a553-79dc839bb9cf] received 2024-04-15T02:52:00.496048186Z [2024-04-15 02:52:00,495: INFO/ForkPoolWorker-15] [69e3dca1-94eb-4a3d-8601-7f1c6af8b8da] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:52:00.499388355Z [2024-04-15 02:52:00,499: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6222330-cdca-49e4-9d87-e2a776b675ec] received 2024-04-15T02:52:00.503490949Z [2024-04-15 02:52:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f19089de-8f35-4cb6-8c73-f0919ad2a4aa] received 2024-04-15T02:52:00.510082400Z [2024-04-15 02:52:00,509: INFO/ForkPoolWorker-16] [540b615e-0f3a-49de-a553-79dc839bb9cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:52:00.517564209Z [2024-04-15 02:52:00,515: INFO/ForkPoolWorker-1] [e6222330-cdca-49e4-9d87-e2a776b675ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:52:00.518829267Z [2024-04-15 02:52:00,518: INFO/ForkPoolWorker-2] [f19089de-8f35-4cb6-8c73-f0919ad2a4aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:52:00.534581246Z [2024-04-15 02:52:00,534: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6202ab1-db4c-48cd-9ec1-d2ef43e0b7f7] received 2024-04-15T02:52:00.548249414Z [2024-04-15 02:52:00,547: INFO/ForkPoolWorker-3] [b6202ab1-db4c-48cd-9ec1-d2ef43e0b7f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:52:01.068184682Z [2024-04-15 02:52:01,058: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:52:01.157098377Z [2024-04-15 02:52:01,152: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:52:01.234922665Z [2024-04-15 02:52:01,225: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:52:01.621834526Z [2024-04-15 02:52:01,608: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:52:01.743103656Z [2024-04-15 02:52:01,725: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:52:01.920106578Z [2024-04-15 02:52:01,919: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:03.445378556Z [2024-04-15 02:52:03,445: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[69e3dca1-94eb-4a3d-8601-7f1c6af8b8da] succeeded in 2.958927560999655s: None 2024-04-15T02:52:03.893536713Z [2024-04-15 02:52:03,884: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:52:03.893549376Z [2024-04-15 02:52:03,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:03.984902273Z [2024-04-15 02:52:03,984: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:52:03.986326151Z [2024-04-15 02:52:03,986: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:03.986338117Z [2024-04-15 02:52:03,986: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:03.986397422Z [2024-04-15 02:52:03,986: INFO/ForkPoolWorker-2] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:03.986520716Z [2024-04-15 02:52:03,986: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:03.986544950Z [2024-04-15 02:52:03,986: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:52:03.990972275Z [2024-04-15 02:52:03,990: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:52:03.990988670Z [2024-04-15 02:52:03,990: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:03.995383309Z [2024-04-15 02:52:03,995: INFO/ForkPoolWorker-2] Creating DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:04.103533587Z [2024-04-15 02:52:04,103: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:04.327924137Z [2024-04-15 02:52:04,325: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:52:04.329765468Z [2024-04-15 02:52:04,329: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:04.359457954Z [2024-04-15 02:52:04,359: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-15T02:52:04.366463802Z [2024-04-15 02:52:04,365: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:04.379718124Z [2024-04-15 02:52:04,379: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:52:04.383377862Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:04.383441525Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:04.383511783Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:04.383675169Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:04.383743189Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:52:04.384014772Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:52:04.384090051Z [2024-04-15 02:52:04,383: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:04.390536011Z [2024-04-15 02:52:04,390: INFO/ForkPoolWorker-1] Creating DAG vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:04.432147660Z [2024-04-15 02:52:04,431: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-15T02:52:04.433353517Z [2024-04-15 02:52:04,433: INFO/ForkPoolWorker-3] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:04.433459983Z [2024-04-15 02:52:04,433: INFO/ForkPoolWorker-3] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:04.433609260Z [2024-04-15 02:52:04,433: INFO/ForkPoolWorker-3] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:04.433821482Z [2024-04-15 02:52:04,433: INFO/ForkPoolWorker-3] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:04.433971377Z [2024-04-15 02:52:04,433: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-15T02:52:04.434515056Z [2024-04-15 02:52:04,434: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:52:04.434937369Z [2024-04-15 02:52:04,434: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:04.441417614Z [2024-04-15 02:52:04,441: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:04.489319726Z [2024-04-15 02:52:04,489: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:04.575095718Z [2024-04-15 02:52:04,574: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:04.664519516Z [2024-04-15 02:52:04,664: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:52:04.667659411Z [2024-04-15 02:52:04,667: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:04.746622305Z [2024-04-15 02:52:04,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:52:04.747474339Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:04.747484699Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:04.747522413Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:04.747603694Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:04.747632950Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:52:04.747891891Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:52:04.747933458Z [2024-04-15 02:52:04,747: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:04.752121812Z [2024-04-15 02:52:04,751: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:04.945459193Z [2024-04-15 02:52:04,945: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:04.954725243Z [2024-04-15 02:52:04,954: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a816db43-4026-42e3-bbf0-69f4dd3485e7] received 2024-04-15T02:52:04.962639739Z [2024-04-15 02:52:04,962: INFO/ForkPoolWorker-15] [a816db43-4026-42e3-bbf0-69f4dd3485e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:05.379895146Z [2024-04-15 02:52:05,376: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:52:05.783700578Z [2024-04-15 02:52:05,783: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f19089de-8f35-4cb6-8c73-f0919ad2a4aa] succeeded in 5.275353512999573s: None 2024-04-15T02:52:06.121483746Z [2024-04-15 02:52:06,121: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6222330-cdca-49e4-9d87-e2a776b675ec] succeeded in 5.617906079000022s: None 2024-04-15T02:52:06.551095487Z [2024-04-15 02:52:06,550: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[b6202ab1-db4c-48cd-9ec1-d2ef43e0b7f7] succeeded in 6.012961786000233s: None 2024-04-15T02:52:06.649142293Z [2024-04-15 02:52:06,648: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:52:06.655333541Z [2024-04-15 02:52:06,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:06.700556537Z [2024-04-15 02:52:06,700: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:52:06.702049901Z [2024-04-15 02:52:06,701: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:06.702174249Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:06.702250022Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:06.702444316Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:06.702506754Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:52:06.702805197Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:52:06.702863643Z [2024-04-15 02:52:06,702: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:06.711386353Z [2024-04-15 02:52:06,711: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:06.758735661Z [2024-04-15 02:52:06,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[540b615e-0f3a-49de-a553-79dc839bb9cf] succeeded in 6.259725454000545s: None 2024-04-15T02:52:06.784670606Z [2024-04-15 02:52:06,784: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:07.294302433Z [2024-04-15 02:52:07,293: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a816db43-4026-42e3-bbf0-69f4dd3485e7] succeeded in 2.3378689899991514s: None 2024-04-15T02:52:08.063965831Z [2024-04-15 02:52:08,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca2c3b37-636c-4062-8ec1-9c5d17f6282a] received 2024-04-15T02:52:08.078377579Z [2024-04-15 02:52:08,078: INFO/ForkPoolWorker-15] [ca2c3b37-636c-4062-8ec1-9c5d17f6282a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'split_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:08.331560208Z [2024-04-15 02:52:08,328: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:52:09.584463183Z [2024-04-15 02:52:09,584: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:52:09.587548200Z [2024-04-15 02:52:09,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:09.621805475Z [2024-04-15 02:52:09,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:52:09.624060326Z [2024-04-15 02:52:09,623: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:09.624129500Z [2024-04-15 02:52:09,624: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:09.624197033Z [2024-04-15 02:52:09,624: INFO/ForkPoolWorker-15] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:09.624431480Z [2024-04-15 02:52:09,624: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:09.624496185Z [2024-04-15 02:52:09,624: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:52:09.626136731Z [2024-04-15 02:52:09,625: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:52:09.626192862Z [2024-04-15 02:52:09,626: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:09.635765651Z [2024-04-15 02:52:09,633: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:09.732999244Z [2024-04-15 02:52:09,732: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:10.342280347Z [2024-04-15 02:52:10,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ca2c3b37-636c-4062-8ec1-9c5d17f6282a] succeeded in 2.271323768000002s: None 2024-04-15T02:52:11.064190346Z [2024-04-15 02:52:11,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4016ddf-dfaa-43d7-9de7-5090fb55cc56] received 2024-04-15T02:52:11.075586199Z [2024-04-15 02:52:11,075: INFO/ForkPoolWorker-15] [b4016ddf-dfaa-43d7-9de7-5090fb55cc56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'collect_metrics', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:52:11.370857604Z [2024-04-15 02:52:11,365: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:52:12.736525163Z [2024-04-15 02:52:12,736: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:52:12.742801982Z [2024-04-15 02:52:12,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:12.787177648Z [2024-04-15 02:52:12,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:52:12.790417883Z [2024-04-15 02:52:12,789: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:12.790467447Z [2024-04-15 02:52:12,790: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:12.790477119Z [2024-04-15 02:52:12,790: INFO/ForkPoolWorker-15] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:12.790635110Z [2024-04-15 02:52:12,790: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:12.790693845Z [2024-04-15 02:52:12,790: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:52:12.791074411Z [2024-04-15 02:52:12,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:52:12.791192795Z [2024-04-15 02:52:12,791: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:12.798854036Z [2024-04-15 02:52:12,798: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:12.937656530Z [2024-04-15 02:52:12,937: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:13.392490949Z [2024-04-15 02:52:13,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56dba0ee-357e-43f2-bf07-a0feacd3623b] received 2024-04-15T02:52:13.401299043Z [2024-04-15 02:52:13,400: INFO/ForkPoolWorker-16] [56dba0ee-357e-43f2-bf07-a0feacd3623b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'send_prometheus', 'scheduled__2024-04-15T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:52:13.481316841Z [2024-04-15 02:52:13,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b4016ddf-dfaa-43d7-9de7-5090fb55cc56] succeeded in 2.4144223009998314s: None 2024-04-15T02:52:13.760275875Z [2024-04-15 02:52:13,757: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:52:14.981648564Z [2024-04-15 02:52:14,981: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:52:14.985057616Z [2024-04-15 02:52:14,984: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:52:15.033259485Z [2024-04-15 02:52:15,033: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:52:15.039260110Z [2024-04-15 02:52:15,038: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:52:15.040925952Z [2024-04-15 02:52:15,040: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:52:15.041491847Z [2024-04-15 02:52:15,041: INFO/ForkPoolWorker-16] Read VIM 16584fa7-eab2-4416-b9e0-e82d3f2f9576 (basic01_109589) 2024-04-15T02:52:15.041852310Z [2024-04-15 02:52:15,041: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'name': 'basic01_109589', 'vim_type': 'openstack'}] 2024-04-15T02:52:15.042117461Z [2024-04-15 02:52:15,041: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:52:15.042643239Z [2024-04-15 02:52:15,042: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:52:15.042862581Z [2024-04-15 02:52:15,042: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:52:15.051373166Z [2024-04-15 02:52:15,051: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576 2024-04-15T02:52:15.118876907Z [2024-04-15 02:52:15,118: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:52:15.577967059Z [2024-04-15 02:52:15,577: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56dba0ee-357e-43f2-bf07-a0feacd3623b] succeeded in 2.1828507870004614s: None 2024-04-15T02:53:00.376738165Z [2024-04-15 02:53:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b9705f7-312e-49d9-9377-0ee0b888a09f] received 2024-04-15T02:53:00.378594495Z [2024-04-15 02:53:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44d6c796-4c18-4f0b-96a1-ab1ac1107c5b] received 2024-04-15T02:53:00.382571164Z [2024-04-15 02:53:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b89cca8d-8126-4e6a-910b-7ddc316bd775] received 2024-04-15T02:53:00.385487673Z [2024-04-15 02:53:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8a8522b-501e-4b8a-aefe-e502920697eb] received 2024-04-15T02:53:00.387943282Z [2024-04-15 02:53:00,387: INFO/ForkPoolWorker-15] [8b9705f7-312e-49d9-9377-0ee0b888a09f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:00.389591074Z [2024-04-15 02:53:00,389: INFO/ForkPoolWorker-1] [b89cca8d-8126-4e6a-910b-7ddc316bd775] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:00.390557312Z [2024-04-15 02:53:00,390: INFO/ForkPoolWorker-16] [44d6c796-4c18-4f0b-96a1-ab1ac1107c5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:00.392125495Z [2024-04-15 02:53:00,391: INFO/ForkPoolWorker-2] [b8a8522b-501e-4b8a-aefe-e502920697eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:00.651198998Z [2024-04-15 02:53:00,648: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:00.679322535Z [2024-04-15 02:53:00,675: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:00.815476240Z [2024-04-15 02:53:00,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:00.843246994Z [2024-04-15 02:53:00,838: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:02.394913480Z [2024-04-15 02:53:02,394: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:53:02.398740664Z [2024-04-15 02:53:02,398: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:02.467979374Z [2024-04-15 02:53:02,467: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:53:02.486638430Z [2024-04-15 02:53:02,486: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:02.486780620Z [2024-04-15 02:53:02,486: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:02.486967595Z [2024-04-15 02:53:02,486: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:02.491508686Z [2024-04-15 02:53:02,486: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:53:02.491944118Z [2024-04-15 02:53:02,491: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:53:02.492055863Z [2024-04-15 02:53:02,491: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:02.497960242Z [2024-04-15 02:53:02,497: WARNING/ForkPoolWorker-16] Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:02.515121380Z [2024-04-15 02:53:02,514: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:02.517290063Z [2024-04-15 02:53:02,517: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:53:02.519720572Z [2024-04-15 02:53:02,519: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:02.588370948Z [2024-04-15 02:53:02,588: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:53:02.590860717Z [2024-04-15 02:53:02,590: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:02.590978653Z [2024-04-15 02:53:02,590: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:02.591139977Z [2024-04-15 02:53:02,590: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:02.591228664Z [2024-04-15 02:53:02,591: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:53:02.591712063Z [2024-04-15 02:53:02,591: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:53:02.591910864Z [2024-04-15 02:53:02,591: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:02.595326579Z [2024-04-15 02:53:02,594: ERROR/ForkPoolWorker-16] [44d6c796-4c18-4f0b-96a1-ab1ac1107c5b] Failed to execute task Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:53:02.595339051Z Traceback (most recent call last): 2024-04-15T02:53:02.595343050Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:53:02.595346416Z args.func(args) 2024-04-15T02:53:02.595350939Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:53:02.595366888Z return func(*args, **kwargs) 2024-04-15T02:53:02.595369437Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:53:02.595372048Z return f(*args, **kwargs) 2024-04-15T02:53:02.595378770Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:53:02.595381509Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:53:02.595384162Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:53:02.595386667Z raise AirflowException( 2024-04-15T02:53:02.595400720Z airflow.exceptions.AirflowException: Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:53:02.662838973Z [2024-04-15 02:53:02,662: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[44d6c796-4c18-4f0b-96a1-ab1ac1107c5b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 44d6c796-4c18-4f0b-96a1-ab1ac1107c5b') 2024-04-15T02:53:02.662855032Z Traceback (most recent call last): 2024-04-15T02:53:02.662859204Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:53:02.662862285Z R = retval = fun(*args, **kwargs) 2024-04-15T02:53:02.662865559Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:53:02.662868798Z return self.run(*args, **kwargs) 2024-04-15T02:53:02.662872286Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:53:02.662876177Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:53:02.662879170Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:53:02.662882749Z raise AirflowException(msg) 2024-04-15T02:53:02.662886568Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 44d6c796-4c18-4f0b-96a1-ab1ac1107c5b 2024-04-15T02:53:02.701712237Z [2024-04-15 02:53:02,701: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T02:53:02.704767858Z [2024-04-15 02:53:02,704: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:02.726427359Z [2024-04-15 02:53:02,726: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T02:53:02.730067302Z [2024-04-15 02:53:02,729: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:02.730142514Z [2024-04-15 02:53:02,730: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:02.730311994Z [2024-04-15 02:53:02,730: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:02.730365342Z [2024-04-15 02:53:02,730: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T02:53:02.730575531Z [2024-04-15 02:53:02,730: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:53:02.730953244Z [2024-04-15 02:53:02,730: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:02.821118988Z [2024-04-15 02:53:02,820: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:53:02.942036580Z [2024-04-15 02:53:02,938: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:53:02.942060942Z [2024-04-15 02:53:02,941: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:02.969493278Z [2024-04-15 02:53:02,969: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:53:02.970519409Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:02.970533740Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:02.970658629Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:02.970684894Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:53:02.970861633Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:53:02.970892770Z [2024-04-15 02:53:02,970: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:02.980282846Z [2024-04-15 02:53:02,980: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:02.980964353Z [2024-04-15 02:53:02,980: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:02.981738286Z [2024-04-15 02:53:02,981: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:53:02.983982496Z [2024-04-15 02:53:02,983: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:03.010715203Z [2024-04-15 02:53:03,006: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:53:03.013100301Z [2024-04-15 02:53:03,012: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:03.013135829Z [2024-04-15 02:53:03,013: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:03.013244439Z [2024-04-15 02:53:03,013: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:03.013292471Z [2024-04-15 02:53:03,013: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:53:03.013642787Z [2024-04-15 02:53:03,013: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:53:03.013968697Z [2024-04-15 02:53:03,013: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:03.019131345Z [2024-04-15 02:53:03,018: ERROR/ForkPoolWorker-1] [b89cca8d-8126-4e6a-910b-7ddc316bd775] Failed to execute task Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:53:03.019141245Z Traceback (most recent call last): 2024-04-15T02:53:03.019144871Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:53:03.019148936Z args.func(args) 2024-04-15T02:53:03.019152296Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:53:03.019155759Z return func(*args, **kwargs) 2024-04-15T02:53:03.019166056Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:53:03.019169022Z return f(*args, **kwargs) 2024-04-15T02:53:03.019178920Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:53:03.019181864Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:53:03.019185065Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:53:03.019187898Z raise AirflowException( 2024-04-15T02:53:03.019197483Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:53:03.022994544Z [2024-04-15 02:53:03,022: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:53:03.026496985Z [2024-04-15 02:53:03,026: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:03.063112739Z [2024-04-15 02:53:03,062: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:53:03.065808770Z [2024-04-15 02:53:03,064: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:03.065821918Z [2024-04-15 02:53:03,065: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:03.065825867Z [2024-04-15 02:53:03,065: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:03.065831863Z [2024-04-15 02:53:03,065: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:53:03.065834766Z [2024-04-15 02:53:03,065: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:53:03.065837622Z [2024-04-15 02:53:03,065: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:03.070177212Z [2024-04-15 02:53:03,068: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b89cca8d-8126-4e6a-910b-7ddc316bd775] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b89cca8d-8126-4e6a-910b-7ddc316bd775') 2024-04-15T02:53:03.070189876Z Traceback (most recent call last): 2024-04-15T02:53:03.071223683Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:53:03.071234787Z R = retval = fun(*args, **kwargs) 2024-04-15T02:53:03.071237977Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:53:03.071241079Z return self.run(*args, **kwargs) 2024-04-15T02:53:03.071244580Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:53:03.071247817Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:53:03.071250630Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:53:03.071253989Z raise AirflowException(msg) 2024-04-15T02:53:03.071257457Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id b89cca8d-8126-4e6a-910b-7ddc316bd775 2024-04-15T02:53:03.157983699Z [2024-04-15 02:53:03,157: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:53:04.929180273Z [2024-04-15 02:53:04,928: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b9705f7-312e-49d9-9377-0ee0b888a09f] succeeded in 4.54946706499959s: None 2024-04-15T02:53:05.072529876Z [2024-04-15 02:53:05,072: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b8a8522b-501e-4b8a-aefe-e502920697eb] succeeded in 4.685598128000493s: None 2024-04-15T02:53:13.519388532Z [2024-04-15 02:53:13,519: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[667a8212-5c2a-465f-b20c-6e255027a5b7] received 2024-04-15T02:53:13.521523466Z [2024-04-15 02:53:13,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12d1198b-b63c-4597-bb52-da462f37fc7f] received 2024-04-15T02:53:13.534791044Z [2024-04-15 02:53:13,534: INFO/ForkPoolWorker-16] [12d1198b-b63c-4597-bb52-da462f37fc7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:53:13.537773839Z [2024-04-15 02:53:13,537: INFO/ForkPoolWorker-15] [667a8212-5c2a-465f-b20c-6e255027a5b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:53:13.819093660Z [2024-04-15 02:53:13,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:13.901996135Z [2024-04-15 02:53:13,886: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:14.906572403Z [2024-04-15 02:53:14,906: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:53:14.909678484Z [2024-04-15 02:53:14,909: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:14.936715496Z [2024-04-15 02:53:14,936: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:53:14.941886009Z [2024-04-15 02:53:14,941: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:14.942063527Z [2024-04-15 02:53:14,941: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:14.942433827Z [2024-04-15 02:53:14,942: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:14.942508084Z [2024-04-15 02:53:14,942: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:53:14.943261045Z [2024-04-15 02:53:14,943: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:53:14.943608416Z [2024-04-15 02:53:14,943: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:14.950785361Z [2024-04-15 02:53:14,950: WARNING/ForkPoolWorker-15] Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:14.951553871Z [2024-04-15 02:53:14,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:53:14.952442440Z [2024-04-15 02:53:14,952: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:53:14.954995455Z [2024-04-15 02:53:14,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:14.975280685Z [2024-04-15 02:53:14,975: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:53:14.976516267Z [2024-04-15 02:53:14,976: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:14.976704382Z [2024-04-15 02:53:14,976: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:14.976977706Z [2024-04-15 02:53:14,976: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:14.979492964Z [2024-04-15 02:53:14,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:53:14.980090182Z [2024-04-15 02:53:14,979: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:53:14.980999913Z [2024-04-15 02:53:14,980: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:14.985622303Z [2024-04-15 02:53:14,984: ERROR/ForkPoolWorker-15] [667a8212-5c2a-465f-b20c-6e255027a5b7] Failed to execute task Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:53:14.985638088Z Traceback (most recent call last): 2024-04-15T02:53:14.985643233Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:53:14.985647833Z args.func(args) 2024-04-15T02:53:14.985652910Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:53:14.985657598Z return func(*args, **kwargs) 2024-04-15T02:53:14.985661871Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:53:14.985665916Z return f(*args, **kwargs) 2024-04-15T02:53:14.985670118Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:53:14.985674251Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:53:14.985678630Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:53:14.985682704Z raise AirflowException( 2024-04-15T02:53:14.985687530Z airflow.exceptions.AirflowException: Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:53:15.026468019Z [2024-04-15 02:53:15,025: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[667a8212-5c2a-465f-b20c-6e255027a5b7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 667a8212-5c2a-465f-b20c-6e255027a5b7') 2024-04-15T02:53:15.026495180Z Traceback (most recent call last): 2024-04-15T02:53:15.026503830Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:53:15.026516393Z R = retval = fun(*args, **kwargs) 2024-04-15T02:53:15.026519064Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:53:15.026521585Z return self.run(*args, **kwargs) 2024-04-15T02:53:15.026524830Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:53:15.026527919Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:53:15.026530463Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:53:15.026533572Z raise AirflowException(msg) 2024-04-15T02:53:15.026536768Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 667a8212-5c2a-465f-b20c-6e255027a5b7 2024-04-15T02:53:15.042138518Z [2024-04-15 02:53:15,041: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:53:15.045047500Z [2024-04-15 02:53:15,044: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:15.068362499Z [2024-04-15 02:53:15,068: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:53:15.071064303Z [2024-04-15 02:53:15,070: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:15.071098813Z [2024-04-15 02:53:15,070: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:15.071432442Z [2024-04-15 02:53:15,071: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:15.071454663Z [2024-04-15 02:53:15,071: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:53:15.072745059Z [2024-04-15 02:53:15,072: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:53:15.072884684Z [2024-04-15 02:53:15,072: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:15.081335961Z [2024-04-15 02:53:15,081: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:15.082074428Z [2024-04-15 02:53:15,081: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:53:15.082885243Z [2024-04-15 02:53:15,082: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:53:15.085840279Z [2024-04-15 02:53:15,085: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:53:15.113522710Z [2024-04-15 02:53:15,113: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:53:15.115331406Z [2024-04-15 02:53:15,115: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:53:15.115418889Z [2024-04-15 02:53:15,115: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:53:15.115571080Z [2024-04-15 02:53:15,115: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:53:15.115603159Z [2024-04-15 02:53:15,115: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:53:15.116437091Z [2024-04-15 02:53:15,116: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:53:15.116455279Z [2024-04-15 02:53:15,116: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:53:15.122920666Z [2024-04-15 02:53:15,122: ERROR/ForkPoolWorker-16] [12d1198b-b63c-4597-bb52-da462f37fc7f] Failed to execute task Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:53:15.122951727Z Traceback (most recent call last): 2024-04-15T02:53:15.122962394Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:53:15.122990403Z args.func(args) 2024-04-15T02:53:15.123001232Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:53:15.123011383Z return func(*args, **kwargs) 2024-04-15T02:53:15.123020408Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:53:15.123030308Z return f(*args, **kwargs) 2024-04-15T02:53:15.123039715Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:53:15.123065609Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:53:15.123073085Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:53:15.123079781Z raise AirflowException( 2024-04-15T02:53:15.123102320Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:53:15.170638926Z [2024-04-15 02:53:15,169: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[12d1198b-b63c-4597-bb52-da462f37fc7f] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 12d1198b-b63c-4597-bb52-da462f37fc7f') 2024-04-15T02:53:15.170661910Z Traceback (most recent call last): 2024-04-15T02:53:15.170667314Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:53:15.170671861Z R = retval = fun(*args, **kwargs) 2024-04-15T02:53:15.170676134Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:53:15.170695850Z return self.run(*args, **kwargs) 2024-04-15T02:53:15.170701250Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:53:15.170705886Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:53:15.170710205Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:53:15.170714969Z raise AirflowException(msg) 2024-04-15T02:53:15.170720541Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 12d1198b-b63c-4597-bb52-da462f37fc7f 2024-04-15T02:54:00.915148059Z [2024-04-15 02:54:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dcd2c25-d991-4a61-bc3f-e162a222585b] received 2024-04-15T02:54:00.916444827Z [2024-04-15 02:54:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b918498a-76ae-4db0-91ae-30cddecd3fc9] received 2024-04-15T02:54:00.920926934Z [2024-04-15 02:54:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42ac3ede-0909-4040-827c-913822b87401] received 2024-04-15T02:54:00.923805028Z [2024-04-15 02:54:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5fd20ce-087f-4794-8dbf-d3e3d3fe816e] received 2024-04-15T02:54:00.925831243Z [2024-04-15 02:54:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38e14ab2-281f-4d14-8b62-19a9617ee915] received 2024-04-15T02:54:00.926278276Z [2024-04-15 02:54:00,926: INFO/ForkPoolWorker-15] [5dcd2c25-d991-4a61-bc3f-e162a222585b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:54:00.930837151Z [2024-04-15 02:54:00,930: INFO/ForkPoolWorker-1] [42ac3ede-0909-4040-827c-913822b87401] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:54:00.932429027Z [2024-04-15 02:54:00,932: INFO/ForkPoolWorker-16] [b918498a-76ae-4db0-91ae-30cddecd3fc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:54:00.940819550Z [2024-04-15 02:54:00,940: INFO/ForkPoolWorker-2] [e5fd20ce-087f-4794-8dbf-d3e3d3fe816e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:54:00.950905366Z [2024-04-15 02:54:00,950: INFO/ForkPoolWorker-3] [38e14ab2-281f-4d14-8b62-19a9617ee915] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:54:01.423789482Z [2024-04-15 02:54:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:54:01.577646824Z [2024-04-15 02:54:01,573: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:54:01.664449895Z [2024-04-15 02:54:01,664: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:54:01.739645623Z [2024-04-15 02:54:01,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:54:01.892716286Z [2024-04-15 02:54:01,881: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:54:01.953990672Z [2024-04-15 02:54:01,950: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:54:02.518558265Z [2024-04-15 02:54:02,518: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e5fd20ce-087f-4794-8dbf-d3e3d3fe816e] succeeded in 1.5919783389999793s: None 2024-04-15T02:54:03.588724428Z [2024-04-15 02:54:03,588: INFO/ForkPoolWorker-3] Getting VIM list 2024-04-15T02:54:03.591675010Z [2024-04-15 02:54:03,591: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:03.619071968Z [2024-04-15 02:54:03,618: INFO/ForkPoolWorker-3] Connected to database osm version 1.2 2024-04-15T02:54:03.627332603Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:03.627513627Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:03.627662812Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:03.627715463Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] Getting VIM list OK 2024-04-15T02:54:03.627979678Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:54:03.628043197Z [2024-04-15 02:54:03,627: INFO/ForkPoolWorker-3] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:03.663384049Z [2024-04-15 02:54:03,663: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:54:03.668703866Z [2024-04-15 02:54:03,668: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:03.696114127Z [2024-04-15 02:54:03,695: INFO/ForkPoolWorker-3] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:54:03.708764048Z [2024-04-15 02:54:03,707: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:54:03.711362710Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:03.711373616Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:03.711541882Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:03.711579332Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:54:03.711799998Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:54:03.711854475Z [2024-04-15 02:54:03,711: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:03.717758334Z [2024-04-15 02:54:03,717: WARNING/ForkPoolWorker-1] Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:54:03.718595245Z [2024-04-15 02:54:03,717: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:54:03.719347489Z [2024-04-15 02:54:03,719: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:54:03.723438264Z [2024-04-15 02:54:03,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:03.747514490Z [2024-04-15 02:54:03,747: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:54:03.748617663Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:03.748652872Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:03.748764777Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:03.748794294Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:54:03.748978058Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:54:03.749009221Z [2024-04-15 02:54:03,748: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:03.754742065Z [2024-04-15 02:54:03,752: ERROR/ForkPoolWorker-1] [42ac3ede-0909-4040-827c-913822b87401] Failed to execute task Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:54:03.754754161Z Traceback (most recent call last): 2024-04-15T02:54:03.754758078Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:54:03.754761940Z args.func(args) 2024-04-15T02:54:03.754765577Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:54:03.754769619Z return func(*args, **kwargs) 2024-04-15T02:54:03.754772639Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:54:03.754775679Z return f(*args, **kwargs) 2024-04-15T02:54:03.754778902Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:54:03.754781857Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:54:03.754784892Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:54:03.754787828Z raise AirflowException( 2024-04-15T02:54:03.754794808Z airflow.exceptions.AirflowException: Dag 'vim_status_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:54:03.788489397Z [2024-04-15 02:54:03,787: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42ac3ede-0909-4040-827c-913822b87401] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 42ac3ede-0909-4040-827c-913822b87401') 2024-04-15T02:54:03.788504196Z Traceback (most recent call last): 2024-04-15T02:54:03.788508243Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:54:03.788511294Z R = retval = fun(*args, **kwargs) 2024-04-15T02:54:03.788514441Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:54:03.788517559Z return self.run(*args, **kwargs) 2024-04-15T02:54:03.788522053Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:54:03.788539112Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:54:03.788542171Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:54:03.788545615Z raise AirflowException(msg) 2024-04-15T02:54:03.788549149Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 42ac3ede-0909-4040-827c-913822b87401 2024-04-15T02:54:03.866374706Z [2024-04-15 02:54:03,866: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:54:03.904111332Z [2024-04-15 02:54:03,903: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:03.938775181Z [2024-04-15 02:54:03,938: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:54:03.939810737Z [2024-04-15 02:54:03,939: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:03.939921859Z [2024-04-15 02:54:03,939: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:03.940177016Z [2024-04-15 02:54:03,939: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:03.940223721Z [2024-04-15 02:54:03,940: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:54:03.940500304Z [2024-04-15 02:54:03,940: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:54:03.940622327Z [2024-04-15 02:54:03,940: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:03.949678447Z [2024-04-15 02:54:03,949: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:54:03.953124745Z [2024-04-15 02:54:03,952: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:03.980791831Z [2024-04-15 02:54:03,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:54:03.980810896Z [2024-04-15 02:54:03,979: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:03.980815456Z [2024-04-15 02:54:03,979: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:03.980819652Z [2024-04-15 02:54:03,979: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:03.980823789Z [2024-04-15 02:54:03,979: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:54:03.980827015Z [2024-04-15 02:54:03,980: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:54:03.980830033Z [2024-04-15 02:54:03,980: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:03.988134803Z [2024-04-15 02:54:03,987: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:54:04.001649629Z [2024-04-15 02:54:03,987: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:54:04.001671937Z [2024-04-15 02:54:03,996: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:54:04.018753070Z [2024-04-15 02:54:04,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:54:04.053030818Z [2024-04-15 02:54:04,052: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:54:04.057580316Z [2024-04-15 02:54:04,057: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:54:04.057697184Z [2024-04-15 02:54:04,057: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:54:04.057890889Z [2024-04-15 02:54:04,057: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:54:04.058009266Z [2024-04-15 02:54:04,057: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:54:04.059620280Z [2024-04-15 02:54:04,059: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:54:04.059738259Z [2024-04-15 02:54:04,059: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:54:04.064159307Z [2024-04-15 02:54:04,063: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:54:04.068151940Z [2024-04-15 02:54:04,067: ERROR/ForkPoolWorker-15] [5dcd2c25-d991-4a61-bc3f-e162a222585b] Failed to execute task Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse.. 2024-04-15T02:54:04.068165524Z Traceback (most recent call last): 2024-04-15T02:54:04.068169446Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork 2024-04-15T02:54:04.068173143Z args.func(args) 2024-04-15T02:54:04.069375494Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command 2024-04-15T02:54:04.069407745Z return func(*args, **kwargs) 2024-04-15T02:54:04.069411967Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper 2024-04-15T02:54:04.069415183Z return f(*args, **kwargs) 2024-04-15T02:54:04.069418615Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run 2024-04-15T02:54:04.069421960Z dag = get_dag(args.subdir, args.dag_id) 2024-04-15T02:54:04.069425898Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag 2024-04-15T02:54:04.069428854Z raise AirflowException( 2024-04-15T02:54:04.069432640Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_16584fa7-eab2-4416-b9e0-e82d3f2f9576' could not be found; either it does not exist or it failed to parse. 2024-04-15T02:54:04.107140883Z [2024-04-15 02:54:04,103: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dcd2c25-d991-4a61-bc3f-e162a222585b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5dcd2c25-d991-4a61-bc3f-e162a222585b') 2024-04-15T02:54:04.107170587Z Traceback (most recent call last): 2024-04-15T02:54:04.107174644Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task 2024-04-15T02:54:04.107177701Z R = retval = fun(*args, **kwargs) 2024-04-15T02:54:04.107180608Z File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__ 2024-04-15T02:54:04.107183535Z return self.run(*args, **kwargs) 2024-04-15T02:54:04.107187134Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command 2024-04-15T02:54:04.107190750Z _execute_in_fork(command_to_exec, celery_task_id) 2024-04-15T02:54:04.107193767Z File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork 2024-04-15T02:54:04.107197142Z raise AirflowException(msg) 2024-04-15T02:54:04.107201273Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5dcd2c25-d991-4a61-bc3f-e162a222585b 2024-04-15T02:54:05.376038699Z [2024-04-15 02:54:05,375: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[38e14ab2-281f-4d14-8b62-19a9617ee915] succeeded in 4.448004302999834s: None 2024-04-15T02:54:05.928000547Z [2024-04-15 02:54:05,927: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b918498a-76ae-4db0-91ae-30cddecd3fc9] succeeded in 5.008431330000349s: None 2024-04-15T02:54:24.567944374Z [2024-04-15 02:54:24,567: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9369ac20-9a2c-4f9f-a24f-4b3df9351b59] received 2024-04-15T02:54:24.588862980Z [2024-04-15 02:54:24,588: INFO/ForkPoolWorker-15] [9369ac20-9a2c-4f9f-a24f-4b3df9351b59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240415025423_621756', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py'] 2024-04-15T02:54:24.891551037Z [2024-04-15 02:54:24,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py 2024-04-15T02:54:25.186332316Z [2024-04-15 02:54:25,185: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:54:25.809247263Z [2024-04-15 02:54:25,808: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9369ac20-9a2c-4f9f-a24f-4b3df9351b59] succeeded in 1.2386184209999556s: None 2024-04-15T02:55:01.199360971Z [2024-04-15 02:55:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5f13c39-c89f-42c9-ae54-98c54e9f7aaa] received 2024-04-15T02:55:01.212702537Z [2024-04-15 02:55:01,212: INFO/ForkPoolWorker-15] [d5f13c39-c89f-42c9-ae54-98c54e9f7aaa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:01.235674675Z [2024-04-15 02:55:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a490281e-0cab-4707-8561-b35512aba81c] received 2024-04-15T02:55:01.239673699Z [2024-04-15 02:55:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbf76807-81fa-4f87-b462-9097b8306a41] received 2024-04-15T02:55:01.283384601Z [2024-04-15 02:55:01,282: INFO/ForkPoolWorker-16] [a490281e-0cab-4707-8561-b35512aba81c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:55:01.284089789Z [2024-04-15 02:55:01,283: INFO/ForkPoolWorker-1] [bbf76807-81fa-4f87-b462-9097b8306a41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:55:01.834838745Z [2024-04-15 02:55:01,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:55:02.152680241Z [2024-04-15 02:55:02,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:55:02.178265989Z [2024-04-15 02:55:02,166: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:55:03.555800481Z [2024-04-15 02:55:03,555: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:55:03.559067060Z [2024-04-15 02:55:03,558: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:03.593997233Z [2024-04-15 02:55:03,593: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:55:03.595748179Z [2024-04-15 02:55:03,595: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:03.595883587Z [2024-04-15 02:55:03,595: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:03.596053256Z [2024-04-15 02:55:03,595: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:03.596218758Z [2024-04-15 02:55:03,596: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:55:03.596525587Z [2024-04-15 02:55:03,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:55:03.596673239Z [2024-04-15 02:55:03,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:03.682983005Z [2024-04-15 02:55:03,682: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:03.786364609Z [2024-04-15 02:55:03,786: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:55:03.789497778Z [2024-04-15 02:55:03,789: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:03.807199382Z [2024-04-15 02:55:03,806: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:55:03.813191613Z [2024-04-15 02:55:03,812: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:55:03.814485733Z [2024-04-15 02:55:03,814: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:03.817711939Z [2024-04-15 02:55:03,814: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:03.817726763Z [2024-04-15 02:55:03,815: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:03.817738867Z [2024-04-15 02:55:03,815: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:55:03.817741836Z [2024-04-15 02:55:03,815: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:55:03.817744662Z [2024-04-15 02:55:03,815: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:03.820022410Z [2024-04-15 02:55:03,819: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:03.909779897Z [2024-04-15 02:55:03,909: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:55:03.912975541Z [2024-04-15 02:55:03,912: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:03.912996819Z [2024-04-15 02:55:03,912: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:03.913004014Z [2024-04-15 02:55:03,912: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:03.913010981Z [2024-04-15 02:55:03,912: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:55:03.913826979Z [2024-04-15 02:55:03,913: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:55:03.913834752Z [2024-04-15 02:55:03,913: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:03.953465452Z [2024-04-15 02:55:03,953: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:04.008823771Z [2024-04-15 02:55:04,008: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:04.432811837Z [2024-04-15 02:55:04,432: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5f13c39-c89f-42c9-ae54-98c54e9f7aaa] succeeded in 3.229317796999567s: None 2024-04-15T02:55:05.312290496Z [2024-04-15 02:55:05,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33412841-5f94-4c5f-a3e5-1504a002257f] received 2024-04-15T02:55:05.321968780Z [2024-04-15 02:55:05,321: INFO/ForkPoolWorker-15] [33412841-5f94-4c5f-a3e5-1504a002257f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:05.533398787Z [2024-04-15 02:55:05,532: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a490281e-0cab-4707-8561-b35512aba81c] succeeded in 4.292568421999931s: None 2024-04-15T02:55:05.621397942Z [2024-04-15 02:55:05,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:55:05.786131244Z [2024-04-15 02:55:05,785: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbf76807-81fa-4f87-b462-9097b8306a41] succeeded in 4.531815144000575s: None 2024-04-15T02:55:06.630300448Z [2024-04-15 02:55:06,629: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:55:06.636662947Z [2024-04-15 02:55:06,636: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:06.657528222Z [2024-04-15 02:55:06,657: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:55:06.659596279Z [2024-04-15 02:55:06,659: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:06.659608256Z [2024-04-15 02:55:06,659: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:06.659701213Z [2024-04-15 02:55:06,659: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:06.659728561Z [2024-04-15 02:55:06,659: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:55:06.660395919Z [2024-04-15 02:55:06,660: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:55:06.660490687Z [2024-04-15 02:55:06,660: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:06.743573252Z [2024-04-15 02:55:06,743: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:07.443713863Z [2024-04-15 02:55:07,443: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[33412841-5f94-4c5f-a3e5-1504a002257f] succeeded in 2.128249023000535s: None 2024-04-15T02:55:07.718909096Z [2024-04-15 02:55:07,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d842264f-04d8-4d5e-bc42-40eed20c5ba4] received 2024-04-15T02:55:07.731984453Z [2024-04-15 02:55:07,731: INFO/ForkPoolWorker-15] [d842264f-04d8-4d5e-bc42-40eed20c5ba4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T02:55:07.989999430Z [2024-04-15 02:55:07,986: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:55:08.935198831Z [2024-04-15 02:55:08,934: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:55:08.938058512Z [2024-04-15 02:55:08,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:08.959155748Z [2024-04-15 02:55:08,958: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:55:08.962385622Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:08.962443756Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:08.962504408Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:08.962518061Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:55:08.963048297Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:55:08.963068161Z [2024-04-15 02:55:08,962: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:09.054954606Z [2024-04-15 02:55:09,054: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:09.607363196Z [2024-04-15 02:55:09,606: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d842264f-04d8-4d5e-bc42-40eed20c5ba4] succeeded in 1.8858892429998377s: None 2024-04-15T02:55:09.995490899Z [2024-04-15 02:55:09,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[872db7a1-5084-4a64-a710-4677efe2c42f] received 2024-04-15T02:55:10.016460463Z [2024-04-15 02:55:10,016: INFO/ForkPoolWorker-15] [872db7a1-5084-4a64-a710-4677efe2c42f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T02:55:10.245685149Z [2024-04-15 02:55:10,242: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T02:55:11.190627085Z [2024-04-15 02:55:11,190: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:55:11.193475576Z [2024-04-15 02:55:11,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:55:11.211755133Z [2024-04-15 02:55:11,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:55:11.212968094Z [2024-04-15 02:55:11,212: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:55:11.213004703Z [2024-04-15 02:55:11,212: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:55:11.213118095Z [2024-04-15 02:55:11,212: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:55:11.213153807Z [2024-04-15 02:55:11,213: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:55:11.213789554Z [2024-04-15 02:55:11,213: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T02:55:11.214148419Z [2024-04-15 02:55:11,214: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:55:11.296881704Z [2024-04-15 02:55:11,296: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:55:11.854926238Z [2024-04-15 02:55:11,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[872db7a1-5084-4a64-a710-4677efe2c42f] succeeded in 1.8561176310004157s: None 2024-04-15T02:56:00.186590776Z [2024-04-15 02:56:00,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdb7c8f4-b472-42d2-9183-91d85931b102] received 2024-04-15T02:56:00.194425574Z [2024-04-15 02:56:00,194: INFO/ForkPoolWorker-15] [fdb7c8f4-b472-42d2-9183-91d85931b102] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:56:00.202498136Z [2024-04-15 02:56:00,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b651217a-1d83-4000-9ae3-e25cee516a99] received 2024-04-15T02:56:00.203860900Z [2024-04-15 02:56:00,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[682c3dce-b5db-4818-a921-5f82a1c92650] received 2024-04-15T02:56:00.213284401Z [2024-04-15 02:56:00,213: INFO/ForkPoolWorker-1] [682c3dce-b5db-4818-a921-5f82a1c92650] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:56:00.215311203Z [2024-04-15 02:56:00,215: INFO/ForkPoolWorker-16] [b651217a-1d83-4000-9ae3-e25cee516a99] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:56:00.495947618Z [2024-04-15 02:56:00,491: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:56:00.511005445Z [2024-04-15 02:56:00,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:56:00.512327970Z [2024-04-15 02:56:00,508: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:56:00.712714852Z [2024-04-15 02:56:00,712: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:56:01.305140445Z [2024-04-15 02:56:01,304: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdb7c8f4-b472-42d2-9183-91d85931b102] succeeded in 1.1168312670006344s: None 2024-04-15T02:56:01.734688181Z [2024-04-15 02:56:01,734: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:56:01.742125882Z [2024-04-15 02:56:01,740: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:56:01.786046500Z [2024-04-15 02:56:01,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:56:01.787351795Z [2024-04-15 02:56:01,787: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:56:01.790314274Z [2024-04-15 02:56:01,790: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:56:01.790457127Z [2024-04-15 02:56:01,790: INFO/ForkPoolWorker-16] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:56:01.790700850Z [2024-04-15 02:56:01,790: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:56:01.790824316Z [2024-04-15 02:56:01,790: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:56:01.791155272Z [2024-04-15 02:56:01,791: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:56:01.791395914Z [2024-04-15 02:56:01,791: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:56:01.798278865Z [2024-04-15 02:56:01,798: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:56:01.884316050Z [2024-04-15 02:56:01,881: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:56:01.885276968Z [2024-04-15 02:56:01,884: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:56:01.977194928Z [2024-04-15 02:56:01,976: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:56:01.986508233Z [2024-04-15 02:56:01,986: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:56:01.990386811Z [2024-04-15 02:56:01,990: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:56:01.991491781Z [2024-04-15 02:56:01,990: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:56:01.991617643Z [2024-04-15 02:56:01,991: INFO/ForkPoolWorker-1] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:56:01.993729333Z [2024-04-15 02:56:01,991: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:56:01.993835838Z [2024-04-15 02:56:01,993: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:56:01.994147531Z [2024-04-15 02:56:01,994: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:56:01.994433859Z [2024-04-15 02:56:01,994: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:56:02.010183355Z [2024-04-15 02:56:02,007: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:56:02.155485951Z [2024-04-15 02:56:02,155: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:56:03.619416953Z [2024-04-15 02:56:03,618: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[682c3dce-b5db-4818-a921-5f82a1c92650] succeeded in 3.4119631390003633s: None 2024-04-15T02:56:04.037833684Z [2024-04-15 02:56:04,037: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b651217a-1d83-4000-9ae3-e25cee516a99] succeeded in 3.8330196609995255s: None 2024-04-15T02:57:00.685526925Z [2024-04-15 02:57:00,685: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5f83022-7249-4392-a315-2bb6b37fa8c5] received 2024-04-15T02:57:00.687318670Z [2024-04-15 02:57:00,687: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abc45d45-9f9d-4086-89fb-4e3cf3c1ffbc] received 2024-04-15T02:57:00.703094784Z [2024-04-15 02:57:00,702: INFO/ForkPoolWorker-15] [c5f83022-7249-4392-a315-2bb6b37fa8c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:57:00.706007605Z [2024-04-15 02:57:00,705: INFO/ForkPoolWorker-16] [abc45d45-9f9d-4086-89fb-4e3cf3c1ffbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:57:01.148223016Z [2024-04-15 02:57:01,144: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:57:01.178982850Z [2024-04-15 02:57:01,171: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:57:02.510304502Z [2024-04-15 02:57:02,509: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:57:02.514104827Z [2024-04-15 02:57:02,513: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:57:02.524264011Z [2024-04-15 02:57:02,523: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:57:02.527881696Z [2024-04-15 02:57:02,527: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:57:02.550618664Z [2024-04-15 02:57:02,550: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:57:02.551887258Z [2024-04-15 02:57:02,551: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:57:02.552084871Z [2024-04-15 02:57:02,551: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:57:02.552290976Z [2024-04-15 02:57:02,552: INFO/ForkPoolWorker-15] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:57:02.552637936Z [2024-04-15 02:57:02,552: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:57:02.552689599Z [2024-04-15 02:57:02,552: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:57:02.553215343Z [2024-04-15 02:57:02,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:57:02.553265882Z [2024-04-15 02:57:02,553: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:57:02.556376751Z [2024-04-15 02:57:02,556: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:57:02.557808728Z [2024-04-15 02:57:02,557: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:57:02.557945550Z [2024-04-15 02:57:02,557: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:57:02.559121667Z [2024-04-15 02:57:02,558: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:57:02.559603385Z [2024-04-15 02:57:02,559: INFO/ForkPoolWorker-16] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:57:02.559699023Z [2024-04-15 02:57:02,559: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:57:02.559727511Z [2024-04-15 02:57:02,559: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:57:02.560286368Z [2024-04-15 02:57:02,559: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:57:02.560365541Z [2024-04-15 02:57:02,560: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:57:02.565548397Z [2024-04-15 02:57:02,565: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:57:02.622037242Z [2024-04-15 02:57:02,621: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:57:02.629682993Z [2024-04-15 02:57:02,629: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:57:04.044485085Z [2024-04-15 02:57:04,043: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[abc45d45-9f9d-4086-89fb-4e3cf3c1ffbc] succeeded in 3.354673898999863s: None 2024-04-15T02:57:04.402271529Z [2024-04-15 02:57:04,401: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5f83022-7249-4392-a315-2bb6b37fa8c5] succeeded in 3.712050432999604s: None 2024-04-15T02:58:00.711201826Z [2024-04-15 02:58:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1befb6-5b5e-45a2-a7d0-5085ccb56310] received 2024-04-15T02:58:00.718967341Z [2024-04-15 02:58:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c5bffdb-ee4d-4920-8023-6b1238dab2e3] received 2024-04-15T02:58:00.721192542Z [2024-04-15 02:58:00,720: INFO/ForkPoolWorker-15] [ad1befb6-5b5e-45a2-a7d0-5085ccb56310] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T02:58:00.723697134Z [2024-04-15 02:58:00,723: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[289df3da-9692-4a9c-8487-234683af6856] received 2024-04-15T02:58:00.740782300Z [2024-04-15 02:58:00,740: INFO/ForkPoolWorker-16] [8c5bffdb-ee4d-4920-8023-6b1238dab2e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:58:00.744786755Z [2024-04-15 02:58:00,744: INFO/ForkPoolWorker-1] [289df3da-9692-4a9c-8487-234683af6856] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:58:01.087349264Z [2024-04-15 02:58:01,083: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:58:01.128951800Z [2024-04-15 02:58:01,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T02:58:01.163908981Z [2024-04-15 02:58:01,160: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:58:01.366485610Z [2024-04-15 02:58:01,366: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:58:01.997453268Z [2024-04-15 02:58:01,997: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad1befb6-5b5e-45a2-a7d0-5085ccb56310] succeeded in 1.2841104600001927s: None 2024-04-15T02:58:02.419956833Z [2024-04-15 02:58:02,419: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:58:02.424975550Z [2024-04-15 02:58:02,423: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:58:02.454927981Z [2024-04-15 02:58:02,454: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:58:02.455908657Z [2024-04-15 02:58:02,455: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:58:02.455996775Z [2024-04-15 02:58:02,455: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:58:02.456256273Z [2024-04-15 02:58:02,456: INFO/ForkPoolWorker-16] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:58:02.456437262Z [2024-04-15 02:58:02,456: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:58:02.456686919Z [2024-04-15 02:58:02,456: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:58:02.457476719Z [2024-04-15 02:58:02,457: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:58:02.457545218Z [2024-04-15 02:58:02,457: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:58:02.462192435Z [2024-04-15 02:58:02,461: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:58:02.525281851Z [2024-04-15 02:58:02,525: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:58:02.673031648Z [2024-04-15 02:58:02,672: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T02:58:02.676181499Z [2024-04-15 02:58:02,675: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:58:02.702838319Z [2024-04-15 02:58:02,702: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T02:58:02.704262100Z [2024-04-15 02:58:02,704: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:58:02.704395533Z [2024-04-15 02:58:02,704: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:58:02.704588398Z [2024-04-15 02:58:02,704: INFO/ForkPoolWorker-1] Read VIM 508e38e7-6612-4941-9a5e-357caa4417e0 (k8s07_dummy) 2024-04-15T02:58:02.704865114Z [2024-04-15 02:58:02,704: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '508e38e7-6612-4941-9a5e-357caa4417e0', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}] 2024-04-15T02:58:02.705002829Z [2024-04-15 02:58:02,704: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T02:58:02.705495641Z [2024-04-15 02:58:02,705: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:58:02.705506078Z [2024-04-15 02:58:02,705: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:58:02.710834547Z [2024-04-15 02:58:02,710: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:58:02.786210366Z [2024-04-15 02:58:02,785: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:58:04.391994398Z [2024-04-15 02:58:04,391: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c5bffdb-ee4d-4920-8023-6b1238dab2e3] succeeded in 3.660549428000195s: None 2024-04-15T02:58:05.885434472Z [2024-04-15 02:58:05,884: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[289df3da-9692-4a9c-8487-234683af6856] succeeded in 5.159146701999816s: None 2024-04-15T02:59:00.576761583Z [2024-04-15 02:59:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98d84efa-f6a3-4d16-a45d-ebf3cac3da63] received 2024-04-15T02:59:00.586135533Z [2024-04-15 02:59:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8c290ac-783a-4062-9a0e-0972f84d8419] received 2024-04-15T02:59:00.594064722Z [2024-04-15 02:59:00,593: INFO/ForkPoolWorker-15] [98d84efa-f6a3-4d16-a45d-ebf3cac3da63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T02:59:00.600473270Z [2024-04-15 02:59:00,600: INFO/ForkPoolWorker-16] [f8c290ac-783a-4062-9a0e-0972f84d8419] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T02:59:00.883997669Z [2024-04-15 02:59:00,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T02:59:00.903879610Z [2024-04-15 02:59:00,901: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T02:59:02.233254087Z [2024-04-15 02:59:02,232: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T02:59:02.236599178Z [2024-04-15 02:59:02,236: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:59:02.276461008Z [2024-04-15 02:59:02,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T02:59:02.279783496Z [2024-04-15 02:59:02,279: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:59:02.280691866Z [2024-04-15 02:59:02,280: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:59:02.280989261Z [2024-04-15 02:59:02,280: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:59:02.281245105Z [2024-04-15 02:59:02,281: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T02:59:02.281667290Z [2024-04-15 02:59:02,281: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T02:59:02.281976903Z [2024-04-15 02:59:02,281: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:59:02.334144320Z [2024-04-15 02:59:02,333: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T02:59:02.337360773Z [2024-04-15 02:59:02,336: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T02:59:02.364094708Z [2024-04-15 02:59:02,363: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:59:02.380915428Z [2024-04-15 02:59:02,380: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T02:59:02.384504382Z [2024-04-15 02:59:02,384: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T02:59:02.384854229Z [2024-04-15 02:59:02,384: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T02:59:02.390090032Z [2024-04-15 02:59:02,389: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T02:59:02.390211873Z [2024-04-15 02:59:02,390: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T02:59:02.390911616Z [2024-04-15 02:59:02,390: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T02:59:02.391160146Z [2024-04-15 02:59:02,391: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T02:59:02.472953177Z [2024-04-15 02:59:02,472: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T02:59:04.422989778Z [2024-04-15 02:59:04,422: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8c290ac-783a-4062-9a0e-0972f84d8419] succeeded in 3.834298368000418s: None 2024-04-15T02:59:04.736180879Z [2024-04-15 02:59:04,735: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[98d84efa-f6a3-4d16-a45d-ebf3cac3da63] succeeded in 4.1545749349998005s: None 2024-04-15T03:00:00.478386281Z [2024-04-15 03:00:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1349a1-6d1e-4c9c-a59e-ef0a4494adde] received 2024-04-15T03:00:00.482518573Z [2024-04-15 03:00:00,482: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe159fa0-c36f-491b-81f2-ea46576a5f3c] received 2024-04-15T03:00:00.486197897Z [2024-04-15 03:00:00,485: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01ac3ed5-bf37-49e5-98ef-2aae749bd3bf] received 2024-04-15T03:00:00.489091867Z [2024-04-15 03:00:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7fb62cf3-a9e5-4382-aada-66f507a0f36c] received 2024-04-15T03:00:00.507448641Z [2024-04-15 03:00:00,507: INFO/ForkPoolWorker-16] [fe159fa0-c36f-491b-81f2-ea46576a5f3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:00:00.509979833Z [2024-04-15 03:00:00,509: INFO/ForkPoolWorker-15] [ad1349a1-6d1e-4c9c-a59e-ef0a4494adde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:00.510764488Z [2024-04-15 03:00:00,510: INFO/ForkPoolWorker-2] [7fb62cf3-a9e5-4382-aada-66f507a0f36c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:00:00.526261525Z [2024-04-15 03:00:00,525: INFO/ForkPoolWorker-1] [01ac3ed5-bf37-49e5-98ef-2aae749bd3bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:00:00.849857780Z [2024-04-15 03:00:00,845: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:00:00.885774103Z [2024-04-15 03:00:00,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:00:00.899522820Z [2024-04-15 03:00:00,888: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:00:00.968747486Z [2024-04-15 03:00:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:00:01.535124765Z [2024-04-15 03:00:01,534: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:02.334025257Z [2024-04-15 03:00:02,333: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe159fa0-c36f-491b-81f2-ea46576a5f3c] succeeded in 1.8488997129998097s: None 2024-04-15T03:00:02.785246370Z [2024-04-15 03:00:02,784: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:00:02.789235451Z [2024-04-15 03:00:02,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:02.790428866Z [2024-04-15 03:00:02,790: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T03:00:02.793569922Z [2024-04-15 03:00:02,793: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:02.846967060Z [2024-04-15 03:00:02,845: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:00:02.866139233Z [2024-04-15 03:00:02,847: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T03:00:02.866161627Z [2024-04-15 03:00:02,856: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:02.866165021Z [2024-04-15 03:00:02,856: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:02.866170361Z [2024-04-15 03:00:02,856: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:02.866173866Z [2024-04-15 03:00:02,856: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T03:00:02.866176776Z [2024-04-15 03:00:02,856: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:00:02.866194652Z [2024-04-15 03:00:02,857: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:02.866198158Z [2024-04-15 03:00:02,857: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:02.866201008Z [2024-04-15 03:00:02,858: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:02.866203771Z [2024-04-15 03:00:02,858: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:02.866206514Z [2024-04-15 03:00:02,858: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:00:02.866209318Z [2024-04-15 03:00:02,858: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:00:02.866212181Z [2024-04-15 03:00:02,858: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:03.016952372Z [2024-04-15 03:00:03,016: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:03.045861309Z [2024-04-15 03:00:03,045: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:03.077643150Z [2024-04-15 03:00:03,077: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:00:03.084574357Z [2024-04-15 03:00:03,084: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:03.118284093Z [2024-04-15 03:00:03,118: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:00:03.119700649Z [2024-04-15 03:00:03,119: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:03.119733723Z [2024-04-15 03:00:03,119: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:03.119821152Z [2024-04-15 03:00:03,119: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:03.119871442Z [2024-04-15 03:00:03,119: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:00:03.120061840Z [2024-04-15 03:00:03,119: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:00:03.120101730Z [2024-04-15 03:00:03,120: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:03.213135943Z [2024-04-15 03:00:03,212: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:03.574158340Z [2024-04-15 03:00:03,573: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad1349a1-6d1e-4c9c-a59e-ef0a4494adde] succeeded in 3.088940288000231s: None 2024-04-15T03:00:04.342231964Z [2024-04-15 03:00:04,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f48e9fa8-ec70-4753-9424-f05ca3818917] received 2024-04-15T03:00:04.350731851Z [2024-04-15 03:00:04,350: INFO/ForkPoolWorker-15] [f48e9fa8-ec70-4753-9424-f05ca3818917] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:04.624508221Z [2024-04-15 03:00:04,624: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[01ac3ed5-bf37-49e5-98ef-2aae749bd3bf] succeeded in 4.131757205000213s: None 2024-04-15T03:00:04.673619816Z [2024-04-15 03:00:04,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:00:04.938193053Z [2024-04-15 03:00:04,937: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7fb62cf3-a9e5-4382-aada-66f507a0f36c] succeeded in 4.4459297759995025s: None 2024-04-15T03:00:05.785751733Z [2024-04-15 03:00:05,785: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:00:05.788874479Z [2024-04-15 03:00:05,788: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:05.818116490Z [2024-04-15 03:00:05,817: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:00:05.819660325Z [2024-04-15 03:00:05,819: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:05.819682616Z [2024-04-15 03:00:05,819: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:05.819906173Z [2024-04-15 03:00:05,819: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:05.819925333Z [2024-04-15 03:00:05,819: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:00:05.820293434Z [2024-04-15 03:00:05,820: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:00:05.820380665Z [2024-04-15 03:00:05,820: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:05.895636468Z [2024-04-15 03:00:05,895: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:06.575971094Z [2024-04-15 03:00:06,575: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f48e9fa8-ec70-4753-9424-f05ca3818917] succeeded in 2.231556893000743s: None 2024-04-15T03:00:06.808083193Z [2024-04-15 03:00:06,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dcfb5dc-1fc0-45d2-983e-83d833704fb5] received 2024-04-15T03:00:06.814267414Z [2024-04-15 03:00:06,814: INFO/ForkPoolWorker-15] [9dcfb5dc-1fc0-45d2-983e-83d833704fb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:00:07.105584022Z [2024-04-15 03:00:07,102: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:00:08.184455839Z [2024-04-15 03:00:08,184: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:00:08.188936668Z [2024-04-15 03:00:08,188: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:08.213285404Z [2024-04-15 03:00:08,213: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:00:08.215451958Z [2024-04-15 03:00:08,215: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:08.215561339Z [2024-04-15 03:00:08,215: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:08.215707521Z [2024-04-15 03:00:08,215: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:08.215780729Z [2024-04-15 03:00:08,215: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:00:08.216052127Z [2024-04-15 03:00:08,215: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:00:08.216541382Z [2024-04-15 03:00:08,216: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:08.299097723Z [2024-04-15 03:00:08,298: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:08.922038882Z [2024-04-15 03:00:08,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9dcfb5dc-1fc0-45d2-983e-83d833704fb5] succeeded in 2.1115020360002745s: None 2024-04-15T03:00:09.075868556Z [2024-04-15 03:00:09,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b98f779-8b39-48b6-b39c-b1aa4b745923] received 2024-04-15T03:00:09.082136750Z [2024-04-15 03:00:09,081: INFO/ForkPoolWorker-15] [3b98f779-8b39-48b6-b39c-b1aa4b745923] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:00:09.416890550Z [2024-04-15 03:00:09,414: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:00:10.699413454Z [2024-04-15 03:00:10,698: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:00:10.702511438Z [2024-04-15 03:00:10,702: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:00:10.731770514Z [2024-04-15 03:00:10,731: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:00:10.733032409Z [2024-04-15 03:00:10,732: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:00:10.733089130Z [2024-04-15 03:00:10,732: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:00:10.733258505Z [2024-04-15 03:00:10,732: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:00:10.733288452Z [2024-04-15 03:00:10,733: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:00:10.733610168Z [2024-04-15 03:00:10,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:00:10.733634318Z [2024-04-15 03:00:10,733: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:00:10.834582351Z [2024-04-15 03:00:10,834: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:00:11.445081038Z [2024-04-15 03:00:11,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b98f779-8b39-48b6-b39c-b1aa4b745923] succeeded in 2.3679403329997513s: None 2024-04-15T03:01:00.290260073Z [2024-04-15 03:01:00,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23969336-69bb-41f1-90b3-6b0f6f3d578d] received 2024-04-15T03:01:00.296061643Z [2024-04-15 03:01:00,295: INFO/ForkPoolWorker-15] [23969336-69bb-41f1-90b3-6b0f6f3d578d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:01:00.319033951Z [2024-04-15 03:01:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b904b83-cebe-45fc-a59f-31235bb8aff2] received 2024-04-15T03:01:00.326583096Z [2024-04-15 03:01:00,326: INFO/ForkPoolWorker-16] [7b904b83-cebe-45fc-a59f-31235bb8aff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:01:00.665244126Z [2024-04-15 03:01:00,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:01:00.691165295Z [2024-04-15 03:01:00,687: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:01:01.796061027Z [2024-04-15 03:01:01,795: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:01:01.806686738Z [2024-04-15 03:01:01,806: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:01:01.840230208Z [2024-04-15 03:01:01,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:01:01.841469473Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:01:01.841486577Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:01:01.841645519Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:01:01.841684944Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:01:01.841892373Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:01:01.843132857Z [2024-04-15 03:01:01,841: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:01:01.931901870Z [2024-04-15 03:01:01,931: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:01:01.974686706Z [2024-04-15 03:01:01,974: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:01:01.981627492Z [2024-04-15 03:01:01,981: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:01:02.032533963Z [2024-04-15 03:01:02,032: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:01:02.034602635Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:01:02.034620453Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:01:02.034731256Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:01:02.034816053Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:01:02.034945376Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:01:02.035018524Z [2024-04-15 03:01:02,034: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:01:02.132069085Z [2024-04-15 03:01:02,131: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:01:03.409566953Z [2024-04-15 03:01:03,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23969336-69bb-41f1-90b3-6b0f6f3d578d] succeeded in 3.1179959420005616s: None 2024-04-15T03:01:04.014215304Z [2024-04-15 03:01:04,013: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7b904b83-cebe-45fc-a59f-31235bb8aff2] succeeded in 3.69327949000035s: None 2024-04-15T03:02:00.734482689Z [2024-04-15 03:02:00,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdf8c663-72b8-40b3-bceb-c4a0c1a0c27c] received 2024-04-15T03:02:00.738087619Z [2024-04-15 03:02:00,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e32b42e-747e-4157-8b42-6ef5cceda313] received 2024-04-15T03:02:00.753181042Z [2024-04-15 03:02:00,752: INFO/ForkPoolWorker-15] [bdf8c663-72b8-40b3-bceb-c4a0c1a0c27c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:02:00.784939271Z [2024-04-15 03:02:00,779: INFO/ForkPoolWorker-16] [6e32b42e-747e-4157-8b42-6ef5cceda313] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:02:00.789365564Z [2024-04-15 03:02:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c8badab-c1ce-4cff-b28b-4a1cf1a5f564] received 2024-04-15T03:02:00.805681616Z [2024-04-15 03:02:00,805: INFO/ForkPoolWorker-1] [5c8badab-c1ce-4cff-b28b-4a1cf1a5f564] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:02:01.079686363Z [2024-04-15 03:02:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:02:01.239318888Z [2024-04-15 03:02:01,231: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:02:01.317472479Z [2024-04-15 03:02:01,305: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:02:01.820922440Z [2024-04-15 03:02:01,820: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:02:02.410024119Z [2024-04-15 03:02:02,409: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bdf8c663-72b8-40b3-bceb-c4a0c1a0c27c] succeeded in 1.6705613779995474s: None 2024-04-15T03:02:02.658237138Z [2024-04-15 03:02:02,657: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:02:02.661630531Z [2024-04-15 03:02:02,661: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:02:02.690795015Z [2024-04-15 03:02:02,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:02:02.692697788Z [2024-04-15 03:02:02,692: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:02:02.692856127Z [2024-04-15 03:02:02,692: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:02:02.693091759Z [2024-04-15 03:02:02,692: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:02:02.693255698Z [2024-04-15 03:02:02,693: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:02:02.696312707Z [2024-04-15 03:02:02,696: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:02:02.696524755Z [2024-04-15 03:02:02,696: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:02:02.778629627Z [2024-04-15 03:02:02,778: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:02:02.835924467Z [2024-04-15 03:02:02,835: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:02:02.843463727Z [2024-04-15 03:02:02,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:02:02.901271746Z [2024-04-15 03:02:02,899: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:02:02.901302468Z [2024-04-15 03:02:02,900: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:02:02.901308258Z [2024-04-15 03:02:02,900: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:02:02.901331465Z [2024-04-15 03:02:02,900: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:02:02.901336966Z [2024-04-15 03:02:02,901: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:02:02.901489791Z [2024-04-15 03:02:02,901: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:02:02.901513211Z [2024-04-15 03:02:02,901: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:02:03.016335740Z [2024-04-15 03:02:03,016: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:02:04.571697366Z [2024-04-15 03:02:04,571: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e32b42e-747e-4157-8b42-6ef5cceda313] succeeded in 3.8302053540000998s: None 2024-04-15T03:02:04.828639540Z [2024-04-15 03:02:04,828: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c8badab-c1ce-4cff-b28b-4a1cf1a5f564] succeeded in 4.038696560999597s: None 2024-04-15T03:03:00.501464486Z [2024-04-15 03:03:00,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9092252c-491e-47a3-98de-caf2cb044576] received 2024-04-15T03:03:00.532261784Z [2024-04-15 03:03:00,531: INFO/ForkPoolWorker-15] [9092252c-491e-47a3-98de-caf2cb044576] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:03:00.632226361Z [2024-04-15 03:03:00,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e0fc336-351b-4cea-8604-db6847ce1709] received 2024-04-15T03:03:00.651114500Z [2024-04-15 03:03:00,650: INFO/ForkPoolWorker-16] [3e0fc336-351b-4cea-8604-db6847ce1709] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:03:00.826028280Z [2024-04-15 03:03:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:03:00.975118473Z [2024-04-15 03:03:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:03:02.141259823Z [2024-04-15 03:03:02,140: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:03:02.149496499Z [2024-04-15 03:03:02,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:03:02.214943316Z [2024-04-15 03:03:02,214: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:03:02.217179487Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:03:02.217221434Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:03:02.217225752Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:03:02.217229211Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:03:02.217232272Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:03:02.217235546Z [2024-04-15 03:03:02,216: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:03:02.329482431Z [2024-04-15 03:03:02,329: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:03:02.386704759Z [2024-04-15 03:03:02,386: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:03:02.390091343Z [2024-04-15 03:03:02,389: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:03:02.415398097Z [2024-04-15 03:03:02,415: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:03:02.421780990Z [2024-04-15 03:03:02,421: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:03:02.421822012Z [2024-04-15 03:03:02,421: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:03:02.421996234Z [2024-04-15 03:03:02,421: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:03:02.422127263Z [2024-04-15 03:03:02,421: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:03:02.422521756Z [2024-04-15 03:03:02,422: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:03:02.422538403Z [2024-04-15 03:03:02,422: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:03:02.514920415Z [2024-04-15 03:03:02,514: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:03:04.079259695Z [2024-04-15 03:03:04,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9092252c-491e-47a3-98de-caf2cb044576] succeeded in 3.5747964610000054s: None 2024-04-15T03:03:04.351395941Z [2024-04-15 03:03:04,350: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3e0fc336-351b-4cea-8604-db6847ce1709] succeeded in 3.7112147389998427s: None 2024-04-15T03:04:00.475282287Z [2024-04-15 03:04:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[007a2363-fa75-4a0d-85e0-541d6fdd0a17] received 2024-04-15T03:04:00.476964369Z [2024-04-15 03:04:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8de04c6-8b49-4acc-b63f-9f28b1848f44] received 2024-04-15T03:04:00.481073690Z [2024-04-15 03:04:00,480: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b430603-0eb6-42c7-89e1-2bf1b9bc17d5] received 2024-04-15T03:04:00.484530238Z [2024-04-15 03:04:00,484: INFO/ForkPoolWorker-15] [007a2363-fa75-4a0d-85e0-541d6fdd0a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:04:00.490048184Z [2024-04-15 03:04:00,489: INFO/ForkPoolWorker-16] [c8de04c6-8b49-4acc-b63f-9f28b1848f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:04:00.499575395Z [2024-04-15 03:04:00,499: INFO/ForkPoolWorker-1] [4b430603-0eb6-42c7-89e1-2bf1b9bc17d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:04:00.768091045Z [2024-04-15 03:04:00,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:04:00.783637677Z [2024-04-15 03:04:00,780: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:04:00.802066618Z [2024-04-15 03:04:00,798: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:04:01.174876039Z [2024-04-15 03:04:01,174: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:04:01.912042510Z [2024-04-15 03:04:01,911: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[007a2363-fa75-4a0d-85e0-541d6fdd0a17] succeeded in 1.434214799000074s: None 2024-04-15T03:04:02.159826730Z [2024-04-15 03:04:02,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:04:02.163253603Z [2024-04-15 03:04:02,162: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:04:02.205086556Z [2024-04-15 03:04:02,204: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:04:02.209099827Z [2024-04-15 03:04:02,208: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:04:02.209164066Z [2024-04-15 03:04:02,209: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:04:02.209273647Z [2024-04-15 03:04:02,209: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:04:02.209346998Z [2024-04-15 03:04:02,209: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:04:02.210178620Z [2024-04-15 03:04:02,210: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:04:02.210194219Z [2024-04-15 03:04:02,210: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:04:02.311110334Z [2024-04-15 03:04:02,310: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:04:02.524746634Z [2024-04-15 03:04:02,524: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:04:02.528271747Z [2024-04-15 03:04:02,527: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:04:02.576394336Z [2024-04-15 03:04:02,576: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:04:02.579470299Z [2024-04-15 03:04:02,579: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:04:02.579525355Z [2024-04-15 03:04:02,579: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:04:02.579613134Z [2024-04-15 03:04:02,579: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:04:02.579669045Z [2024-04-15 03:04:02,579: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:04:02.580355223Z [2024-04-15 03:04:02,580: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:04:02.580415067Z [2024-04-15 03:04:02,580: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:04:02.709036409Z [2024-04-15 03:04:02,708: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:04:04.251331910Z [2024-04-15 03:04:04,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8de04c6-8b49-4acc-b63f-9f28b1848f44] succeeded in 3.772001119000379s: None 2024-04-15T03:04:04.395822023Z [2024-04-15 03:04:04,393: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b430603-0eb6-42c7-89e1-2bf1b9bc17d5] succeeded in 3.9106380520006496s: None 2024-04-15T03:05:00.465058888Z [2024-04-15 03:05:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3da26f6a-6a23-4db6-a3fc-0c34ae0b9998] received 2024-04-15T03:05:00.467648956Z [2024-04-15 03:05:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c47feaae-15b0-48e1-802f-df4e6d108104] received 2024-04-15T03:05:00.469484388Z [2024-04-15 03:05:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[476809c4-8d89-445e-8b2b-ff057eff424f] received 2024-04-15T03:05:00.475968497Z [2024-04-15 03:05:00,475: INFO/ForkPoolWorker-15] [3da26f6a-6a23-4db6-a3fc-0c34ae0b9998] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:00.482245450Z [2024-04-15 03:05:00,481: INFO/ForkPoolWorker-16] [c47feaae-15b0-48e1-802f-df4e6d108104] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:05:00.482771965Z [2024-04-15 03:05:00,482: INFO/ForkPoolWorker-1] [476809c4-8d89-445e-8b2b-ff057eff424f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:05:00.739695080Z [2024-04-15 03:05:00,736: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:05:00.768790375Z [2024-04-15 03:05:00,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:05:00.773230125Z [2024-04-15 03:05:00,770: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:05:02.424621061Z [2024-04-15 03:05:02,424: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:05:02.424918360Z [2024-04-15 03:05:02,419: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:05:02.428227166Z [2024-04-15 03:05:02,427: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:02.428344759Z [2024-04-15 03:05:02,427: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:02.454244545Z [2024-04-15 03:05:02,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:05:02.464406595Z [2024-04-15 03:05:02,464: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:05:02.471356120Z [2024-04-15 03:05:02,470: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:02.471683125Z [2024-04-15 03:05:02,471: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:02.471864373Z [2024-04-15 03:05:02,471: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:02.471962302Z [2024-04-15 03:05:02,471: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:05:02.472255993Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:02.472303483Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:02.472496346Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:02.472549975Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:05:02.472857832Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:05:02.472863856Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:02.473012465Z [2024-04-15 03:05:02,472: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:05:02.473131950Z [2024-04-15 03:05:02,473: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:02.562974978Z [2024-04-15 03:05:02,562: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:02.567567147Z [2024-04-15 03:05:02,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:02.666221015Z [2024-04-15 03:05:02,665: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:05:02.669378959Z [2024-04-15 03:05:02,668: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:02.692283367Z [2024-04-15 03:05:02,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:05:02.695159008Z [2024-04-15 03:05:02,693: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:02.695168048Z [2024-04-15 03:05:02,694: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:02.695191214Z [2024-04-15 03:05:02,694: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:02.695197799Z [2024-04-15 03:05:02,694: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:05:02.696004227Z [2024-04-15 03:05:02,695: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:05:02.696344227Z [2024-04-15 03:05:02,695: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:02.769855096Z [2024-04-15 03:05:02,769: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:03.216176832Z [2024-04-15 03:05:03,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3da26f6a-6a23-4db6-a3fc-0c34ae0b9998] succeeded in 2.7492540479997842s: None 2024-04-15T03:05:04.135033131Z [2024-04-15 03:05:04,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43f44144-0025-4740-889b-d8d3720dbe30] received 2024-04-15T03:05:04.154716191Z [2024-04-15 03:05:04,154: INFO/ForkPoolWorker-15] [43f44144-0025-4740-889b-d8d3720dbe30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:04.167655203Z [2024-04-15 03:05:04,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c47feaae-15b0-48e1-802f-df4e6d108104] succeeded in 3.6976782830006414s: None 2024-04-15T03:05:04.566991658Z [2024-04-15 03:05:04,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:05:04.644444092Z [2024-04-15 03:05:04,643: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[476809c4-8d89-445e-8b2b-ff057eff424f] succeeded in 4.173251084000185s: None 2024-04-15T03:05:05.670687644Z [2024-04-15 03:05:05,670: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:05:05.673936262Z [2024-04-15 03:05:05,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:05.708700161Z [2024-04-15 03:05:05,708: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:05:05.710553428Z [2024-04-15 03:05:05,710: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:05.710723212Z [2024-04-15 03:05:05,710: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:05.710999138Z [2024-04-15 03:05:05,710: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:05.711149396Z [2024-04-15 03:05:05,711: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:05:05.711522626Z [2024-04-15 03:05:05,711: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:05:05.711703542Z [2024-04-15 03:05:05,711: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:05.799080212Z [2024-04-15 03:05:05,798: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:06.503864252Z [2024-04-15 03:05:06,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[43f44144-0025-4740-889b-d8d3720dbe30] succeeded in 2.3588113069999963s: None 2024-04-15T03:05:06.808856287Z [2024-04-15 03:05:06,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ead9d613-5b64-4f5c-b44b-a17fca85d4de] received 2024-04-15T03:05:06.817803737Z [2024-04-15 03:05:06,817: INFO/ForkPoolWorker-15] [ead9d613-5b64-4f5c-b44b-a17fca85d4de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:05:07.081290082Z [2024-04-15 03:05:07,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:05:08.125664898Z [2024-04-15 03:05:08,125: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:05:08.128541863Z [2024-04-15 03:05:08,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:08.155412597Z [2024-04-15 03:05:08,155: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:05:08.157539894Z [2024-04-15 03:05:08,157: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:08.157669930Z [2024-04-15 03:05:08,157: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:08.158117232Z [2024-04-15 03:05:08,157: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:08.158257613Z [2024-04-15 03:05:08,158: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:05:08.158577151Z [2024-04-15 03:05:08,158: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:05:08.158694189Z [2024-04-15 03:05:08,158: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:08.253630118Z [2024-04-15 03:05:08,253: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:08.834352022Z [2024-04-15 03:05:08,833: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ead9d613-5b64-4f5c-b44b-a17fca85d4de] succeeded in 2.0221608700003344s: None 2024-04-15T03:05:09.084310057Z [2024-04-15 03:05:09,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c572ce40-2e4e-4997-9bd0-832332c6a6cf] received 2024-04-15T03:05:09.090878314Z [2024-04-15 03:05:09,090: INFO/ForkPoolWorker-15] [c572ce40-2e4e-4997-9bd0-832332c6a6cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:05:09.377002494Z [2024-04-15 03:05:09,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:05:10.593478977Z [2024-04-15 03:05:10,592: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:05:10.596383922Z [2024-04-15 03:05:10,595: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:05:10.626677618Z [2024-04-15 03:05:10,626: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:05:10.629258387Z [2024-04-15 03:05:10,628: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:05:10.629511037Z [2024-04-15 03:05:10,629: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:05:10.629883296Z [2024-04-15 03:05:10,629: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:05:10.630011797Z [2024-04-15 03:05:10,629: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:05:10.632627326Z [2024-04-15 03:05:10,632: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:05:10.632705220Z [2024-04-15 03:05:10,632: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:05:10.719451428Z [2024-04-15 03:05:10,718: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:05:11.343324816Z [2024-04-15 03:05:11,342: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c572ce40-2e4e-4997-9bd0-832332c6a6cf] succeeded in 2.25695953200011s: None 2024-04-15T03:06:00.359538446Z [2024-04-15 03:06:00,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5244d036-8b52-49c4-9f5e-60608f695768] received 2024-04-15T03:06:00.370665484Z [2024-04-15 03:06:00,370: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b00f458-7e23-4834-8705-a7cfa217d10c] received 2024-04-15T03:06:00.378223541Z [2024-04-15 03:06:00,377: INFO/ForkPoolWorker-15] [5244d036-8b52-49c4-9f5e-60608f695768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:06:00.380069826Z [2024-04-15 03:06:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15af0e92-89f6-4eb6-91d0-a8d14743012b] received 2024-04-15T03:06:00.382545486Z [2024-04-15 03:06:00,382: INFO/ForkPoolWorker-16] [8b00f458-7e23-4834-8705-a7cfa217d10c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:06:00.406451461Z [2024-04-15 03:06:00,406: INFO/ForkPoolWorker-1] [15af0e92-89f6-4eb6-91d0-a8d14743012b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:06:00.654531565Z [2024-04-15 03:06:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:06:00.688386295Z [2024-04-15 03:06:00,684: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:06:00.750788244Z [2024-04-15 03:06:00,746: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:06:00.956439385Z [2024-04-15 03:06:00,956: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:06:01.501257510Z [2024-04-15 03:06:01,500: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8b00f458-7e23-4834-8705-a7cfa217d10c] succeeded in 1.1280157419996613s: None 2024-04-15T03:06:02.196952387Z [2024-04-15 03:06:02,196: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:06:02.199929457Z [2024-04-15 03:06:02,199: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:06:02.246846423Z [2024-04-15 03:06:02,246: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:06:02.250240401Z [2024-04-15 03:06:02,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:06:02.272239891Z [2024-04-15 03:06:02,271: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:06:02.273637669Z [2024-04-15 03:06:02,273: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:06:02.273752351Z [2024-04-15 03:06:02,273: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:06:02.273983161Z [2024-04-15 03:06:02,273: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:06:02.274144732Z [2024-04-15 03:06:02,273: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:06:02.274660331Z [2024-04-15 03:06:02,274: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:06:02.274817148Z [2024-04-15 03:06:02,274: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:06:02.282745793Z [2024-04-15 03:06:02,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:06:02.283712415Z [2024-04-15 03:06:02,283: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:06:02.283790051Z [2024-04-15 03:06:02,283: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:06:02.283921681Z [2024-04-15 03:06:02,283: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:06:02.283989963Z [2024-04-15 03:06:02,283: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:06:02.284215710Z [2024-04-15 03:06:02,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:06:02.284297730Z [2024-04-15 03:06:02,284: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:06:02.344720625Z [2024-04-15 03:06:02,344: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:06:02.364971948Z [2024-04-15 03:06:02,364: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:06:03.829135698Z [2024-04-15 03:06:03,828: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5244d036-8b52-49c4-9f5e-60608f695768] succeeded in 3.463919582000017s: None 2024-04-15T03:06:04.304067759Z [2024-04-15 03:06:04,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[15af0e92-89f6-4eb6-91d0-a8d14743012b] succeeded in 3.918972593000035s: None 2024-04-15T03:07:00.872648182Z [2024-04-15 03:07:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2ec5beb-72d9-49f3-90fe-93446a1e3c19] received 2024-04-15T03:07:00.877162520Z [2024-04-15 03:07:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2d5e3ce-2634-4dcf-a363-2310d9b0fd11] received 2024-04-15T03:07:00.898793060Z [2024-04-15 03:07:00,898: INFO/ForkPoolWorker-15] [c2ec5beb-72d9-49f3-90fe-93446a1e3c19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:07:00.898813680Z [2024-04-15 03:07:00,898: INFO/ForkPoolWorker-16] [d2d5e3ce-2634-4dcf-a363-2310d9b0fd11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:07:01.184994496Z [2024-04-15 03:07:01,181: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:07:01.342090787Z [2024-04-15 03:07:01,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:07:02.573979483Z [2024-04-15 03:07:02,573: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:07:02.577433299Z [2024-04-15 03:07:02,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:07:02.588576474Z [2024-04-15 03:07:02,588: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:07:02.592430369Z [2024-04-15 03:07:02,592: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:07:02.619360970Z [2024-04-15 03:07:02,619: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:07:02.620791652Z [2024-04-15 03:07:02,620: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:07:02.620805215Z [2024-04-15 03:07:02,620: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:07:02.621049566Z [2024-04-15 03:07:02,620: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:07:02.621253147Z [2024-04-15 03:07:02,621: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:07:02.621584308Z [2024-04-15 03:07:02,621: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:07:02.621696352Z [2024-04-15 03:07:02,621: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:07:02.627875874Z [2024-04-15 03:07:02,627: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:07:02.630040748Z [2024-04-15 03:07:02,629: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:07:02.630875856Z [2024-04-15 03:07:02,630: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:07:02.631589470Z [2024-04-15 03:07:02,631: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:07:02.634015196Z [2024-04-15 03:07:02,633: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:07:02.634499059Z [2024-04-15 03:07:02,634: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:07:02.635446566Z [2024-04-15 03:07:02,635: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:07:02.703798656Z [2024-04-15 03:07:02,703: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:07:02.731137288Z [2024-04-15 03:07:02,730: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:07:04.411993211Z [2024-04-15 03:07:04,411: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2ec5beb-72d9-49f3-90fe-93446a1e3c19] succeeded in 3.5368644690006477s: None 2024-04-15T03:07:04.936269023Z [2024-04-15 03:07:04,935: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d2d5e3ce-2634-4dcf-a363-2310d9b0fd11] succeeded in 4.059309083999324s: None 2024-04-15T03:08:00.642646205Z [2024-04-15 03:08:00,642: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d66bc385-31e5-46d4-96f6-84c099de6738] received 2024-04-15T03:08:00.644873450Z [2024-04-15 03:08:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec680d54-d80f-4e5f-ac24-56b7f67f2c76] received 2024-04-15T03:08:00.650551367Z [2024-04-15 03:08:00,650: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9012f5b-03af-4ed0-bc03-750d806b2ef3] received 2024-04-15T03:08:00.657675687Z [2024-04-15 03:08:00,657: INFO/ForkPoolWorker-16] [ec680d54-d80f-4e5f-ac24-56b7f67f2c76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:08:00.661484188Z [2024-04-15 03:08:00,661: INFO/ForkPoolWorker-15] [d66bc385-31e5-46d4-96f6-84c099de6738] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:08:00.667370540Z [2024-04-15 03:08:00,667: INFO/ForkPoolWorker-1] [b9012f5b-03af-4ed0-bc03-750d806b2ef3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:08:00.981813582Z [2024-04-15 03:08:00,978: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:08:01.000610260Z [2024-04-15 03:08:00,996: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:08:01.082942541Z [2024-04-15 03:08:01,071: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:08:01.343821531Z [2024-04-15 03:08:01,343: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:08:02.212438101Z [2024-04-15 03:08:02,212: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d66bc385-31e5-46d4-96f6-84c099de6738] succeeded in 1.5651849810001295s: None 2024-04-15T03:08:02.559465955Z [2024-04-15 03:08:02,559: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:08:02.563050833Z [2024-04-15 03:08:02,562: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:08:02.599403284Z [2024-04-15 03:08:02,599: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:08:02.600402340Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:08:02.600467799Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:08:02.600630623Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:08:02.600687581Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:08:02.600968237Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:08:02.601042076Z [2024-04-15 03:08:02,600: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:08:02.605226990Z [2024-04-15 03:08:02,604: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:08:02.610000110Z [2024-04-15 03:08:02,609: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:08:02.642588009Z [2024-04-15 03:08:02,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:08:02.644030915Z [2024-04-15 03:08:02,643: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:08:02.644696485Z [2024-04-15 03:08:02,644: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:08:02.644938124Z [2024-04-15 03:08:02,644: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:08:02.645107826Z [2024-04-15 03:08:02,645: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:08:02.645414973Z [2024-04-15 03:08:02,645: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:08:02.645810770Z [2024-04-15 03:08:02,645: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:08:02.677764968Z [2024-04-15 03:08:02,677: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:08:02.732601871Z [2024-04-15 03:08:02,732: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:08:04.676822792Z [2024-04-15 03:08:04,676: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9012f5b-03af-4ed0-bc03-750d806b2ef3] succeeded in 4.022716424999999s: None 2024-04-15T03:08:05.241704175Z [2024-04-15 03:08:05,241: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec680d54-d80f-4e5f-ac24-56b7f67f2c76] succeeded in 4.594060790000185s: None 2024-04-15T03:09:00.647429042Z [2024-04-15 03:09:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86a05b2b-f8b8-47b0-a642-e8776f3a270f] received 2024-04-15T03:09:00.651585625Z [2024-04-15 03:09:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0afc98b4-1d47-427c-bcd8-f1c9692f4ec3] received 2024-04-15T03:09:00.655706574Z [2024-04-15 03:09:00,655: INFO/ForkPoolWorker-15] [86a05b2b-f8b8-47b0-a642-e8776f3a270f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:09:00.664123650Z [2024-04-15 03:09:00,663: INFO/ForkPoolWorker-16] [0afc98b4-1d47-427c-bcd8-f1c9692f4ec3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:09:00.923281293Z [2024-04-15 03:09:00,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:09:00.987667674Z [2024-04-15 03:09:00,984: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:09:02.174188409Z [2024-04-15 03:09:02,157: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:09:02.177778849Z [2024-04-15 03:09:02,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:09:02.241885622Z [2024-04-15 03:09:02,241: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:09:02.249000208Z [2024-04-15 03:09:02,248: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:09:02.249225325Z [2024-04-15 03:09:02,248: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:09:02.249495643Z [2024-04-15 03:09:02,249: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:09:02.249729632Z [2024-04-15 03:09:02,249: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:09:02.250175872Z [2024-04-15 03:09:02,250: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:09:02.250348283Z [2024-04-15 03:09:02,250: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:09:02.321640052Z [2024-04-15 03:09:02,321: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:09:02.329331586Z [2024-04-15 03:09:02,329: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:09:02.333505851Z [2024-04-15 03:09:02,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:09:02.365797265Z [2024-04-15 03:09:02,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:09:02.367084594Z [2024-04-15 03:09:02,366: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:09:02.367242231Z [2024-04-15 03:09:02,367: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:09:02.367434866Z [2024-04-15 03:09:02,367: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:09:02.367556608Z [2024-04-15 03:09:02,367: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:09:02.367846653Z [2024-04-15 03:09:02,367: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:09:02.367973832Z [2024-04-15 03:09:02,367: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:09:02.467394911Z [2024-04-15 03:09:02,467: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:09:04.004519275Z [2024-04-15 03:09:04,003: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0afc98b4-1d47-427c-bcd8-f1c9692f4ec3] succeeded in 3.3495797759997004s: None 2024-04-15T03:09:04.152161444Z [2024-04-15 03:09:04,151: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86a05b2b-f8b8-47b0-a642-e8776f3a270f] succeeded in 3.5025432969996473s: None 2024-04-15T03:10:00.692138971Z [2024-04-15 03:10:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1dc57f8-6695-455a-b26d-ba9e2f0d7493] received 2024-04-15T03:10:00.696496275Z [2024-04-15 03:10:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1970b157-b791-4cda-b812-22534ca8a418] received 2024-04-15T03:10:00.701285744Z [2024-04-15 03:10:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4960e4c5-cc33-4fd0-851f-2caef2003bf7] received 2024-04-15T03:10:00.704475580Z [2024-04-15 03:10:00,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ed68aef-506e-4ecb-ad16-a25ee647fa97] received 2024-04-15T03:10:00.720670837Z [2024-04-15 03:10:00,720: INFO/ForkPoolWorker-15] [c1dc57f8-6695-455a-b26d-ba9e2f0d7493] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:00.726216669Z [2024-04-15 03:10:00,725: INFO/ForkPoolWorker-2] [7ed68aef-506e-4ecb-ad16-a25ee647fa97] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:10:00.729924076Z [2024-04-15 03:10:00,729: INFO/ForkPoolWorker-1] [4960e4c5-cc33-4fd0-851f-2caef2003bf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:10:00.735846315Z [2024-04-15 03:10:00,735: INFO/ForkPoolWorker-16] [1970b157-b791-4cda-b812-22534ca8a418] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:10:01.230818626Z [2024-04-15 03:10:01,226: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:10:01.335306878Z [2024-04-15 03:10:01,332: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:10:01.429403536Z [2024-04-15 03:10:01,426: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:10:01.660130648Z [2024-04-15 03:10:01,651: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:10:01.821988225Z [2024-04-15 03:10:01,821: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:02.575590752Z [2024-04-15 03:10:02,575: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4960e4c5-cc33-4fd0-851f-2caef2003bf7] succeeded in 1.864839030999974s: None 2024-04-15T03:10:02.971737204Z [2024-04-15 03:10:02,971: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T03:10:02.979370283Z [2024-04-15 03:10:02,977: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:03.032299621Z [2024-04-15 03:10:03,032: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T03:10:03.033476183Z [2024-04-15 03:10:03,033: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:03.033606605Z [2024-04-15 03:10:03,033: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:03.033818103Z [2024-04-15 03:10:03,033: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:03.033934941Z [2024-04-15 03:10:03,033: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T03:10:03.034285308Z [2024-04-15 03:10:03,034: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:10:03.034830840Z [2024-04-15 03:10:03,034: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:03.116681779Z [2024-04-15 03:10:03,116: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:03.228288770Z [2024-04-15 03:10:03,227: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:10:03.231773828Z [2024-04-15 03:10:03,231: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:03.251919203Z [2024-04-15 03:10:03,251: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:10:03.253326537Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:03.253408653Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:03.253555533Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:03.253629247Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:10:03.253839144Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:10:03.253957584Z [2024-04-15 03:10:03,253: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:03.351914659Z [2024-04-15 03:10:03,351: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:03.440435964Z [2024-04-15 03:10:03,440: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:10:03.443828700Z [2024-04-15 03:10:03,443: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:03.482451962Z [2024-04-15 03:10:03,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:10:03.484333094Z [2024-04-15 03:10:03,483: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:03.484395302Z [2024-04-15 03:10:03,484: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:03.484510525Z [2024-04-15 03:10:03,484: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:03.484550848Z [2024-04-15 03:10:03,484: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:10:03.486242558Z [2024-04-15 03:10:03,486: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:10:03.486255084Z [2024-04-15 03:10:03,486: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:03.583926415Z [2024-04-15 03:10:03,583: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:04.172703688Z [2024-04-15 03:10:04,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c1dc57f8-6695-455a-b26d-ba9e2f0d7493] succeeded in 3.477801360999365s: None 2024-04-15T03:10:04.538967374Z [2024-04-15 03:10:04,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80e361ea-d008-4f30-a4a4-27669a2563cd] received 2024-04-15T03:10:04.547057155Z [2024-04-15 03:10:04,546: INFO/ForkPoolWorker-15] [80e361ea-d008-4f30-a4a4-27669a2563cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:04.590882462Z [2024-04-15 03:10:04,590: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7ed68aef-506e-4ecb-ad16-a25ee647fa97] succeeded in 3.8742492459996356s: None 2024-04-15T03:10:04.892214877Z [2024-04-15 03:10:04,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:10:05.167881710Z [2024-04-15 03:10:05,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1970b157-b791-4cda-b812-22534ca8a418] succeeded in 4.468317115999525s: None 2024-04-15T03:10:05.951019433Z [2024-04-15 03:10:05,950: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:10:05.954035417Z [2024-04-15 03:10:05,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:05.987096224Z [2024-04-15 03:10:05,986: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:10:05.988708068Z [2024-04-15 03:10:05,988: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:05.989317232Z [2024-04-15 03:10:05,988: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:05.989530437Z [2024-04-15 03:10:05,989: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:05.989628134Z [2024-04-15 03:10:05,989: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:10:05.990757868Z [2024-04-15 03:10:05,990: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:10:05.991545128Z [2024-04-15 03:10:05,990: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:06.071008250Z [2024-04-15 03:10:06,070: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:06.651373259Z [2024-04-15 03:10:06,650: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80e361ea-d008-4f30-a4a4-27669a2563cd] succeeded in 2.1098986670003796s: None 2024-04-15T03:10:06.743215817Z [2024-04-15 03:10:06,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[703aa24b-1d5e-4233-890b-df24a0e180d8] received 2024-04-15T03:10:06.754242370Z [2024-04-15 03:10:06,753: INFO/ForkPoolWorker-15] [703aa24b-1d5e-4233-890b-df24a0e180d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:10:06.998924460Z [2024-04-15 03:10:06,996: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:10:08.006391623Z [2024-04-15 03:10:08,005: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:10:08.009575613Z [2024-04-15 03:10:08,009: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:08.037427203Z [2024-04-15 03:10:08,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:10:08.038556232Z [2024-04-15 03:10:08,038: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:08.038569640Z [2024-04-15 03:10:08,038: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:08.038824553Z [2024-04-15 03:10:08,038: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:08.038847432Z [2024-04-15 03:10:08,038: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:10:08.039332962Z [2024-04-15 03:10:08,039: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:10:08.039478385Z [2024-04-15 03:10:08,039: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:08.135249509Z [2024-04-15 03:10:08,134: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:09.670743213Z [2024-04-15 03:10:09,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[703aa24b-1d5e-4233-890b-df24a0e180d8] succeeded in 2.9248518389995297s: None 2024-04-15T03:10:09.717987990Z [2024-04-15 03:10:09,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[774c00dd-387d-45ce-8b3c-eb450f60c19b] received 2024-04-15T03:10:09.729129812Z [2024-04-15 03:10:09,728: INFO/ForkPoolWorker-15] [774c00dd-387d-45ce-8b3c-eb450f60c19b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:10:10.046097860Z [2024-04-15 03:10:10,043: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:10:11.056782937Z [2024-04-15 03:10:11,056: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:10:11.059579261Z [2024-04-15 03:10:11,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:10:11.078344748Z [2024-04-15 03:10:11,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:10:11.093667267Z [2024-04-15 03:10:11,093: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:10:11.093788835Z [2024-04-15 03:10:11,093: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:10:11.094138354Z [2024-04-15 03:10:11,093: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:10:11.094214579Z [2024-04-15 03:10:11,094: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:10:11.094579114Z [2024-04-15 03:10:11,094: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:10:11.094702382Z [2024-04-15 03:10:11,094: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:10:11.171952890Z [2024-04-15 03:10:11,171: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:10:11.765307420Z [2024-04-15 03:10:11,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[774c00dd-387d-45ce-8b3c-eb450f60c19b] succeeded in 2.0434909799996603s: None 2024-04-15T03:11:00.496401538Z [2024-04-15 03:11:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6cd04f8-1e8b-4f27-9f9c-47d840bd7df8] received 2024-04-15T03:11:00.505933726Z [2024-04-15 03:11:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a963a7d2-acca-4b8e-b746-a769cced3711] received 2024-04-15T03:11:00.515437607Z [2024-04-15 03:11:00,514: INFO/ForkPoolWorker-15] [c6cd04f8-1e8b-4f27-9f9c-47d840bd7df8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:11:00.516695899Z [2024-04-15 03:11:00,516: INFO/ForkPoolWorker-16] [a963a7d2-acca-4b8e-b746-a769cced3711] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:11:00.803152512Z [2024-04-15 03:11:00,798: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:11:00.810491550Z [2024-04-15 03:11:00,800: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:11:02.026022530Z [2024-04-15 03:11:02,022: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:11:02.034748036Z [2024-04-15 03:11:02,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:11:02.099890254Z [2024-04-15 03:11:02,099: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:11:02.104085937Z [2024-04-15 03:11:02,103: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:11:02.104113453Z [2024-04-15 03:11:02,103: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:11:02.104251979Z [2024-04-15 03:11:02,104: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:11:02.104266471Z [2024-04-15 03:11:02,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:11:02.104521583Z [2024-04-15 03:11:02,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:11:02.104533544Z [2024-04-15 03:11:02,104: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:11:02.220817412Z [2024-04-15 03:11:02,220: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:11:02.257220619Z [2024-04-15 03:11:02,256: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:11:02.260367017Z [2024-04-15 03:11:02,259: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:11:02.282531383Z [2024-04-15 03:11:02,282: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:11:02.283653653Z [2024-04-15 03:11:02,283: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:11:02.283713264Z [2024-04-15 03:11:02,283: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:11:02.283841392Z [2024-04-15 03:11:02,283: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:11:02.283929791Z [2024-04-15 03:11:02,283: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:11:02.284970162Z [2024-04-15 03:11:02,284: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:11:02.285199480Z [2024-04-15 03:11:02,285: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:11:02.372711089Z [2024-04-15 03:11:02,371: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:11:03.862355154Z [2024-04-15 03:11:03,858: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a963a7d2-acca-4b8e-b746-a769cced3711] succeeded in 3.3488729430000603s: None 2024-04-15T03:11:04.914967052Z [2024-04-15 03:11:04,914: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6cd04f8-1e8b-4f27-9f9c-47d840bd7df8] succeeded in 4.414138183000432s: None 2024-04-15T03:12:00.990662239Z [2024-04-15 03:12:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77ec6149-97d2-42d7-bde3-208c1b58051e] received 2024-04-15T03:12:01.014047819Z [2024-04-15 03:12:01,013: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96f9b699-3239-4acf-9e4f-3598003ace32] received 2024-04-15T03:12:01.019897693Z [2024-04-15 03:12:01,019: INFO/ForkPoolWorker-15] [77ec6149-97d2-42d7-bde3-208c1b58051e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:12:01.024534693Z [2024-04-15 03:12:01,024: INFO/ForkPoolWorker-16] [96f9b699-3239-4acf-9e4f-3598003ace32] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:12:01.032215874Z [2024-04-15 03:12:01,031: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2436b486-b35d-44d7-b6de-7f86dbdd208c] received 2024-04-15T03:12:01.073758502Z [2024-04-15 03:12:01,071: INFO/ForkPoolWorker-1] [2436b486-b35d-44d7-b6de-7f86dbdd208c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:12:01.446573558Z [2024-04-15 03:12:01,443: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:12:01.468616928Z [2024-04-15 03:12:01,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:12:01.523826701Z [2024-04-15 03:12:01,507: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:12:01.861371676Z [2024-04-15 03:12:01,861: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:12:02.447800537Z [2024-04-15 03:12:02,447: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[96f9b699-3239-4acf-9e4f-3598003ace32] succeeded in 1.4298219720003544s: None 2024-04-15T03:12:02.938041529Z [2024-04-15 03:12:02,935: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:12:02.942065998Z [2024-04-15 03:12:02,938: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:12:02.972920246Z [2024-04-15 03:12:02,972: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:12:02.974050194Z [2024-04-15 03:12:02,973: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:12:02.974166409Z [2024-04-15 03:12:02,974: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:12:02.974324002Z [2024-04-15 03:12:02,974: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:12:02.974436180Z [2024-04-15 03:12:02,974: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:12:02.974753103Z [2024-04-15 03:12:02,974: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:12:02.974927767Z [2024-04-15 03:12:02,974: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:12:03.055199640Z [2024-04-15 03:12:03,054: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:12:03.078222882Z [2024-04-15 03:12:03,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:12:03.081382745Z [2024-04-15 03:12:03,080: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:12:03.107762420Z [2024-04-15 03:12:03,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:12:03.108875207Z [2024-04-15 03:12:03,108: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:12:03.108988680Z [2024-04-15 03:12:03,108: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:12:03.109155629Z [2024-04-15 03:12:03,108: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:12:03.109242773Z [2024-04-15 03:12:03,109: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:12:03.110296776Z [2024-04-15 03:12:03,109: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:12:03.110530870Z [2024-04-15 03:12:03,110: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:12:03.216925954Z [2024-04-15 03:12:03,216: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:12:04.575571412Z [2024-04-15 03:12:04,574: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2436b486-b35d-44d7-b6de-7f86dbdd208c] succeeded in 3.5376821129993914s: None 2024-04-15T03:12:05.374241120Z [2024-04-15 03:12:05,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77ec6149-97d2-42d7-bde3-208c1b58051e] succeeded in 4.380522750000637s: None 2024-04-15T03:13:00.227549165Z [2024-04-15 03:13:00,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65043bf2-db18-4e49-a113-a33f814f26ae] received 2024-04-15T03:13:00.232992626Z [2024-04-15 03:13:00,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b89b8fd6-74ec-4d76-b03b-48badbff2a2d] received 2024-04-15T03:13:00.236575782Z [2024-04-15 03:13:00,236: INFO/ForkPoolWorker-15] [65043bf2-db18-4e49-a113-a33f814f26ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:13:00.243449958Z [2024-04-15 03:13:00,243: INFO/ForkPoolWorker-16] [b89b8fd6-74ec-4d76-b03b-48badbff2a2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:13:00.536815211Z [2024-04-15 03:13:00,533: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:13:00.566088479Z [2024-04-15 03:13:00,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:13:02.016489042Z [2024-04-15 03:13:02,016: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:13:02.020252897Z [2024-04-15 03:13:02,019: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:13:02.103426337Z [2024-04-15 03:13:02,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:13:02.104764317Z [2024-04-15 03:13:02,104: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:13:02.104833294Z [2024-04-15 03:13:02,104: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:13:02.104971475Z [2024-04-15 03:13:02,104: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:13:02.104982316Z [2024-04-15 03:13:02,104: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:13:02.105214664Z [2024-04-15 03:13:02,105: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:13:02.105236112Z [2024-04-15 03:13:02,105: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:13:02.289136844Z [2024-04-15 03:13:02,288: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:13:02.351797901Z [2024-04-15 03:13:02,351: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:13:02.355186674Z [2024-04-15 03:13:02,354: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:13:02.414429428Z [2024-04-15 03:13:02,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:13:02.418405833Z [2024-04-15 03:13:02,418: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:13:02.418596130Z [2024-04-15 03:13:02,418: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:13:02.418815762Z [2024-04-15 03:13:02,418: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:13:02.418969714Z [2024-04-15 03:13:02,418: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:13:02.419279515Z [2024-04-15 03:13:02,419: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:13:02.419536044Z [2024-04-15 03:13:02,419: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:13:02.530702049Z [2024-04-15 03:13:02,530: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:13:03.966859027Z [2024-04-15 03:13:03,966: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b89b8fd6-74ec-4d76-b03b-48badbff2a2d] succeeded in 3.732005014999231s: None 2024-04-15T03:13:04.637095095Z [2024-04-15 03:13:04,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65043bf2-db18-4e49-a113-a33f814f26ae] succeeded in 4.405539537999175s: None 2024-04-15T03:14:00.833185253Z [2024-04-15 03:14:00,832: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2778a525-0529-466f-912f-1df62926cb6e] received 2024-04-15T03:14:00.847940987Z [2024-04-15 03:14:00,847: INFO/ForkPoolWorker-15] [2778a525-0529-466f-912f-1df62926cb6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:14:00.848570490Z [2024-04-15 03:14:00,848: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c57553b-5809-4096-a729-e0a88799dd42] received 2024-04-15T03:14:00.857445520Z [2024-04-15 03:14:00,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8fc096f-4557-4410-96b6-7e375108b3d6] received 2024-04-15T03:14:00.874044450Z [2024-04-15 03:14:00,857: INFO/ForkPoolWorker-16] [2c57553b-5809-4096-a729-e0a88799dd42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:14:00.879573957Z [2024-04-15 03:14:00,879: INFO/ForkPoolWorker-1] [d8fc096f-4557-4410-96b6-7e375108b3d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:14:01.251055305Z [2024-04-15 03:14:01,247: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:14:01.293866154Z [2024-04-15 03:14:01,290: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:14:01.420973455Z [2024-04-15 03:14:01,412: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:14:01.671561208Z [2024-04-15 03:14:01,671: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:14:02.461542563Z [2024-04-15 03:14:02,461: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2778a525-0529-466f-912f-1df62926cb6e] succeeded in 1.624411517000226s: None 2024-04-15T03:14:02.918027947Z [2024-04-15 03:14:02,916: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:14:02.926019034Z [2024-04-15 03:14:02,922: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:14:02.964487039Z [2024-04-15 03:14:02,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:14:02.965702353Z [2024-04-15 03:14:02,965: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:14:02.966050884Z [2024-04-15 03:14:02,965: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:14:02.966167456Z [2024-04-15 03:14:02,966: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:14:02.966564051Z [2024-04-15 03:14:02,966: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:14:02.968399113Z [2024-04-15 03:14:02,968: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:14:02.968477135Z [2024-04-15 03:14:02,968: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:14:03.088641027Z [2024-04-15 03:14:03,088: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:14:03.220457950Z [2024-04-15 03:14:03,220: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:14:03.223896470Z [2024-04-15 03:14:03,223: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:14:03.265509642Z [2024-04-15 03:14:03,265: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:14:03.267115648Z [2024-04-15 03:14:03,266: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:14:03.267285412Z [2024-04-15 03:14:03,267: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:14:03.267441894Z [2024-04-15 03:14:03,267: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:14:03.267495631Z [2024-04-15 03:14:03,267: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:14:03.267743841Z [2024-04-15 03:14:03,267: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:14:03.267919960Z [2024-04-15 03:14:03,267: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:14:03.346435413Z [2024-04-15 03:14:03,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:14:04.803840205Z [2024-04-15 03:14:04,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c57553b-5809-4096-a729-e0a88799dd42] succeeded in 3.9521640499997375s: None 2024-04-15T03:14:05.949686458Z [2024-04-15 03:14:05,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d8fc096f-4557-4410-96b6-7e375108b3d6] succeeded in 5.0898884769994766s: None 2024-04-15T03:15:00.580352130Z [2024-04-15 03:15:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44818714-d913-4a6b-a30e-0470aa31dbdd] received 2024-04-15T03:15:00.588122913Z [2024-04-15 03:15:00,587: INFO/ForkPoolWorker-15] [44818714-d913-4a6b-a30e-0470aa31dbdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:00.590123945Z [2024-04-15 03:15:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[774e8203-b49c-47b0-bab7-226f8cafb12c] received 2024-04-15T03:15:00.594553930Z [2024-04-15 03:15:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7361fa2-17e5-4cc1-afbd-f9fb2e2306b7] received 2024-04-15T03:15:00.603710974Z [2024-04-15 03:15:00,603: INFO/ForkPoolWorker-16] [774e8203-b49c-47b0-bab7-226f8cafb12c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:15:00.607504387Z [2024-04-15 03:15:00,607: INFO/ForkPoolWorker-1] [a7361fa2-17e5-4cc1-afbd-f9fb2e2306b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:15:00.944404791Z [2024-04-15 03:15:00,941: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:15:00.957655948Z [2024-04-15 03:15:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:15:01.170656227Z [2024-04-15 03:15:01,167: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:15:02.519119662Z [2024-04-15 03:15:02,518: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:15:02.522705974Z [2024-04-15 03:15:02,522: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:02.566576663Z [2024-04-15 03:15:02,566: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:15:02.568096653Z [2024-04-15 03:15:02,567: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:02.568569101Z [2024-04-15 03:15:02,568: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:02.568990997Z [2024-04-15 03:15:02,568: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:02.570178056Z [2024-04-15 03:15:02,568: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:15:02.570667029Z [2024-04-15 03:15:02,570: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:15:02.571639859Z [2024-04-15 03:15:02,571: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:02.670515889Z [2024-04-15 03:15:02,670: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:02.773185412Z [2024-04-15 03:15:02,772: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:15:02.776350937Z [2024-04-15 03:15:02,775: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:02.797731205Z [2024-04-15 03:15:02,797: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:15:02.801971251Z [2024-04-15 03:15:02,801: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:02.809596293Z [2024-04-15 03:15:02,809: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:15:02.810696740Z [2024-04-15 03:15:02,810: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:02.810803983Z [2024-04-15 03:15:02,810: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:02.810984562Z [2024-04-15 03:15:02,810: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:02.811082714Z [2024-04-15 03:15:02,810: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:15:02.811354417Z [2024-04-15 03:15:02,811: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:15:02.811380354Z [2024-04-15 03:15:02,811: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:02.837395206Z [2024-04-15 03:15:02,837: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:15:02.838939150Z [2024-04-15 03:15:02,838: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:02.838983473Z [2024-04-15 03:15:02,838: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:02.839084001Z [2024-04-15 03:15:02,838: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:02.839125373Z [2024-04-15 03:15:02,839: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:15:02.839306151Z [2024-04-15 03:15:02,839: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:15:02.839352323Z [2024-04-15 03:15:02,839: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:02.954649448Z [2024-04-15 03:15:02,954: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:02.968349224Z [2024-04-15 03:15:02,968: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:03.563030702Z [2024-04-15 03:15:03,562: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44818714-d913-4a6b-a30e-0470aa31dbdd] succeeded in 2.979837470000348s: None 2024-04-15T03:15:04.211247682Z [2024-04-15 03:15:04,210: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40c9e0d9-98b8-4e7f-b5d1-f15adedeb6b4] received 2024-04-15T03:15:04.224190663Z [2024-04-15 03:15:04,223: INFO/ForkPoolWorker-15] [40c9e0d9-98b8-4e7f-b5d1-f15adedeb6b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:04.533225297Z [2024-04-15 03:15:04,530: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:15:04.567194852Z [2024-04-15 03:15:04,566: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7361fa2-17e5-4cc1-afbd-f9fb2e2306b7] succeeded in 3.9706019799996284s: None 2024-04-15T03:15:04.593996482Z [2024-04-15 03:15:04,593: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[774e8203-b49c-47b0-bab7-226f8cafb12c] succeeded in 4.001520503999927s: None 2024-04-15T03:15:05.564353054Z [2024-04-15 03:15:05,563: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:15:05.567849571Z [2024-04-15 03:15:05,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:05.600400019Z [2024-04-15 03:15:05,600: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:15:05.601435764Z [2024-04-15 03:15:05,601: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:05.601568797Z [2024-04-15 03:15:05,601: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:05.601820569Z [2024-04-15 03:15:05,601: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:05.601986885Z [2024-04-15 03:15:05,601: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:15:05.602506268Z [2024-04-15 03:15:05,602: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:15:05.602619441Z [2024-04-15 03:15:05,602: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:05.689717773Z [2024-04-15 03:15:05,689: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:06.473998701Z [2024-04-15 03:15:06,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[40c9e0d9-98b8-4e7f-b5d1-f15adedeb6b4] succeeded in 2.2579747889994906s: None 2024-04-15T03:15:06.695097487Z [2024-04-15 03:15:06,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[159cc263-9051-4225-8bc7-603921c77ce0] received 2024-04-15T03:15:06.706304904Z [2024-04-15 03:15:06,705: INFO/ForkPoolWorker-15] [159cc263-9051-4225-8bc7-603921c77ce0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:15:06.969249690Z [2024-04-15 03:15:06,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:15:08.020276813Z [2024-04-15 03:15:08,019: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:15:08.023202989Z [2024-04-15 03:15:08,022: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:08.049600758Z [2024-04-15 03:15:08,049: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:15:08.052334330Z [2024-04-15 03:15:08,051: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:08.052367037Z [2024-04-15 03:15:08,052: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:08.052540589Z [2024-04-15 03:15:08,052: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:08.052991713Z [2024-04-15 03:15:08,052: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:15:08.055613367Z [2024-04-15 03:15:08,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:15:08.055629398Z [2024-04-15 03:15:08,055: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:08.157338193Z [2024-04-15 03:15:08,156: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:09.689913034Z [2024-04-15 03:15:09,689: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[159cc263-9051-4225-8bc7-603921c77ce0] succeeded in 2.9924929990002056s: None 2024-04-15T03:15:10.682349475Z [2024-04-15 03:15:10,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab58872f-4705-4521-b2f5-437a0b987759] received 2024-04-15T03:15:10.698077666Z [2024-04-15 03:15:10,697: INFO/ForkPoolWorker-15] [ab58872f-4705-4521-b2f5-437a0b987759] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:15:10.984317789Z [2024-04-15 03:15:10,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:15:12.059133836Z [2024-04-15 03:15:12,058: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:15:12.061749912Z [2024-04-15 03:15:12,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:15:12.087341777Z [2024-04-15 03:15:12,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:15:12.088691646Z [2024-04-15 03:15:12,088: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:15:12.089196828Z [2024-04-15 03:15:12,088: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:15:12.089341667Z [2024-04-15 03:15:12,089: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:15:12.089807395Z [2024-04-15 03:15:12,089: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:15:12.090424386Z [2024-04-15 03:15:12,090: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:15:12.090523632Z [2024-04-15 03:15:12,090: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:15:12.182562903Z [2024-04-15 03:15:12,182: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:15:12.744286439Z [2024-04-15 03:15:12,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab58872f-4705-4521-b2f5-437a0b987759] succeeded in 2.058249020000403s: None 2024-04-15T03:16:00.512251708Z [2024-04-15 03:16:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e97bab5-e58f-4a07-a7e3-042e6b22fc13] received 2024-04-15T03:16:00.514955440Z [2024-04-15 03:16:00,514: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3814e872-781f-43a9-b436-c83125791949] received 2024-04-15T03:16:00.516957598Z [2024-04-15 03:16:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce58ba39-593a-4a2c-a005-5c207a1a5451] received 2024-04-15T03:16:00.530369732Z [2024-04-15 03:16:00,529: INFO/ForkPoolWorker-1] [ce58ba39-593a-4a2c-a005-5c207a1a5451] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:16:00.534249284Z [2024-04-15 03:16:00,533: INFO/ForkPoolWorker-16] [3814e872-781f-43a9-b436-c83125791949] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:16:00.538449546Z [2024-04-15 03:16:00,538: INFO/ForkPoolWorker-15] [4e97bab5-e58f-4a07-a7e3-042e6b22fc13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:16:00.829859360Z [2024-04-15 03:16:00,824: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:16:00.834023842Z [2024-04-15 03:16:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:16:00.857465375Z [2024-04-15 03:16:00,853: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:16:01.244872918Z [2024-04-15 03:16:01,244: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:16:01.842858180Z [2024-04-15 03:16:01,842: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3814e872-781f-43a9-b436-c83125791949] succeeded in 1.3234738749997632s: None 2024-04-15T03:16:02.333384472Z [2024-04-15 03:16:02,332: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:16:02.336763502Z [2024-04-15 03:16:02,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:16:02.363095238Z [2024-04-15 03:16:02,362: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:16:02.365720931Z [2024-04-15 03:16:02,365: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:16:02.365786181Z [2024-04-15 03:16:02,365: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:16:02.365991262Z [2024-04-15 03:16:02,365: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:16:02.366110220Z [2024-04-15 03:16:02,365: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:16:02.366360383Z [2024-04-15 03:16:02,366: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:16:02.366439900Z [2024-04-15 03:16:02,366: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:16:02.410280937Z [2024-04-15 03:16:02,409: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:16:02.413412138Z [2024-04-15 03:16:02,412: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:16:02.444331851Z [2024-04-15 03:16:02,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:16:02.450608030Z [2024-04-15 03:16:02,450: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:16:02.456069053Z [2024-04-15 03:16:02,455: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:16:02.456145510Z [2024-04-15 03:16:02,455: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:16:02.456420063Z [2024-04-15 03:16:02,456: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:16:02.456495619Z [2024-04-15 03:16:02,456: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:16:02.456832020Z [2024-04-15 03:16:02,456: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:16:02.456915208Z [2024-04-15 03:16:02,456: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:16:02.560768952Z [2024-04-15 03:16:02,560: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:16:03.904697872Z [2024-04-15 03:16:03,904: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e97bab5-e58f-4a07-a7e3-042e6b22fc13] succeeded in 3.3875215650004975s: None 2024-04-15T03:16:04.467173421Z [2024-04-15 03:16:04,466: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ce58ba39-593a-4a2c-a005-5c207a1a5451] succeeded in 3.9463784139998097s: None 2024-04-15T03:17:00.885687453Z [2024-04-15 03:17:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6fe87d8-ae5e-45db-be03-a92c50439f22] received 2024-04-15T03:17:00.892922212Z [2024-04-15 03:17:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c419427-0728-422d-80a7-2b20f8849349] received 2024-04-15T03:17:00.895172316Z [2024-04-15 03:17:00,894: INFO/ForkPoolWorker-15] [c6fe87d8-ae5e-45db-be03-a92c50439f22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:17:00.905695704Z [2024-04-15 03:17:00,905: INFO/ForkPoolWorker-16] [5c419427-0728-422d-80a7-2b20f8849349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:17:01.322638894Z [2024-04-15 03:17:01,318: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:17:01.335720220Z [2024-04-15 03:17:01,319: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:17:02.708631103Z [2024-04-15 03:17:02,708: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:17:02.711927987Z [2024-04-15 03:17:02,711: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:17:02.727188856Z [2024-04-15 03:17:02,726: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:17:02.730606246Z [2024-04-15 03:17:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:17:02.741373676Z [2024-04-15 03:17:02,741: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:17:02.745710714Z [2024-04-15 03:17:02,745: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:17:02.745943599Z [2024-04-15 03:17:02,745: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:17:02.746161369Z [2024-04-15 03:17:02,745: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:17:02.746276358Z [2024-04-15 03:17:02,746: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:17:02.746694909Z [2024-04-15 03:17:02,746: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:17:02.746870167Z [2024-04-15 03:17:02,746: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:17:02.758654474Z [2024-04-15 03:17:02,758: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:17:02.759684238Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:17:02.759693284Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:17:02.759795270Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:17:02.759819136Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:17:02.760014018Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:17:02.760041907Z [2024-04-15 03:17:02,759: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:17:02.836023539Z [2024-04-15 03:17:02,835: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:17:02.850840647Z [2024-04-15 03:17:02,850: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:17:04.787183420Z [2024-04-15 03:17:04,786: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c6fe87d8-ae5e-45db-be03-a92c50439f22] succeeded in 3.8993021969999972s: None 2024-04-15T03:17:05.815545038Z [2024-04-15 03:17:05,815: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c419427-0728-422d-80a7-2b20f8849349] succeeded in 4.919384843999978s: None 2024-04-15T03:18:01.318830733Z [2024-04-15 03:18:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1180e992-8db7-4297-b05d-a22322cb6eb5] received 2024-04-15T03:18:01.326141911Z [2024-04-15 03:18:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01273292-bfc5-495e-9097-c2eb80aa0183] received 2024-04-15T03:18:01.336922361Z [2024-04-15 03:18:01,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65cd962e-3941-4126-a663-e7dbd1edd5ea] received 2024-04-15T03:18:01.346668750Z [2024-04-15 03:18:01,345: INFO/ForkPoolWorker-15] [1180e992-8db7-4297-b05d-a22322cb6eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:18:01.349027127Z [2024-04-15 03:18:01,348: INFO/ForkPoolWorker-16] [01273292-bfc5-495e-9097-c2eb80aa0183] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:18:01.350874136Z [2024-04-15 03:18:01,350: INFO/ForkPoolWorker-1] [65cd962e-3941-4126-a663-e7dbd1edd5ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:18:01.670494343Z [2024-04-15 03:18:01,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:18:01.743902561Z [2024-04-15 03:18:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:18:01.758240429Z [2024-04-15 03:18:01,754: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:18:02.142473023Z [2024-04-15 03:18:02,142: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:18:02.955728446Z [2024-04-15 03:18:02,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01273292-bfc5-495e-9097-c2eb80aa0183] succeeded in 1.6264059409995753s: None 2024-04-15T03:18:03.189669037Z [2024-04-15 03:18:03,189: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:18:03.192796155Z [2024-04-15 03:18:03,192: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:18:03.221252457Z [2024-04-15 03:18:03,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:18:03.222463157Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:18:03.222521704Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:18:03.222640018Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:18:03.222671218Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:18:03.222883624Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:18:03.222955762Z [2024-04-15 03:18:03,222: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:18:03.328288475Z [2024-04-15 03:18:03,327: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:18:03.437095801Z [2024-04-15 03:18:03,436: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:18:03.440325483Z [2024-04-15 03:18:03,439: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:18:03.476245360Z [2024-04-15 03:18:03,476: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:18:03.482900409Z [2024-04-15 03:18:03,481: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:18:03.483002219Z [2024-04-15 03:18:03,482: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:18:03.483200311Z [2024-04-15 03:18:03,482: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:18:03.483266457Z [2024-04-15 03:18:03,483: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:18:03.483565957Z [2024-04-15 03:18:03,483: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:18:03.483712723Z [2024-04-15 03:18:03,483: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:18:03.574209229Z [2024-04-15 03:18:03,573: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:18:05.134176505Z [2024-04-15 03:18:05,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1180e992-8db7-4297-b05d-a22322cb6eb5] succeeded in 3.8115245790004337s: None 2024-04-15T03:18:05.678515234Z [2024-04-15 03:18:05,677: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[65cd962e-3941-4126-a663-e7dbd1edd5ea] succeeded in 4.339136456000233s: None 2024-04-15T03:19:00.192729684Z [2024-04-15 03:19:00,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2095465a-24bb-443f-bd86-5e30fe708d80] received 2024-04-15T03:19:00.198487676Z [2024-04-15 03:19:00,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bfe9310-5f80-4b81-bf45-8f3c5aa426a3] received 2024-04-15T03:19:00.208425604Z [2024-04-15 03:19:00,207: INFO/ForkPoolWorker-16] [9bfe9310-5f80-4b81-bf45-8f3c5aa426a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:19:00.212554402Z [2024-04-15 03:19:00,211: INFO/ForkPoolWorker-15] [2095465a-24bb-443f-bd86-5e30fe708d80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:19:00.566220583Z [2024-04-15 03:19:00,562: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:19:00.572919685Z [2024-04-15 03:19:00,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:19:02.078036058Z [2024-04-15 03:19:02,077: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:19:02.081551557Z [2024-04-15 03:19:02,081: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:19:02.110639341Z [2024-04-15 03:19:02,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:19:02.114236283Z [2024-04-15 03:19:02,113: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:19:02.114327989Z [2024-04-15 03:19:02,114: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:19:02.114523501Z [2024-04-15 03:19:02,114: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:19:02.114576809Z [2024-04-15 03:19:02,114: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:19:02.114785091Z [2024-04-15 03:19:02,114: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:19:02.114807017Z [2024-04-15 03:19:02,114: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:19:02.161624160Z [2024-04-15 03:19:02,161: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:19:02.164981179Z [2024-04-15 03:19:02,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:19:02.198693114Z [2024-04-15 03:19:02,198: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:19:02.204792134Z [2024-04-15 03:19:02,204: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:19:02.204966099Z [2024-04-15 03:19:02,204: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:19:02.204977852Z [2024-04-15 03:19:02,204: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:19:02.205189074Z [2024-04-15 03:19:02,204: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:19:02.206020303Z [2024-04-15 03:19:02,205: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:19:02.206449605Z [2024-04-15 03:19:02,206: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:19:02.209806101Z [2024-04-15 03:19:02,209: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:19:02.323868714Z [2024-04-15 03:19:02,323: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:19:04.192675145Z [2024-04-15 03:19:04,192: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bfe9310-5f80-4b81-bf45-8f3c5aa426a3] succeeded in 3.9914201270003105s: None 2024-04-15T03:19:04.497131617Z [2024-04-15 03:19:04,496: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2095465a-24bb-443f-bd86-5e30fe708d80] succeeded in 4.297342398999717s: None 2024-04-15T03:20:00.790033447Z [2024-04-15 03:20:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0788bebe-04c1-4ad1-acf7-7a8c855f5a78] received 2024-04-15T03:20:00.790061952Z [2024-04-15 03:20:00,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9463b2bd-8f08-4da3-917f-2a0ff34d6510] received 2024-04-15T03:20:00.795839902Z [2024-04-15 03:20:00,793: INFO/ForkPoolWorker-15] [0788bebe-04c1-4ad1-acf7-7a8c855f5a78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:00.799655658Z [2024-04-15 03:20:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a939153-242a-4aea-9839-41edc03d848e] received 2024-04-15T03:20:00.807095165Z [2024-04-15 03:20:00,805: INFO/ForkPoolWorker-16] [9463b2bd-8f08-4da3-917f-2a0ff34d6510] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:20:00.809974242Z [2024-04-15 03:20:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a280801-bacd-4c35-8215-cd03d916ced0] received 2024-04-15T03:20:00.809989659Z [2024-04-15 03:20:00,808: INFO/ForkPoolWorker-1] [3a939153-242a-4aea-9839-41edc03d848e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:20:00.849922511Z [2024-04-15 03:20:00,849: INFO/ForkPoolWorker-2] [9a280801-bacd-4c35-8215-cd03d916ced0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:20:01.220375277Z [2024-04-15 03:20:01,216: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:20:01.256347474Z [2024-04-15 03:20:01,252: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:20:01.311474645Z [2024-04-15 03:20:01,308: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:20:01.600153203Z [2024-04-15 03:20:01,599: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:01.646418230Z [2024-04-15 03:20:01,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:20:02.443425040Z [2024-04-15 03:20:02,443: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9463b2bd-8f08-4da3-917f-2a0ff34d6510] succeeded in 1.6492671209998662s: None 2024-04-15T03:20:03.175875749Z [2024-04-15 03:20:03,175: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T03:20:03.179302608Z [2024-04-15 03:20:03,178: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:03.204489943Z [2024-04-15 03:20:03,204: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:20:03.208065568Z [2024-04-15 03:20:03,207: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:03.226726618Z [2024-04-15 03:20:03,226: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T03:20:03.228169782Z [2024-04-15 03:20:03,227: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:03.228452393Z [2024-04-15 03:20:03,228: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:03.228953682Z [2024-04-15 03:20:03,228: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:03.229204412Z [2024-04-15 03:20:03,229: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T03:20:03.229584860Z [2024-04-15 03:20:03,229: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:20:03.229711157Z [2024-04-15 03:20:03,229: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:03.247384246Z [2024-04-15 03:20:03,247: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:20:03.250640409Z [2024-04-15 03:20:03,250: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:03.250753613Z [2024-04-15 03:20:03,250: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:03.250999288Z [2024-04-15 03:20:03,250: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:03.251042882Z [2024-04-15 03:20:03,250: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:20:03.252375993Z [2024-04-15 03:20:03,252: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:20:03.252425959Z [2024-04-15 03:20:03,252: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:03.314958645Z [2024-04-15 03:20:03,314: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:03.353021759Z [2024-04-15 03:20:03,352: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:03.571031248Z [2024-04-15 03:20:03,570: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:20:03.574236952Z [2024-04-15 03:20:03,573: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:03.615973648Z [2024-04-15 03:20:03,615: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:20:03.618769652Z [2024-04-15 03:20:03,618: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:03.618782657Z [2024-04-15 03:20:03,618: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:03.618906138Z [2024-04-15 03:20:03,618: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:03.618917571Z [2024-04-15 03:20:03,618: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:20:03.619137154Z [2024-04-15 03:20:03,619: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:20:03.620232230Z [2024-04-15 03:20:03,619: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:03.738435646Z [2024-04-15 03:20:03,738: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:04.512680853Z [2024-04-15 03:20:04,485: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0788bebe-04c1-4ad1-acf7-7a8c855f5a78] succeeded in 3.6988009080005213s: None 2024-04-15T03:20:04.604573502Z [2024-04-15 03:20:04,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ef114ab-8f3e-41fc-8197-270b192bff68] received 2024-04-15T03:20:04.610910541Z [2024-04-15 03:20:04,610: INFO/ForkPoolWorker-15] [3ef114ab-8f3e-41fc-8197-270b192bff68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:05.001474871Z [2024-04-15 03:20:04,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:20:05.011925059Z [2024-04-15 03:20:05,011: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a939153-242a-4aea-9839-41edc03d848e] succeeded in 4.210037343000295s: None 2024-04-15T03:20:05.208570738Z [2024-04-15 03:20:05,202: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9a280801-bacd-4c35-8215-cd03d916ced0] succeeded in 4.383944885000346s: None 2024-04-15T03:20:06.098908957Z [2024-04-15 03:20:06,098: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:20:06.102854828Z [2024-04-15 03:20:06,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:06.142776354Z [2024-04-15 03:20:06,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:20:06.145273796Z [2024-04-15 03:20:06,144: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:06.145325539Z [2024-04-15 03:20:06,145: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:06.145528920Z [2024-04-15 03:20:06,145: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:06.146232845Z [2024-04-15 03:20:06,145: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:20:06.147221006Z [2024-04-15 03:20:06,146: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:20:06.147240474Z [2024-04-15 03:20:06,147: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:06.264500812Z [2024-04-15 03:20:06,263: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:06.957957911Z [2024-04-15 03:20:06,957: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3ef114ab-8f3e-41fc-8197-270b192bff68] succeeded in 2.3507397370003673s: None 2024-04-15T03:20:07.003626621Z [2024-04-15 03:20:07,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37787385-9cb2-4f4c-b13c-1a383e85bc69] received 2024-04-15T03:20:07.020749550Z [2024-04-15 03:20:07,020: INFO/ForkPoolWorker-15] [37787385-9cb2-4f4c-b13c-1a383e85bc69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:20:07.321115520Z [2024-04-15 03:20:07,318: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:20:08.343040724Z [2024-04-15 03:20:08,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:20:08.346164019Z [2024-04-15 03:20:08,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:08.374509435Z [2024-04-15 03:20:08,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:20:08.376626072Z [2024-04-15 03:20:08,376: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:08.376650755Z [2024-04-15 03:20:08,376: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:08.376838567Z [2024-04-15 03:20:08,376: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:08.377485545Z [2024-04-15 03:20:08,377: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:20:08.377798728Z [2024-04-15 03:20:08,377: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:20:08.377806610Z [2024-04-15 03:20:08,377: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:08.497580712Z [2024-04-15 03:20:08,495: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:09.951899308Z [2024-04-15 03:20:09,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37787385-9cb2-4f4c-b13c-1a383e85bc69] succeeded in 2.9443639480005004s: None 2024-04-15T03:20:10.882951933Z [2024-04-15 03:20:10,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d5f84b0-a68b-4b99-aa05-a848c8dade79] received 2024-04-15T03:20:10.894510762Z [2024-04-15 03:20:10,894: INFO/ForkPoolWorker-15] [7d5f84b0-a68b-4b99-aa05-a848c8dade79] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:20:11.168124318Z [2024-04-15 03:20:11,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:20:12.215707069Z [2024-04-15 03:20:12,215: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:20:12.218715763Z [2024-04-15 03:20:12,218: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:20:12.244169210Z [2024-04-15 03:20:12,243: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:20:12.245179950Z [2024-04-15 03:20:12,244: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:20:12.245198394Z [2024-04-15 03:20:12,245: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:20:12.245335965Z [2024-04-15 03:20:12,245: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:20:12.245397042Z [2024-04-15 03:20:12,245: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:20:12.245576870Z [2024-04-15 03:20:12,245: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:20:12.245586108Z [2024-04-15 03:20:12,245: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:20:12.326623170Z [2024-04-15 03:20:12,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:20:12.966819914Z [2024-04-15 03:20:12,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7d5f84b0-a68b-4b99-aa05-a848c8dade79] succeeded in 2.082094792999669s: None 2024-04-15T03:21:00.616776945Z [2024-04-15 03:21:00,616: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1166c4b-f4c8-45f0-b0bd-f095f28c3227] received 2024-04-15T03:21:00.618685439Z [2024-04-15 03:21:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d41eee91-eea2-4721-b7d0-d39b0d42a0d0] received 2024-04-15T03:21:00.631611798Z [2024-04-15 03:21:00,631: INFO/ForkPoolWorker-15] [e1166c4b-f4c8-45f0-b0bd-f095f28c3227] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:21:00.638655620Z [2024-04-15 03:21:00,638: INFO/ForkPoolWorker-16] [d41eee91-eea2-4721-b7d0-d39b0d42a0d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:21:01.025235459Z [2024-04-15 03:21:01,020: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:21:01.077591028Z [2024-04-15 03:21:01,073: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:21:02.590925085Z [2024-04-15 03:21:02,590: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:21:02.593161159Z [2024-04-15 03:21:02,592: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:21:02.594243281Z [2024-04-15 03:21:02,593: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:21:02.596311822Z [2024-04-15 03:21:02,595: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:21:02.616788776Z [2024-04-15 03:21:02,616: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:21:02.619819796Z [2024-04-15 03:21:02,619: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:21:02.619943894Z [2024-04-15 03:21:02,619: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:21:02.620150536Z [2024-04-15 03:21:02,619: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:21:02.620419302Z [2024-04-15 03:21:02,620: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:21:02.620707687Z [2024-04-15 03:21:02,620: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:21:02.620838702Z [2024-04-15 03:21:02,620: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:21:02.626057601Z [2024-04-15 03:21:02,625: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:21:02.627724846Z [2024-04-15 03:21:02,627: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:21:02.627848258Z [2024-04-15 03:21:02,627: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:21:02.628059379Z [2024-04-15 03:21:02,627: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:21:02.628293881Z [2024-04-15 03:21:02,628: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:21:02.628736085Z [2024-04-15 03:21:02,628: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:21:02.629564488Z [2024-04-15 03:21:02,629: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:21:02.714532837Z [2024-04-15 03:21:02,714: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:21:02.725190287Z [2024-04-15 03:21:02,724: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:21:04.158677854Z [2024-04-15 03:21:04,158: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1166c4b-f4c8-45f0-b0bd-f095f28c3227] succeeded in 3.538215270999899s: None 2024-04-15T03:21:04.756525795Z [2024-04-15 03:21:04,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d41eee91-eea2-4721-b7d0-d39b0d42a0d0] succeeded in 4.1337707540005795s: None 2024-04-15T03:21:44.117054019Z [2024-04-15 03:21:44,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd0c38e3-745e-4896-8f57-5036dea52611] received 2024-04-15T03:21:44.126453051Z [2024-04-15 03:21:44,126: INFO/ForkPoolWorker-15] [bd0c38e3-745e-4896-8f57-5036dea52611] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415032143_017362', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T03:21:44.410719690Z [2024-04-15 03:21:44,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-15T03:21:44.778309035Z [2024-04-15 03:21:44,777: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:21:45.457780773Z [2024-04-15 03:21:45,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd0c38e3-745e-4896-8f57-5036dea52611] succeeded in 1.3365590060002432s: None 2024-04-15T03:22:01.064809114Z [2024-04-15 03:22:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8d7af88-2560-4d6e-9d61-e04742851af6] received 2024-04-15T03:22:01.072314642Z [2024-04-15 03:22:01,071: INFO/ForkPoolWorker-15] [c8d7af88-2560-4d6e-9d61-e04742851af6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:22:01.088157120Z [2024-04-15 03:22:01,087: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb43185a-c870-4443-9939-5ab3db95ed50] received 2024-04-15T03:22:01.110674706Z [2024-04-15 03:22:01,110: INFO/ForkPoolWorker-16] [fb43185a-c870-4443-9939-5ab3db95ed50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:22:01.113421642Z [2024-04-15 03:22:01,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9378ff14-94d5-4948-8026-e6532dba6801] received 2024-04-15T03:22:01.134736380Z [2024-04-15 03:22:01,134: INFO/ForkPoolWorker-1] [9378ff14-94d5-4948-8026-e6532dba6801] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:22:01.487873463Z [2024-04-15 03:22:01,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:22:01.509974510Z [2024-04-15 03:22:01,504: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:22:01.723104242Z [2024-04-15 03:22:01,722: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:22:01.807303288Z [2024-04-15 03:22:01,750: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:22:02.591626931Z [2024-04-15 03:22:02,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8d7af88-2560-4d6e-9d61-e04742851af6] succeeded in 1.5248528199999782s: None 2024-04-15T03:22:03.413539761Z [2024-04-15 03:22:03,413: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:22:03.417149870Z [2024-04-15 03:22:03,416: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:22:03.454912173Z [2024-04-15 03:22:03,454: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:22:03.457815809Z [2024-04-15 03:22:03,457: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:22:03.458084034Z [2024-04-15 03:22:03,457: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:22:03.458372668Z [2024-04-15 03:22:03,458: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:22:03.458565775Z [2024-04-15 03:22:03,458: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:22:03.458920497Z [2024-04-15 03:22:03,458: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:22:03.459257261Z [2024-04-15 03:22:03,459: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:22:03.547359044Z [2024-04-15 03:22:03,547: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:22:03.633786531Z [2024-04-15 03:22:03,633: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:22:03.640021121Z [2024-04-15 03:22:03,639: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:22:03.690741408Z [2024-04-15 03:22:03,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:22:03.692174984Z [2024-04-15 03:22:03,691: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:22:03.692408868Z [2024-04-15 03:22:03,692: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:22:03.692660965Z [2024-04-15 03:22:03,692: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:22:03.692762142Z [2024-04-15 03:22:03,692: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:22:03.693103512Z [2024-04-15 03:22:03,692: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:22:03.693606193Z [2024-04-15 03:22:03,693: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:22:03.826601482Z [2024-04-15 03:22:03,826: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:22:05.213190036Z [2024-04-15 03:22:05,212: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fb43185a-c870-4443-9939-5ab3db95ed50] succeeded in 4.118191137999929s: None 2024-04-15T03:22:05.734280491Z [2024-04-15 03:22:05,733: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9378ff14-94d5-4948-8026-e6532dba6801] succeeded in 4.616532703999837s: None 2024-04-15T03:23:00.210943607Z [2024-04-15 03:23:00,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3524e29-a66a-4447-b682-ae3a0c1ea8bc] received 2024-04-15T03:23:00.224381770Z [2024-04-15 03:23:00,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4d43ae5-80a9-4b90-9382-f60891452f34] received 2024-04-15T03:23:00.224554915Z [2024-04-15 03:23:00,224: INFO/ForkPoolWorker-15] [c3524e29-a66a-4447-b682-ae3a0c1ea8bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:23:00.239637548Z [2024-04-15 03:23:00,239: INFO/ForkPoolWorker-16] [e4d43ae5-80a9-4b90-9382-f60891452f34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:23:00.487984125Z [2024-04-15 03:23:00,484: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:23:00.495137307Z [2024-04-15 03:23:00,491: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:23:01.867077789Z [2024-04-15 03:23:01,861: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:23:01.873829959Z [2024-04-15 03:23:01,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:23:01.888465155Z [2024-04-15 03:23:01,888: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:23:01.892883403Z [2024-04-15 03:23:01,892: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:23:01.945329121Z [2024-04-15 03:23:01,945: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:23:01.948571041Z [2024-04-15 03:23:01,948: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:23:01.948683349Z [2024-04-15 03:23:01,948: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:23:01.948803099Z [2024-04-15 03:23:01,948: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:23:01.948836028Z [2024-04-15 03:23:01,948: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:23:01.949148240Z [2024-04-15 03:23:01,949: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:23:01.949164126Z [2024-04-15 03:23:01,949: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:23:01.957382234Z [2024-04-15 03:23:01,957: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:23:01.965671049Z [2024-04-15 03:23:01,965: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:23:01.966932570Z [2024-04-15 03:23:01,966: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:23:01.967511604Z [2024-04-15 03:23:01,966: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:23:01.967677594Z [2024-04-15 03:23:01,967: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:23:01.968127807Z [2024-04-15 03:23:01,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:23:01.968449985Z [2024-04-15 03:23:01,968: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:23:02.071234417Z [2024-04-15 03:23:02,070: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:23:02.132264621Z [2024-04-15 03:23:02,131: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:23:03.695011729Z [2024-04-15 03:23:03,693: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4d43ae5-80a9-4b90-9382-f60891452f34] succeeded in 3.467067863000011s: None 2024-04-15T03:23:04.120784890Z [2024-04-15 03:23:04,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3524e29-a66a-4447-b682-ae3a0c1ea8bc] succeeded in 3.90504846299973s: None 2024-04-15T03:24:00.836319167Z [2024-04-15 03:24:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5153ff18-6190-4cb6-85cb-a06505dfceb3] received 2024-04-15T03:24:00.841794685Z [2024-04-15 03:24:00,841: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cda5b66-ab29-4ebb-b58c-b18f1197b6ec] received 2024-04-15T03:24:00.849987071Z [2024-04-15 03:24:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f117892-6e4b-4b04-a0b2-adfa2ac42992] received 2024-04-15T03:24:00.870949767Z [2024-04-15 03:24:00,868: INFO/ForkPoolWorker-16] [0cda5b66-ab29-4ebb-b58c-b18f1197b6ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:24:00.871989367Z [2024-04-15 03:24:00,871: INFO/ForkPoolWorker-15] [5153ff18-6190-4cb6-85cb-a06505dfceb3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:24:00.873918512Z [2024-04-15 03:24:00,873: INFO/ForkPoolWorker-1] [6f117892-6e4b-4b04-a0b2-adfa2ac42992] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:24:01.244270752Z [2024-04-15 03:24:01,234: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:24:01.295083055Z [2024-04-15 03:24:01,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:24:01.307238571Z [2024-04-15 03:24:01,303: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:24:01.822504993Z [2024-04-15 03:24:01,820: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:24:02.510023619Z [2024-04-15 03:24:02,509: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f117892-6e4b-4b04-a0b2-adfa2ac42992] succeeded in 1.656213755999488s: None 2024-04-15T03:24:02.988166829Z [2024-04-15 03:24:02,986: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:24:02.992261321Z [2024-04-15 03:24:02,991: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:24:02.995852656Z [2024-04-15 03:24:02,995: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:24:02.999288033Z [2024-04-15 03:24:02,998: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:24:03.066714580Z [2024-04-15 03:24:03,066: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:24:03.067217789Z [2024-04-15 03:24:03,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:24:03.069750646Z [2024-04-15 03:24:03,069: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:24:03.069765444Z [2024-04-15 03:24:03,069: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:24:03.070117343Z [2024-04-15 03:24:03,069: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:24:03.070219260Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:24:03.070378133Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:24:03.070440635Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:24:03.070706876Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:24:03.070776812Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:24:03.070783347Z [2024-04-15 03:24:03,069: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:24:03.071089749Z [2024-04-15 03:24:03,070: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:24:03.071726152Z [2024-04-15 03:24:03,071: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:24:03.072727932Z [2024-04-15 03:24:03,071: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:24:03.173968617Z [2024-04-15 03:24:03,173: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:24:03.190656263Z [2024-04-15 03:24:03,190: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:24:04.951633098Z [2024-04-15 03:24:04,951: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5153ff18-6190-4cb6-85cb-a06505dfceb3] succeeded in 4.107116164999752s: None 2024-04-15T03:24:05.996096957Z [2024-04-15 03:24:05,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0cda5b66-ab29-4ebb-b58c-b18f1197b6ec] succeeded in 5.146949310999844s: None 2024-04-15T03:25:00.661474048Z [2024-04-15 03:25:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b2dc7fd-39bd-4a84-b308-f65e2b0dcf24] received 2024-04-15T03:25:00.665003016Z [2024-04-15 03:25:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b273c94e-29fa-4ced-a868-620ae50164a2] received 2024-04-15T03:25:00.668825950Z [2024-04-15 03:25:00,668: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[964e271a-6bfe-4af7-8485-40fab77f6aef] received 2024-04-15T03:25:00.672404032Z [2024-04-15 03:25:00,672: INFO/ForkPoolWorker-15] [9b2dc7fd-39bd-4a84-b308-f65e2b0dcf24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:25:00.682520901Z [2024-04-15 03:25:00,682: INFO/ForkPoolWorker-1] [964e271a-6bfe-4af7-8485-40fab77f6aef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:00.686875047Z [2024-04-15 03:25:00,686: INFO/ForkPoolWorker-16] [b273c94e-29fa-4ced-a868-620ae50164a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:25:00.978397642Z [2024-04-15 03:25:00,975: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:25:01.037673880Z [2024-04-15 03:25:01,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:25:01.071425759Z [2024-04-15 03:25:01,068: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:25:02.704836259Z [2024-04-15 03:25:02,704: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:25:02.708182273Z [2024-04-15 03:25:02,707: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:02.724172923Z [2024-04-15 03:25:02,723: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:25:02.728048928Z [2024-04-15 03:25:02,727: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:02.742485785Z [2024-04-15 03:25:02,742: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:25:02.745006996Z [2024-04-15 03:25:02,744: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:02.745167005Z [2024-04-15 03:25:02,744: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:02.745518975Z [2024-04-15 03:25:02,745: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:02.745700180Z [2024-04-15 03:25:02,745: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:25:02.746049201Z [2024-04-15 03:25:02,745: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:25:02.746169379Z [2024-04-15 03:25:02,746: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:02.757612010Z [2024-04-15 03:25:02,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:25:02.758737736Z [2024-04-15 03:25:02,758: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:02.759312028Z [2024-04-15 03:25:02,759: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:02.760180024Z [2024-04-15 03:25:02,759: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:02.760355062Z [2024-04-15 03:25:02,760: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:25:02.760574564Z [2024-04-15 03:25:02,760: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:25:02.761264751Z [2024-04-15 03:25:02,761: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:02.832380433Z [2024-04-15 03:25:02,832: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:02.873003303Z [2024-04-15 03:25:02,872: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:02.888960483Z [2024-04-15 03:25:02,888: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:25:02.893031409Z [2024-04-15 03:25:02,892: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:02.931731622Z [2024-04-15 03:25:02,931: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:25:02.939643196Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:02.939657492Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:02.939667269Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:02.939671009Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:25:02.941656357Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:25:02.941667493Z [2024-04-15 03:25:02,939: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:03.073626474Z [2024-04-15 03:25:03,073: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:03.513569489Z [2024-04-15 03:25:03,513: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[964e271a-6bfe-4af7-8485-40fab77f6aef] succeeded in 2.843079150000449s: None 2024-04-15T03:25:03.632058501Z [2024-04-15 03:25:03,631: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70c91b1d-f1f5-46ab-8934-7cb414e0d100] received 2024-04-15T03:25:03.646977487Z [2024-04-15 03:25:03,646: INFO/ForkPoolWorker-1] [70c91b1d-f1f5-46ab-8934-7cb414e0d100] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:03.937071254Z [2024-04-15 03:25:03,934: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:25:04.490076550Z [2024-04-15 03:25:04,489: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b273c94e-29fa-4ced-a868-620ae50164a2] succeeded in 3.8223123130001113s: None 2024-04-15T03:25:04.921778126Z [2024-04-15 03:25:04,921: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9b2dc7fd-39bd-4a84-b308-f65e2b0dcf24] succeeded in 4.257856343999265s: None 2024-04-15T03:25:05.258121475Z [2024-04-15 03:25:05,257: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:25:05.261137047Z [2024-04-15 03:25:05,260: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:05.296569509Z [2024-04-15 03:25:05,296: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:25:05.299472467Z [2024-04-15 03:25:05,299: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:05.299807622Z [2024-04-15 03:25:05,299: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:05.300283661Z [2024-04-15 03:25:05,299: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:05.300585208Z [2024-04-15 03:25:05,300: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:25:05.301221461Z [2024-04-15 03:25:05,300: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:25:05.301564360Z [2024-04-15 03:25:05,301: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:05.382533789Z [2024-04-15 03:25:05,382: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:06.064964250Z [2024-04-15 03:25:06,063: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[70c91b1d-f1f5-46ab-8934-7cb414e0d100] succeeded in 2.423054382999908s: None 2024-04-15T03:25:06.814408729Z [2024-04-15 03:25:06,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86fe18ad-79e5-48f8-9c5f-cf2c3b8d06fd] received 2024-04-15T03:25:06.821554142Z [2024-04-15 03:25:06,821: INFO/ForkPoolWorker-15] [86fe18ad-79e5-48f8-9c5f-cf2c3b8d06fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:25:07.096451763Z [2024-04-15 03:25:07,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:25:08.182968249Z [2024-04-15 03:25:08,182: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:25:08.186108811Z [2024-04-15 03:25:08,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:08.230078576Z [2024-04-15 03:25:08,229: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:25:08.232082198Z [2024-04-15 03:25:08,231: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:08.232435015Z [2024-04-15 03:25:08,232: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:08.232947530Z [2024-04-15 03:25:08,232: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:08.233245055Z [2024-04-15 03:25:08,233: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:25:08.233784237Z [2024-04-15 03:25:08,233: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:25:08.234178888Z [2024-04-15 03:25:08,233: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:08.327018940Z [2024-04-15 03:25:08,326: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:10.307965337Z [2024-04-15 03:25:10,307: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86fe18ad-79e5-48f8-9c5f-cf2c3b8d06fd] succeeded in 3.4919202329992913s: None 2024-04-15T03:25:10.797541790Z [2024-04-15 03:25:10,794: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c49aa4d-af42-43df-83da-997de1bc621a] received 2024-04-15T03:25:10.802444810Z [2024-04-15 03:25:10,802: INFO/ForkPoolWorker-15] [3c49aa4d-af42-43df-83da-997de1bc621a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:25:11.083611503Z [2024-04-15 03:25:11,080: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:25:12.233326518Z [2024-04-15 03:25:12,232: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:25:12.236027426Z [2024-04-15 03:25:12,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:25:12.270721685Z [2024-04-15 03:25:12,270: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:25:12.271765358Z [2024-04-15 03:25:12,271: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:25:12.271837913Z [2024-04-15 03:25:12,271: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:25:12.272020250Z [2024-04-15 03:25:12,271: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:25:12.272087943Z [2024-04-15 03:25:12,272: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:25:12.272444390Z [2024-04-15 03:25:12,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:25:12.272563879Z [2024-04-15 03:25:12,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:25:12.384778470Z [2024-04-15 03:25:12,384: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:13.162825853Z [2024-04-15 03:25:13,162: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c49aa4d-af42-43df-83da-997de1bc621a] succeeded in 2.365596364999874s: None 2024-04-15T03:25:45.091255000Z [2024-04-15 03:25:45,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86b7740f-1bc4-4a7c-b642-5cc07c4817e4] received 2024-04-15T03:25:45.107085564Z [2024-04-15 03:25:45,106: INFO/ForkPoolWorker-15] [86b7740f-1bc4-4a7c-b642-5cc07c4817e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240415032543_944907', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py'] 2024-04-15T03:25:45.367457618Z [2024-04-15 03:25:45,364: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py 2024-04-15T03:25:45.709399309Z [2024-04-15 03:25:45,709: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:25:46.321748616Z [2024-04-15 03:25:46,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86b7740f-1bc4-4a7c-b642-5cc07c4817e4] succeeded in 1.227168819000326s: None 2024-04-15T03:26:00.537712612Z [2024-04-15 03:26:00,537: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64ac7cf2-72b8-4024-9db2-0e711f28ca69] received 2024-04-15T03:26:00.549211121Z [2024-04-15 03:26:00,548: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1553e2d3-9df5-4a14-a5ae-f753de22d801] received 2024-04-15T03:26:00.551307642Z [2024-04-15 03:26:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dc638fe-b2ca-49e8-9f38-8058cfef6cf6] received 2024-04-15T03:26:00.551869516Z [2024-04-15 03:26:00,551: INFO/ForkPoolWorker-15] [64ac7cf2-72b8-4024-9db2-0e711f28ca69] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:26:00.565419900Z [2024-04-15 03:26:00,565: INFO/ForkPoolWorker-16] [1553e2d3-9df5-4a14-a5ae-f753de22d801] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:26:00.576006061Z [2024-04-15 03:26:00,567: INFO/ForkPoolWorker-1] [3dc638fe-b2ca-49e8-9f38-8058cfef6cf6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:26:00.922560498Z [2024-04-15 03:26:00,917: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:26:00.933352531Z [2024-04-15 03:26:00,929: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:26:00.938633050Z [2024-04-15 03:26:00,934: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:26:01.196147799Z [2024-04-15 03:26:01,195: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:26:02.052748093Z [2024-04-15 03:26:02,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64ac7cf2-72b8-4024-9db2-0e711f28ca69] succeeded in 1.5040045769992503s: None 2024-04-15T03:26:02.351997839Z [2024-04-15 03:26:02,351: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:26:02.355606117Z [2024-04-15 03:26:02,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:26:02.384938613Z [2024-04-15 03:26:02,384: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:26:02.387896158Z [2024-04-15 03:26:02,387: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:26:02.388114887Z [2024-04-15 03:26:02,387: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:26:02.388378797Z [2024-04-15 03:26:02,388: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:26:02.388536667Z [2024-04-15 03:26:02,388: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:26:02.388835432Z [2024-04-15 03:26:02,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:26:02.389065354Z [2024-04-15 03:26:02,388: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:26:02.456585716Z [2024-04-15 03:26:02,456: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:26:02.727261442Z [2024-04-15 03:26:02,726: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:26:02.730555940Z [2024-04-15 03:26:02,730: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:26:02.773730669Z [2024-04-15 03:26:02,773: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:26:02.775209094Z [2024-04-15 03:26:02,774: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:26:02.775225857Z [2024-04-15 03:26:02,775: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:26:02.775370513Z [2024-04-15 03:26:02,775: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:26:02.775406264Z [2024-04-15 03:26:02,775: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:26:02.775696479Z [2024-04-15 03:26:02,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:26:02.776040602Z [2024-04-15 03:26:02,775: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:26:02.907717790Z [2024-04-15 03:26:02,907: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:26:04.079389480Z [2024-04-15 03:26:04,078: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3dc638fe-b2ca-49e8-9f38-8058cfef6cf6] succeeded in 3.5249455539997143s: None 2024-04-15T03:26:05.454674422Z [2024-04-15 03:26:05,453: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1553e2d3-9df5-4a14-a5ae-f753de22d801] succeeded in 4.898235087000103s: None 2024-04-15T03:27:01.155433829Z [2024-04-15 03:27:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf50648f-5e87-4b0a-8062-4ca72fd2fd62] received 2024-04-15T03:27:01.162865499Z [2024-04-15 03:27:01,162: INFO/ForkPoolWorker-15] [cf50648f-5e87-4b0a-8062-4ca72fd2fd62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:27:01.172605576Z [2024-04-15 03:27:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f7e3b76-0d92-437d-be0b-f482c90fad21] received 2024-04-15T03:27:01.184704608Z [2024-04-15 03:27:01,184: INFO/ForkPoolWorker-16] [7f7e3b76-0d92-437d-be0b-f482c90fad21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:27:01.437789606Z [2024-04-15 03:27:01,434: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:27:01.529804036Z [2024-04-15 03:27:01,519: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:27:02.739065655Z [2024-04-15 03:27:02,738: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:27:02.742482818Z [2024-04-15 03:27:02,742: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:27:02.754996569Z [2024-04-15 03:27:02,754: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:27:02.758704714Z [2024-04-15 03:27:02,758: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:27:02.767533729Z [2024-04-15 03:27:02,767: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:27:02.769095011Z [2024-04-15 03:27:02,768: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:27:02.769135927Z [2024-04-15 03:27:02,769: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:27:02.769235125Z [2024-04-15 03:27:02,769: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:27:02.769291760Z [2024-04-15 03:27:02,769: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:27:02.769574444Z [2024-04-15 03:27:02,769: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:27:02.769611108Z [2024-04-15 03:27:02,769: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:27:02.791284263Z [2024-04-15 03:27:02,791: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:27:02.793101154Z [2024-04-15 03:27:02,792: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:27:02.793251817Z [2024-04-15 03:27:02,793: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:27:02.793468386Z [2024-04-15 03:27:02,793: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:27:02.793609866Z [2024-04-15 03:27:02,793: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:27:02.793896682Z [2024-04-15 03:27:02,793: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:27:02.794137813Z [2024-04-15 03:27:02,794: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:27:02.894632903Z [2024-04-15 03:27:02,894: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:27:02.928478126Z [2024-04-15 03:27:02,927: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:27:04.527785233Z [2024-04-15 03:27:04,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7f7e3b76-0d92-437d-be0b-f482c90fad21] succeeded in 3.353652508999403s: None 2024-04-15T03:27:05.596954336Z [2024-04-15 03:27:05,596: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cf50648f-5e87-4b0a-8062-4ca72fd2fd62] succeeded in 4.438782913999603s: None 2024-04-15T03:28:01.019742122Z [2024-04-15 03:28:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe40935d-90a6-4cdb-845f-1fdbf7494151] received 2024-04-15T03:28:01.023041019Z [2024-04-15 03:28:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3bad6cc7-3291-4a96-b21d-a56587a895fa] received 2024-04-15T03:28:01.028145431Z [2024-04-15 03:28:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e011f9d-25a4-464e-822e-52e8380cc9f0] received 2024-04-15T03:28:01.050222132Z [2024-04-15 03:28:01,049: INFO/ForkPoolWorker-1] [8e011f9d-25a4-464e-822e-52e8380cc9f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:28:01.056563222Z [2024-04-15 03:28:01,056: INFO/ForkPoolWorker-15] [fe40935d-90a6-4cdb-845f-1fdbf7494151] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:28:01.061968056Z [2024-04-15 03:28:01,061: INFO/ForkPoolWorker-16] [3bad6cc7-3291-4a96-b21d-a56587a895fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:28:01.400418578Z [2024-04-15 03:28:01,396: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:28:01.573518070Z [2024-04-15 03:28:01,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:28:01.602369955Z [2024-04-15 03:28:01,599: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:28:01.941967665Z [2024-04-15 03:28:01,937: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:28:02.555033065Z [2024-04-15 03:28:02,554: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3bad6cc7-3291-4a96-b21d-a56587a895fa] succeeded in 1.5258265860002211s: None 2024-04-15T03:28:02.748027535Z [2024-04-15 03:28:02,747: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:28:02.751372240Z [2024-04-15 03:28:02,750: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:28:02.785276264Z [2024-04-15 03:28:02,785: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:28:02.786437180Z [2024-04-15 03:28:02,786: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:28:02.786647289Z [2024-04-15 03:28:02,786: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:28:02.786747059Z [2024-04-15 03:28:02,786: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:28:02.786778161Z [2024-04-15 03:28:02,786: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:28:02.788602434Z [2024-04-15 03:28:02,788: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:28:02.788617782Z [2024-04-15 03:28:02,788: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:28:02.894139876Z [2024-04-15 03:28:02,893: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:28:03.248354943Z [2024-04-15 03:28:03,247: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:28:03.251675290Z [2024-04-15 03:28:03,251: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:28:03.290651795Z [2024-04-15 03:28:03,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:28:03.291752074Z [2024-04-15 03:28:03,291: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:28:03.291828279Z [2024-04-15 03:28:03,291: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:28:03.291990814Z [2024-04-15 03:28:03,291: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:28:03.292104128Z [2024-04-15 03:28:03,291: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:28:03.292414642Z [2024-04-15 03:28:03,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:28:03.292804290Z [2024-04-15 03:28:03,292: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:28:03.361264238Z [2024-04-15 03:28:03,360: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:28:04.347765368Z [2024-04-15 03:28:04,346: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e011f9d-25a4-464e-822e-52e8380cc9f0] succeeded in 3.315876324999408s: None 2024-04-15T03:28:05.343989034Z [2024-04-15 03:28:05,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe40935d-90a6-4cdb-845f-1fdbf7494151] succeeded in 4.318665343999783s: None 2024-04-15T03:29:00.881114743Z [2024-04-15 03:29:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12dac5d5-b80f-469d-86c7-b84b86190122] received 2024-04-15T03:29:00.886408093Z [2024-04-15 03:29:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a0df226-3796-4676-b866-0b1630de8050] received 2024-04-15T03:29:00.898545499Z [2024-04-15 03:29:00,898: INFO/ForkPoolWorker-16] [6a0df226-3796-4676-b866-0b1630de8050] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:29:00.902847772Z [2024-04-15 03:29:00,902: INFO/ForkPoolWorker-15] [12dac5d5-b80f-469d-86c7-b84b86190122] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:29:01.210329888Z [2024-04-15 03:29:01,206: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:29:01.259361418Z [2024-04-15 03:29:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:29:02.533448572Z [2024-04-15 03:29:02,533: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:29:02.536857313Z [2024-04-15 03:29:02,536: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:29:02.570866569Z [2024-04-15 03:29:02,570: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:29:02.571982664Z [2024-04-15 03:29:02,571: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:29:02.572001599Z [2024-04-15 03:29:02,571: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:29:02.572168005Z [2024-04-15 03:29:02,571: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:29:02.572235366Z [2024-04-15 03:29:02,572: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:29:02.572594791Z [2024-04-15 03:29:02,572: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:29:02.572655006Z [2024-04-15 03:29:02,572: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:29:02.673994108Z [2024-04-15 03:29:02,673: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:29:02.679129067Z [2024-04-15 03:29:02,678: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:29:02.682309140Z [2024-04-15 03:29:02,681: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:29:02.704571037Z [2024-04-15 03:29:02,704: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:29:02.708861578Z [2024-04-15 03:29:02,707: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:29:02.708979979Z [2024-04-15 03:29:02,708: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:29:02.709084480Z [2024-04-15 03:29:02,708: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:29:02.709121015Z [2024-04-15 03:29:02,709: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:29:02.710276930Z [2024-04-15 03:29:02,710: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:29:02.710350711Z [2024-04-15 03:29:02,710: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:29:02.806500414Z [2024-04-15 03:29:02,806: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:29:04.318698331Z [2024-04-15 03:29:04,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12dac5d5-b80f-469d-86c7-b84b86190122] succeeded in 3.433518871999695s: None 2024-04-15T03:29:04.713436857Z [2024-04-15 03:29:04,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a0df226-3796-4676-b866-0b1630de8050] succeeded in 3.824711484000545s: None 2024-04-15T03:30:00.940206953Z [2024-04-15 03:30:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[919c5770-f853-4930-b0ae-c9b0b6e67ce7] received 2024-04-15T03:30:00.947928728Z [2024-04-15 03:30:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9a15e0f-396b-4de9-9f83-f64f6e32622d] received 2024-04-15T03:30:00.947970067Z [2024-04-15 03:30:00,947: INFO/ForkPoolWorker-15] [919c5770-f853-4930-b0ae-c9b0b6e67ce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:00.960157575Z [2024-04-15 03:30:00,959: INFO/ForkPoolWorker-16] [b9a15e0f-396b-4de9-9f83-f64f6e32622d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:30:00.962204506Z [2024-04-15 03:30:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c441848a-2126-4f14-84cd-28ec4be8cfcd] received 2024-04-15T03:30:00.967577750Z [2024-04-15 03:30:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9539e642-efbf-498b-8766-59c583002d3a] received 2024-04-15T03:30:00.971273988Z [2024-04-15 03:30:00,970: INFO/ForkPoolWorker-1] [c441848a-2126-4f14-84cd-28ec4be8cfcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:30:00.992562947Z [2024-04-15 03:30:00,992: INFO/ForkPoolWorker-2] [9539e642-efbf-498b-8766-59c583002d3a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:30:01.280379425Z [2024-04-15 03:30:01,277: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:30:01.509659236Z [2024-04-15 03:30:01,495: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:30:01.585539884Z [2024-04-15 03:30:01,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:30:01.677221937Z [2024-04-15 03:30:01,673: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:30:02.133301304Z [2024-04-15 03:30:02,133: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:03.012710886Z [2024-04-15 03:30:03,012: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:30:03.015955516Z [2024-04-15 03:30:03,015: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:03.024196410Z [2024-04-15 03:30:03,023: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b9a15e0f-396b-4de9-9f83-f64f6e32622d] succeeded in 2.073735928000133s: None 2024-04-15T03:30:03.069074772Z [2024-04-15 03:30:03,068: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:30:03.073992467Z [2024-04-15 03:30:03,073: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:03.074089487Z [2024-04-15 03:30:03,073: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:03.074242936Z [2024-04-15 03:30:03,074: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:03.074344713Z [2024-04-15 03:30:03,074: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:30:03.074591154Z [2024-04-15 03:30:03,074: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:30:03.074997964Z [2024-04-15 03:30:03,074: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:03.168820851Z [2024-04-15 03:30:03,168: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:03.578687013Z [2024-04-15 03:30:03,578: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:30:03.581791001Z [2024-04-15 03:30:03,581: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:03.610297612Z [2024-04-15 03:30:03,610: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:30:03.611839273Z [2024-04-15 03:30:03,611: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:03.612013132Z [2024-04-15 03:30:03,611: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:03.612152275Z [2024-04-15 03:30:03,612: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:03.612230762Z [2024-04-15 03:30:03,612: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:30:03.612623554Z [2024-04-15 03:30:03,612: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:30:03.612707234Z [2024-04-15 03:30:03,612: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:03.642131630Z [2024-04-15 03:30:03,641: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T03:30:03.645382207Z [2024-04-15 03:30:03,644: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:03.689736076Z [2024-04-15 03:30:03,689: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:03.690589161Z [2024-04-15 03:30:03,690: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T03:30:03.691796700Z [2024-04-15 03:30:03,691: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:03.691873473Z [2024-04-15 03:30:03,691: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:03.692015976Z [2024-04-15 03:30:03,691: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:03.692049248Z [2024-04-15 03:30:03,691: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T03:30:03.692329365Z [2024-04-15 03:30:03,692: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:30:03.692421009Z [2024-04-15 03:30:03,692: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:03.709833445Z [2024-04-15 03:30:03,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[919c5770-f853-4930-b0ae-c9b0b6e67ce7] succeeded in 2.7663063899999543s: None 2024-04-15T03:30:03.770924697Z [2024-04-15 03:30:03,770: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:04.177552944Z [2024-04-15 03:30:04,177: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d8dafdb-e520-44bd-9d9d-12d9431c2cfd] received 2024-04-15T03:30:04.185496610Z [2024-04-15 03:30:04,185: INFO/ForkPoolWorker-15] [6d8dafdb-e520-44bd-9d9d-12d9431c2cfd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:04.478242239Z [2024-04-15 03:30:04,475: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:30:05.374105033Z [2024-04-15 03:30:05,373: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9539e642-efbf-498b-8766-59c583002d3a] succeeded in 4.402324603000125s: None 2024-04-15T03:30:05.513111967Z [2024-04-15 03:30:05,512: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c441848a-2126-4f14-84cd-28ec4be8cfcd] succeeded in 4.548551591000432s: None 2024-04-15T03:30:05.595155036Z [2024-04-15 03:30:05,594: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:30:05.598098213Z [2024-04-15 03:30:05,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:05.621131431Z [2024-04-15 03:30:05,620: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:30:05.624150816Z [2024-04-15 03:30:05,623: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:05.624803217Z [2024-04-15 03:30:05,624: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:05.625292546Z [2024-04-15 03:30:05,624: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:05.625307608Z [2024-04-15 03:30:05,625: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:30:05.625600116Z [2024-04-15 03:30:05,625: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:30:05.625617408Z [2024-04-15 03:30:05,625: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:05.705494311Z [2024-04-15 03:30:05,705: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:06.306570795Z [2024-04-15 03:30:06,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d8dafdb-e520-44bd-9d9d-12d9431c2cfd] succeeded in 2.127457419000166s: None 2024-04-15T03:30:07.036441446Z [2024-04-15 03:30:07,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0c15166-6c6f-4080-ae26-15f40f6a088c] received 2024-04-15T03:30:07.047115958Z [2024-04-15 03:30:07,046: INFO/ForkPoolWorker-15] [b0c15166-6c6f-4080-ae26-15f40f6a088c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:30:07.416821490Z [2024-04-15 03:30:07,413: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:30:08.589656387Z [2024-04-15 03:30:08,589: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:30:08.592620721Z [2024-04-15 03:30:08,592: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:08.624906883Z [2024-04-15 03:30:08,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:30:08.627069184Z [2024-04-15 03:30:08,626: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:08.627248084Z [2024-04-15 03:30:08,627: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:08.627522555Z [2024-04-15 03:30:08,627: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:08.627704920Z [2024-04-15 03:30:08,627: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:30:08.628256143Z [2024-04-15 03:30:08,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:30:08.628761244Z [2024-04-15 03:30:08,628: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:08.719544359Z [2024-04-15 03:30:08,719: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:10.083190102Z [2024-04-15 03:30:10,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b0c15166-6c6f-4080-ae26-15f40f6a088c] succeeded in 3.0420799639996403s: None 2024-04-15T03:30:11.059034547Z [2024-04-15 03:30:11,058: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0313b56-fa16-43f4-9e5e-aec6ef9b5c21] received 2024-04-15T03:30:11.072541508Z [2024-04-15 03:30:11,072: INFO/ForkPoolWorker-15] [e0313b56-fa16-43f4-9e5e-aec6ef9b5c21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:30:11.336050232Z [2024-04-15 03:30:11,333: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:30:12.435569098Z [2024-04-15 03:30:12,435: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:30:12.438547214Z [2024-04-15 03:30:12,438: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:30:12.481334011Z [2024-04-15 03:30:12,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:30:12.483078855Z [2024-04-15 03:30:12,482: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:30:12.483205499Z [2024-04-15 03:30:12,483: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:30:12.483497896Z [2024-04-15 03:30:12,483: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:30:12.483614187Z [2024-04-15 03:30:12,483: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:30:12.484033015Z [2024-04-15 03:30:12,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:30:12.484150342Z [2024-04-15 03:30:12,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:30:12.586956895Z [2024-04-15 03:30:12,586: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:30:13.149270350Z [2024-04-15 03:30:13,148: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0313b56-fa16-43f4-9e5e-aec6ef9b5c21] succeeded in 2.088124152999626s: None 2024-04-15T03:31:00.682641906Z [2024-04-15 03:31:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[208c1597-6bbe-44de-9142-9a7b58237b4d] received 2024-04-15T03:31:00.688520971Z [2024-04-15 03:31:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26491b5e-a700-4ba9-a2de-06112c60cc98] received 2024-04-15T03:31:00.701778110Z [2024-04-15 03:31:00,701: INFO/ForkPoolWorker-15] [208c1597-6bbe-44de-9142-9a7b58237b4d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:31:00.704387804Z [2024-04-15 03:31:00,704: INFO/ForkPoolWorker-16] [26491b5e-a700-4ba9-a2de-06112c60cc98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:31:01.122499664Z [2024-04-15 03:31:01,117: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:31:01.136923718Z [2024-04-15 03:31:01,134: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:31:02.606533594Z [2024-04-15 03:31:02,606: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:31:02.610138779Z [2024-04-15 03:31:02,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:31:02.679087386Z [2024-04-15 03:31:02,678: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:31:02.685956821Z [2024-04-15 03:31:02,685: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:31:02.686017530Z [2024-04-15 03:31:02,685: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:31:02.687123066Z [2024-04-15 03:31:02,686: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:31:02.687252847Z [2024-04-15 03:31:02,687: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:31:02.688695462Z [2024-04-15 03:31:02,688: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:31:02.688806736Z [2024-04-15 03:31:02,688: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:31:02.713737334Z [2024-04-15 03:31:02,713: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:31:02.717116852Z [2024-04-15 03:31:02,716: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:31:02.776980748Z [2024-04-15 03:31:02,776: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:31:02.802578640Z [2024-04-15 03:31:02,802: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:31:02.802692475Z [2024-04-15 03:31:02,802: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:31:02.802892383Z [2024-04-15 03:31:02,802: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:31:02.803056562Z [2024-04-15 03:31:02,802: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:31:02.803446508Z [2024-04-15 03:31:02,803: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:31:02.803636721Z [2024-04-15 03:31:02,803: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:31:02.810168435Z [2024-04-15 03:31:02,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:31:02.996681717Z [2024-04-15 03:31:02,996: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:31:05.161536269Z [2024-04-15 03:31:05,160: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[208c1597-6bbe-44de-9142-9a7b58237b4d] succeeded in 4.4736006330003875s: None 2024-04-15T03:31:05.164538708Z [2024-04-15 03:31:05,164: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26491b5e-a700-4ba9-a2de-06112c60cc98] succeeded in 4.473823481999716s: None 2024-04-15T03:32:01.151778852Z [2024-04-15 03:32:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cb3e370-c77c-4e6b-bd9b-21fa8cb4e966] received 2024-04-15T03:32:01.167258888Z [2024-04-15 03:32:01,166: INFO/ForkPoolWorker-15] [2cb3e370-c77c-4e6b-bd9b-21fa8cb4e966] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:32:01.172719417Z [2024-04-15 03:32:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1373ab34-cc3a-478e-af6d-8391808cc51b] received 2024-04-15T03:32:01.194439447Z [2024-04-15 03:32:01,193: INFO/ForkPoolWorker-16] [1373ab34-cc3a-478e-af6d-8391808cc51b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:32:01.202077140Z [2024-04-15 03:32:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0f929ca-d52a-4432-af3e-afe16f7cf6c4] received 2024-04-15T03:32:01.242487028Z [2024-04-15 03:32:01,241: INFO/ForkPoolWorker-1] [c0f929ca-d52a-4432-af3e-afe16f7cf6c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:32:01.535840570Z [2024-04-15 03:32:01,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:32:01.646295626Z [2024-04-15 03:32:01,642: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:32:01.778420090Z [2024-04-15 03:32:01,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:32:01.859920160Z [2024-04-15 03:32:01,833: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:32:02.475204633Z [2024-04-15 03:32:02,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1373ab34-cc3a-478e-af6d-8391808cc51b] succeeded in 1.3004907000004096s: None 2024-04-15T03:32:03.093058208Z [2024-04-15 03:32:03,092: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:32:03.096155085Z [2024-04-15 03:32:03,095: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:32:03.115048205Z [2024-04-15 03:32:03,114: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:32:03.120113818Z [2024-04-15 03:32:03,119: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:32:03.137563054Z [2024-04-15 03:32:03,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:32:03.139786030Z [2024-04-15 03:32:03,139: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:32:03.139894390Z [2024-04-15 03:32:03,139: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:32:03.140122560Z [2024-04-15 03:32:03,139: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:32:03.140224748Z [2024-04-15 03:32:03,140: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:32:03.141049554Z [2024-04-15 03:32:03,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:32:03.141143328Z [2024-04-15 03:32:03,141: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:32:03.149961409Z [2024-04-15 03:32:03,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:32:03.151009035Z [2024-04-15 03:32:03,150: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:32:03.151151349Z [2024-04-15 03:32:03,150: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:32:03.151321871Z [2024-04-15 03:32:03,151: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:32:03.151451502Z [2024-04-15 03:32:03,151: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:32:03.151717856Z [2024-04-15 03:32:03,151: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:32:03.152093104Z [2024-04-15 03:32:03,151: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:32:03.212560592Z [2024-04-15 03:32:03,212: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:32:03.246456428Z [2024-04-15 03:32:03,246: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:32:04.850261776Z [2024-04-15 03:32:04,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cb3e370-c77c-4e6b-bd9b-21fa8cb4e966] succeeded in 3.692338752000069s: None 2024-04-15T03:32:05.228290799Z [2024-04-15 03:32:05,227: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c0f929ca-d52a-4432-af3e-afe16f7cf6c4] succeeded in 4.016903908000131s: None 2024-04-15T03:33:01.172614667Z [2024-04-15 03:33:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c18a8ab1-5f0d-4475-a709-85e6649f89b2] received 2024-04-15T03:33:01.182989968Z [2024-04-15 03:33:01,182: INFO/ForkPoolWorker-15] [c18a8ab1-5f0d-4475-a709-85e6649f89b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:33:01.187668835Z [2024-04-15 03:33:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd76190c-1a4c-4721-81a8-03c65e0d8391] received 2024-04-15T03:33:01.202406050Z [2024-04-15 03:33:01,202: INFO/ForkPoolWorker-16] [fd76190c-1a4c-4721-81a8-03c65e0d8391] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:33:01.521104521Z [2024-04-15 03:33:01,517: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:33:01.551430949Z [2024-04-15 03:33:01,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:33:02.919646999Z [2024-04-15 03:33:02,918: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:33:02.926759667Z [2024-04-15 03:33:02,926: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:33:02.942301680Z [2024-04-15 03:33:02,942: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:33:02.945570222Z [2024-04-15 03:33:02,945: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:33:02.961379329Z [2024-04-15 03:33:02,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:33:02.964027973Z [2024-04-15 03:33:02,963: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:33:02.965393221Z [2024-04-15 03:33:02,965: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:33:02.966895699Z [2024-04-15 03:33:02,966: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:33:02.968151367Z [2024-04-15 03:33:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:33:02.968512420Z [2024-04-15 03:33:02,968: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:33:02.968798996Z [2024-04-15 03:33:02,968: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:33:02.968942096Z [2024-04-15 03:33:02,968: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:33:02.969306257Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:33:02.969387731Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:33:02.969545966Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:33:02.969600036Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:33:02.969963902Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:33:02.970069127Z [2024-04-15 03:33:02,969: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:33:03.036423020Z [2024-04-15 03:33:03,036: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:33:03.045487704Z [2024-04-15 03:33:03,045: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:33:04.888043195Z [2024-04-15 03:33:04,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd76190c-1a4c-4721-81a8-03c65e0d8391] succeeded in 3.6986571380002715s: None 2024-04-15T03:33:05.556286624Z [2024-04-15 03:33:05,555: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c18a8ab1-5f0d-4475-a709-85e6649f89b2] succeeded in 4.379241161000209s: None 2024-04-15T03:34:00.962052760Z [2024-04-15 03:34:00,961: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4330c9a6-b5ea-47ce-aa11-590ec14c8b47] received 2024-04-15T03:34:00.980590536Z [2024-04-15 03:34:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47d7745e-711b-4ea5-bbd2-004d71796d3b] received 2024-04-15T03:34:00.989651419Z [2024-04-15 03:34:00,989: INFO/ForkPoolWorker-15] [4330c9a6-b5ea-47ce-aa11-590ec14c8b47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:34:00.996152462Z [2024-04-15 03:34:00,995: INFO/ForkPoolWorker-16] [47d7745e-711b-4ea5-bbd2-004d71796d3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:34:01.011249868Z [2024-04-15 03:34:01,010: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[682d89c2-049d-4f40-a103-12b9cdf92e66] received 2024-04-15T03:34:01.043843497Z [2024-04-15 03:34:01,043: INFO/ForkPoolWorker-1] [682d89c2-049d-4f40-a103-12b9cdf92e66] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:34:01.327979796Z [2024-04-15 03:34:01,324: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:34:01.490567853Z [2024-04-15 03:34:01,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:34:01.592756083Z [2024-04-15 03:34:01,588: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:34:01.980278018Z [2024-04-15 03:34:01,980: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:34:02.701525578Z [2024-04-15 03:34:02,701: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[682d89c2-049d-4f40-a103-12b9cdf92e66] succeeded in 1.6841018430004624s: None 2024-04-15T03:34:02.952727980Z [2024-04-15 03:34:02,949: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:34:02.953392225Z [2024-04-15 03:34:02,952: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:34:02.980186531Z [2024-04-15 03:34:02,979: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:34:02.981709131Z [2024-04-15 03:34:02,981: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:34:02.982157627Z [2024-04-15 03:34:02,981: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:34:02.982329014Z [2024-04-15 03:34:02,982: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:34:02.982434909Z [2024-04-15 03:34:02,982: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:34:02.982685980Z [2024-04-15 03:34:02,982: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:34:02.983207681Z [2024-04-15 03:34:02,983: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:34:03.086438680Z [2024-04-15 03:34:03,086: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:34:03.130021795Z [2024-04-15 03:34:03,129: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:34:03.133273367Z [2024-04-15 03:34:03,132: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:34:03.173217153Z [2024-04-15 03:34:03,173: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:34:03.174626125Z [2024-04-15 03:34:03,174: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:34:03.174749816Z [2024-04-15 03:34:03,174: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:34:03.174933498Z [2024-04-15 03:34:03,174: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:34:03.175248587Z [2024-04-15 03:34:03,175: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:34:03.175994555Z [2024-04-15 03:34:03,175: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:34:03.176131475Z [2024-04-15 03:34:03,175: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:34:03.267545844Z [2024-04-15 03:34:03,267: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:34:04.782729201Z [2024-04-15 03:34:04,781: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[47d7745e-711b-4ea5-bbd2-004d71796d3b] succeeded in 3.7997233040005085s: None 2024-04-15T03:34:05.574452353Z [2024-04-15 03:34:05,573: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4330c9a6-b5ea-47ce-aa11-590ec14c8b47] succeeded in 4.608519289000469s: None 2024-04-15T03:35:00.923160299Z [2024-04-15 03:35:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad4d5cc5-f9b4-471b-a6f8-4ee629e62e65] received 2024-04-15T03:35:00.931720393Z [2024-04-15 03:35:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ad819e4-91af-4e6a-aa8e-348575fd855b] received 2024-04-15T03:35:00.940582851Z [2024-04-15 03:35:00,940: INFO/ForkPoolWorker-16] [0ad819e4-91af-4e6a-aa8e-348575fd855b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:35:00.944899931Z [2024-04-15 03:35:00,944: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c6c63c4-8c5b-4ba3-9c36-b7c006e80dcf] received 2024-04-15T03:35:00.953063907Z [2024-04-15 03:35:00,952: INFO/ForkPoolWorker-15] [ad4d5cc5-f9b4-471b-a6f8-4ee629e62e65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:00.956201186Z [2024-04-15 03:35:00,955: INFO/ForkPoolWorker-1] [7c6c63c4-8c5b-4ba3-9c36-b7c006e80dcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:35:01.281701536Z [2024-04-15 03:35:01,278: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:35:01.304925320Z [2024-04-15 03:35:01,301: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:35:01.384752346Z [2024-04-15 03:35:01,381: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:35:02.882889897Z [2024-04-15 03:35:02,878: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:35:02.882913651Z [2024-04-15 03:35:02,882: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:02.961850742Z [2024-04-15 03:35:02,960: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:35:02.965991003Z [2024-04-15 03:35:02,962: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:02.966009227Z [2024-04-15 03:35:02,963: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:02.966014643Z [2024-04-15 03:35:02,963: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:02.966019496Z [2024-04-15 03:35:02,963: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:35:02.966022960Z [2024-04-15 03:35:02,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:35:02.966046507Z [2024-04-15 03:35:02,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:03.010639222Z [2024-04-15 03:35:03,010: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:35:03.014959020Z [2024-04-15 03:35:03,014: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:03.048667770Z [2024-04-15 03:35:03,048: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:35:03.052284845Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:03.052299322Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:03.052958076Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:03.052969775Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:35:03.052975239Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:35:03.052978540Z [2024-04-15 03:35:03,052: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:03.062400339Z [2024-04-15 03:35:03,062: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:35:03.065810588Z [2024-04-15 03:35:03,065: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:03.092003437Z [2024-04-15 03:35:03,091: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:35:03.093230905Z [2024-04-15 03:35:03,092: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:03.093257477Z [2024-04-15 03:35:03,093: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:03.093395381Z [2024-04-15 03:35:03,093: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:03.093406846Z [2024-04-15 03:35:03,093: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:35:03.094887644Z [2024-04-15 03:35:03,094: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:35:03.094922576Z [2024-04-15 03:35:03,094: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:03.122966877Z [2024-04-15 03:35:03,122: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:03.172307541Z [2024-04-15 03:35:03,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:03.189421907Z [2024-04-15 03:35:03,189: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:03.679868047Z [2024-04-15 03:35:03,679: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad4d5cc5-f9b4-471b-a6f8-4ee629e62e65] succeeded in 2.753553694999937s: None 2024-04-15T03:35:04.543257596Z [2024-04-15 03:35:04,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55f45611-8ae9-447c-9b24-c7b84175ac6e] received 2024-04-15T03:35:04.570605782Z [2024-04-15 03:35:04,570: INFO/ForkPoolWorker-15] [55f45611-8ae9-447c-9b24-c7b84175ac6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:04.687396585Z [2024-04-15 03:35:04,686: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ad819e4-91af-4e6a-aa8e-348575fd855b] succeeded in 3.7516382690009777s: None 2024-04-15T03:35:04.900076632Z [2024-04-15 03:35:04,896: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:35:05.015458790Z [2024-04-15 03:35:05,015: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7c6c63c4-8c5b-4ba3-9c36-b7c006e80dcf] succeeded in 4.064565347000098s: None 2024-04-15T03:35:05.968207343Z [2024-04-15 03:35:05,967: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:35:05.971294755Z [2024-04-15 03:35:05,970: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:06.017834161Z [2024-04-15 03:35:06,017: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:35:06.019348818Z [2024-04-15 03:35:06,019: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:06.019552797Z [2024-04-15 03:35:06,019: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:06.019862084Z [2024-04-15 03:35:06,019: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:06.020105615Z [2024-04-15 03:35:06,019: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:35:06.020581385Z [2024-04-15 03:35:06,020: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:35:06.020779137Z [2024-04-15 03:35:06,020: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:06.110610012Z [2024-04-15 03:35:06,110: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:06.855290352Z [2024-04-15 03:35:06,854: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55f45611-8ae9-447c-9b24-c7b84175ac6e] succeeded in 2.307292018998851s: None 2024-04-15T03:35:07.011955477Z [2024-04-15 03:35:07,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1275a905-5d5c-4be6-bc73-4f226d932763] received 2024-04-15T03:35:07.020981940Z [2024-04-15 03:35:07,020: INFO/ForkPoolWorker-15] [1275a905-5d5c-4be6-bc73-4f226d932763] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:35:07.283235552Z [2024-04-15 03:35:07,280: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:35:08.256008910Z [2024-04-15 03:35:08,255: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:35:08.258906244Z [2024-04-15 03:35:08,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:08.288626986Z [2024-04-15 03:35:08,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:35:08.290324543Z [2024-04-15 03:35:08,289: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:08.290468845Z [2024-04-15 03:35:08,290: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:08.290687890Z [2024-04-15 03:35:08,290: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:08.290749902Z [2024-04-15 03:35:08,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:35:08.291431922Z [2024-04-15 03:35:08,291: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:35:08.291499316Z [2024-04-15 03:35:08,291: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:08.379636876Z [2024-04-15 03:35:08,379: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:09.763870596Z [2024-04-15 03:35:09,763: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1275a905-5d5c-4be6-bc73-4f226d932763] succeeded in 2.7492128829999274s: None 2024-04-15T03:35:09.814950980Z [2024-04-15 03:35:09,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25d26ec7-74d7-4a3b-a695-fb5b6bdb2fab] received 2024-04-15T03:35:09.851359646Z [2024-04-15 03:35:09,851: INFO/ForkPoolWorker-15] [25d26ec7-74d7-4a3b-a695-fb5b6bdb2fab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:35:10.202462142Z [2024-04-15 03:35:10,199: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:35:11.322519105Z [2024-04-15 03:35:11,322: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:35:11.325692819Z [2024-04-15 03:35:11,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:35:11.360260792Z [2024-04-15 03:35:11,360: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:35:11.363726739Z [2024-04-15 03:35:11,363: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:35:11.363739468Z [2024-04-15 03:35:11,363: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:35:11.363971314Z [2024-04-15 03:35:11,363: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:35:11.364132597Z [2024-04-15 03:35:11,363: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:35:11.364443847Z [2024-04-15 03:35:11,364: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:35:11.364453995Z [2024-04-15 03:35:11,364: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:35:11.444448280Z [2024-04-15 03:35:11,444: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:35:12.068614486Z [2024-04-15 03:35:12,067: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25d26ec7-74d7-4a3b-a695-fb5b6bdb2fab] succeeded in 2.2493586119999236s: None 2024-04-15T03:36:00.479507341Z [2024-04-15 03:36:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c1def4d-93a5-4c84-8551-9a70dc6a5646] received 2024-04-15T03:36:00.493190122Z [2024-04-15 03:36:00,492: INFO/ForkPoolWorker-15] [7c1def4d-93a5-4c84-8551-9a70dc6a5646] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:36:00.503961801Z [2024-04-15 03:36:00,503: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a55d04e-17df-4bdc-9f14-5fff1445642e] received 2024-04-15T03:36:00.513863129Z [2024-04-15 03:36:00,513: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60703e43-5350-4fad-b0b5-dd381bbab8ad] received 2024-04-15T03:36:00.518844799Z [2024-04-15 03:36:00,518: INFO/ForkPoolWorker-16] [2a55d04e-17df-4bdc-9f14-5fff1445642e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:36:00.525756196Z [2024-04-15 03:36:00,525: INFO/ForkPoolWorker-1] [60703e43-5350-4fad-b0b5-dd381bbab8ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:36:00.766914921Z [2024-04-15 03:36:00,764: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:36:00.794882903Z [2024-04-15 03:36:00,792: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:36:00.927326255Z [2024-04-15 03:36:00,918: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:36:01.031443194Z [2024-04-15 03:36:01,031: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:36:01.584284845Z [2024-04-15 03:36:01,583: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c1def4d-93a5-4c84-8551-9a70dc6a5646] succeeded in 1.1026621460005117s: None 2024-04-15T03:36:02.471388692Z [2024-04-15 03:36:02,471: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:36:02.475742726Z [2024-04-15 03:36:02,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:36:02.508342683Z [2024-04-15 03:36:02,508: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:36:02.509394794Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:36:02.509410925Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:36:02.509529771Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:36:02.509564140Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:36:02.509808132Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:36:02.510177128Z [2024-04-15 03:36:02,509: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:36:02.553044441Z [2024-04-15 03:36:02,552: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:36:02.556211409Z [2024-04-15 03:36:02,555: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:36:02.601507368Z [2024-04-15 03:36:02,600: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:36:02.602022177Z [2024-04-15 03:36:02,601: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:36:02.602089441Z [2024-04-15 03:36:02,601: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:36:02.602240426Z [2024-04-15 03:36:02,602: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:36:02.602326564Z [2024-04-15 03:36:02,602: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:36:02.602689952Z [2024-04-15 03:36:02,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:36:02.602695705Z [2024-04-15 03:36:02,602: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:36:02.618128052Z [2024-04-15 03:36:02,614: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:36:02.719909987Z [2024-04-15 03:36:02,719: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:36:04.393537288Z [2024-04-15 03:36:04,392: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2a55d04e-17df-4bdc-9f14-5fff1445642e] succeeded in 3.8863095760007127s: None 2024-04-15T03:36:05.466399731Z [2024-04-15 03:36:05,465: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60703e43-5350-4fad-b0b5-dd381bbab8ad] succeeded in 4.948697259000255s: None 2024-04-15T03:36:42.436665259Z [2024-04-15 03:36:42,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c37e6d8-accc-448e-9f44-d519dbcd05c9] received 2024-04-15T03:36:42.449689537Z [2024-04-15 03:36:42,449: INFO/ForkPoolWorker-15] [3c37e6d8-accc-448e-9f44-d519dbcd05c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415033641_174613', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T03:36:42.740349391Z [2024-04-15 03:36:42,736: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-15T03:36:43.037490725Z [2024-04-15 03:36:43,037: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:36:43.712384643Z [2024-04-15 03:36:43,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c37e6d8-accc-448e-9f44-d519dbcd05c9] succeeded in 1.2728698430000804s: None 2024-04-15T03:37:00.919803131Z [2024-04-15 03:37:00,919: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[377d653b-06eb-479c-992f-810e0eaee2a9] received 2024-04-15T03:37:00.923206029Z [2024-04-15 03:37:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d70401a-3327-4549-bdfa-82759cdd4019] received 2024-04-15T03:37:00.944946013Z [2024-04-15 03:37:00,944: INFO/ForkPoolWorker-16] [4d70401a-3327-4549-bdfa-82759cdd4019] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:37:00.950813696Z [2024-04-15 03:37:00,950: INFO/ForkPoolWorker-15] [377d653b-06eb-479c-992f-810e0eaee2a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:37:01.255997959Z [2024-04-15 03:37:01,252: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:37:01.331737972Z [2024-04-15 03:37:01,328: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:37:02.432112919Z [2024-04-15 03:37:02,431: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:37:02.435592341Z [2024-04-15 03:37:02,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:37:02.466473219Z [2024-04-15 03:37:02,466: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:37:02.468531102Z [2024-04-15 03:37:02,468: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:37:02.468569309Z [2024-04-15 03:37:02,468: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:37:02.470026522Z [2024-04-15 03:37:02,469: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:37:02.470042425Z [2024-04-15 03:37:02,469: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:37:02.470304694Z [2024-04-15 03:37:02,470: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:37:02.470315471Z [2024-04-15 03:37:02,470: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:37:02.595618218Z [2024-04-15 03:37:02,595: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:37:03.000355185Z [2024-04-15 03:37:02,999: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:37:03.008016450Z [2024-04-15 03:37:03,007: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:37:03.042001620Z [2024-04-15 03:37:03,041: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:37:03.043298953Z [2024-04-15 03:37:03,043: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:37:03.043454717Z [2024-04-15 03:37:03,043: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:37:03.043594693Z [2024-04-15 03:37:03,043: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:37:03.043768672Z [2024-04-15 03:37:03,043: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:37:03.044218202Z [2024-04-15 03:37:03,044: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:37:03.044312897Z [2024-04-15 03:37:03,044: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:37:03.127687103Z [2024-04-15 03:37:03,127: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:37:04.818269927Z [2024-04-15 03:37:04,816: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[377d653b-06eb-479c-992f-810e0eaee2a9] succeeded in 3.8921615869985544s: None 2024-04-15T03:37:05.382318160Z [2024-04-15 03:37:05,381: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d70401a-3327-4549-bdfa-82759cdd4019] succeeded in 4.453219655000794s: None 2024-04-15T03:38:00.269582413Z [2024-04-15 03:38:00,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9109936-94bf-49ac-81c9-5e4dbae86b51] received 2024-04-15T03:38:00.278747085Z [2024-04-15 03:38:00,278: INFO/ForkPoolWorker-15] [c9109936-94bf-49ac-81c9-5e4dbae86b51] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:38:00.282501743Z [2024-04-15 03:38:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94f7e0d5-a07a-474c-9eb7-0fe05d0a7938] received 2024-04-15T03:38:00.288323000Z [2024-04-15 03:38:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0874b0ad-932f-4af3-a341-effe5dadef43] received 2024-04-15T03:38:00.289176044Z [2024-04-15 03:38:00,288: INFO/ForkPoolWorker-16] [94f7e0d5-a07a-474c-9eb7-0fe05d0a7938] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:38:00.307278633Z [2024-04-15 03:38:00,306: INFO/ForkPoolWorker-1] [0874b0ad-932f-4af3-a341-effe5dadef43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:38:00.554911898Z [2024-04-15 03:38:00,551: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:38:00.560584106Z [2024-04-15 03:38:00,557: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:38:00.664167892Z [2024-04-15 03:38:00,660: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:38:00.814440493Z [2024-04-15 03:38:00,810: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:38:01.479924739Z [2024-04-15 03:38:01,479: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9109936-94bf-49ac-81c9-5e4dbae86b51] succeeded in 1.2086314640000637s: None 2024-04-15T03:38:01.909974587Z [2024-04-15 03:38:01,901: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:38:01.909997111Z [2024-04-15 03:38:01,907: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:38:01.996787434Z [2024-04-15 03:38:01,996: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:38:01.999013040Z [2024-04-15 03:38:01,998: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:38:01.999524837Z [2024-04-15 03:38:01,999: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:38:02.000715327Z [2024-04-15 03:38:01,999: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:38:02.000727493Z [2024-04-15 03:38:01,999: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:38:02.000731991Z [2024-04-15 03:38:02,000: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:38:02.000739660Z [2024-04-15 03:38:02,000: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:38:02.096723061Z [2024-04-15 03:38:02,096: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:38:02.524076263Z [2024-04-15 03:38:02,523: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:38:02.529101305Z [2024-04-15 03:38:02,528: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:38:02.653979443Z [2024-04-15 03:38:02,653: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:38:02.656078797Z [2024-04-15 03:38:02,655: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:38:02.656095982Z [2024-04-15 03:38:02,656: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:38:02.656190129Z [2024-04-15 03:38:02,656: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:38:02.656223756Z [2024-04-15 03:38:02,656: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:38:02.656471187Z [2024-04-15 03:38:02,656: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:38:02.656508734Z [2024-04-15 03:38:02,656: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:38:02.737646945Z [2024-04-15 03:38:02,737: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:38:03.735761276Z [2024-04-15 03:38:03,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94f7e0d5-a07a-474c-9eb7-0fe05d0a7938] succeeded in 3.4514867450016027s: None 2024-04-15T03:38:05.056283544Z [2024-04-15 03:38:05,055: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0874b0ad-932f-4af3-a341-effe5dadef43] succeeded in 4.763213493000876s: None 2024-04-15T03:39:00.670595184Z [2024-04-15 03:39:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34f694a9-a051-4107-b647-b8585a39e209] received 2024-04-15T03:39:00.674840724Z [2024-04-15 03:39:00,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2987b33-71d6-42ab-964d-ec6be8d05f05] received 2024-04-15T03:39:00.688127142Z [2024-04-15 03:39:00,685: INFO/ForkPoolWorker-16] [f2987b33-71d6-42ab-964d-ec6be8d05f05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:39:00.691933684Z [2024-04-15 03:39:00,691: INFO/ForkPoolWorker-15] [34f694a9-a051-4107-b647-b8585a39e209] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:39:01.105290910Z [2024-04-15 03:39:01,100: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:39:01.316011393Z [2024-04-15 03:39:01,313: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:39:02.466182176Z [2024-04-15 03:39:02,465: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:39:02.469317012Z [2024-04-15 03:39:02,468: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:39:02.538042048Z [2024-04-15 03:39:02,532: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:39:02.538060069Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:39:02.538064918Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:39:02.538069750Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:39:02.538086980Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:39:02.538090300Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:39:02.538093871Z [2024-04-15 03:39:02,534: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:39:02.622956891Z [2024-04-15 03:39:02,622: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:39:03.176038138Z [2024-04-15 03:39:03,175: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:39:03.179348545Z [2024-04-15 03:39:03,178: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:39:03.206669237Z [2024-04-15 03:39:03,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:39:03.207875450Z [2024-04-15 03:39:03,207: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:39:03.207933474Z [2024-04-15 03:39:03,207: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:39:03.208079332Z [2024-04-15 03:39:03,207: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:39:03.208155874Z [2024-04-15 03:39:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:39:03.208365067Z [2024-04-15 03:39:03,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:39:03.208472417Z [2024-04-15 03:39:03,208: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:39:03.287400462Z [2024-04-15 03:39:03,286: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:39:05.271253498Z [2024-04-15 03:39:05,270: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f2987b33-71d6-42ab-964d-ec6be8d05f05] succeeded in 4.5947838020001655s: None 2024-04-15T03:39:05.383117703Z [2024-04-15 03:39:05,382: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[34f694a9-a051-4107-b647-b8585a39e209] succeeded in 4.709620432999145s: None 2024-04-15T03:40:01.128997782Z [2024-04-15 03:40:01,127: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d93da00-74b3-43b2-b585-3b16b83d9048] received 2024-04-15T03:40:01.130191757Z [2024-04-15 03:40:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08fec16a-968b-4850-a316-c4f41fa6a1d1] received 2024-04-15T03:40:01.145340859Z [2024-04-15 03:40:01,144: INFO/ForkPoolWorker-15] [3d93da00-74b3-43b2-b585-3b16b83d9048] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:40:01.155299753Z [2024-04-15 03:40:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd56c2d6-764a-467a-b189-10307e0c5c55] received 2024-04-15T03:40:01.156873600Z [2024-04-15 03:40:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6a615ad-8191-4530-95ad-68b0d11892af] received 2024-04-15T03:40:01.170040546Z [2024-04-15 03:40:01,169: INFO/ForkPoolWorker-2] [a6a615ad-8191-4530-95ad-68b0d11892af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:40:01.178837923Z [2024-04-15 03:40:01,178: INFO/ForkPoolWorker-16] [08fec16a-968b-4850-a316-c4f41fa6a1d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:40:01.214275143Z [2024-04-15 03:40:01,213: INFO/ForkPoolWorker-1] [dd56c2d6-764a-467a-b189-10307e0c5c55] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:01.440833873Z [2024-04-15 03:40:01,436: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:40:01.584665986Z [2024-04-15 03:40:01,578: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:40:01.602464447Z [2024-04-15 03:40:01,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:40:01.834278238Z [2024-04-15 03:40:01,823: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:40:02.836967400Z [2024-04-15 03:40:02,836: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:03.603297458Z [2024-04-15 03:40:03,602: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a6a615ad-8191-4530-95ad-68b0d11892af] succeeded in 2.4435931610005355s: None 2024-04-15T03:40:04.150627213Z [2024-04-15 03:40:04,150: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:40:04.156193373Z [2024-04-15 03:40:04,155: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:04.224668993Z [2024-04-15 03:40:04,224: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:40:04.226843578Z [2024-04-15 03:40:04,226: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:04.226860967Z [2024-04-15 03:40:04,226: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:04.227058268Z [2024-04-15 03:40:04,226: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:04.227114412Z [2024-04-15 03:40:04,227: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:40:04.227900384Z [2024-04-15 03:40:04,227: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:40:04.227977877Z [2024-04-15 03:40:04,227: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:04.346751092Z [2024-04-15 03:40:04,346: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:04.642370171Z [2024-04-15 03:40:04,641: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:40:04.647340172Z [2024-04-15 03:40:04,646: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:04.703400237Z [2024-04-15 03:40:04,703: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:40:04.710486017Z [2024-04-15 03:40:04,710: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:04.710731935Z [2024-04-15 03:40:04,710: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:04.710931656Z [2024-04-15 03:40:04,710: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:04.711051406Z [2024-04-15 03:40:04,710: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:40:04.711374743Z [2024-04-15 03:40:04,711: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:40:04.711565078Z [2024-04-15 03:40:04,711: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:04.823647812Z [2024-04-15 03:40:04,823: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:04.861431046Z [2024-04-15 03:40:04,861: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:40:04.866045233Z [2024-04-15 03:40:04,865: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:04.891090370Z [2024-04-15 03:40:04,890: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:40:04.891990054Z [2024-04-15 03:40:04,891: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:04.892005094Z [2024-04-15 03:40:04,891: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:04.892145719Z [2024-04-15 03:40:04,891: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:04.892193228Z [2024-04-15 03:40:04,892: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:40:04.892396506Z [2024-04-15 03:40:04,892: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:40:04.892442958Z [2024-04-15 03:40:04,892: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:04.987098230Z [2024-04-15 03:40:04,986: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:05.045114359Z [2024-04-15 03:40:05,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dd56c2d6-764a-467a-b189-10307e0c5c55] succeeded in 3.88206480000008s: None 2024-04-15T03:40:05.752363967Z [2024-04-15 03:40:05,752: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfde1c36-50c8-44d0-b564-a152c45d89ab] received 2024-04-15T03:40:05.761666963Z [2024-04-15 03:40:05,761: INFO/ForkPoolWorker-1] [bfde1c36-50c8-44d0-b564-a152c45d89ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:06.060724173Z [2024-04-15 03:40:06,057: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:40:06.504609480Z [2024-04-15 03:40:06,504: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d93da00-74b3-43b2-b585-3b16b83d9048] succeeded in 5.37086175299919s: None 2024-04-15T03:40:06.641607430Z [2024-04-15 03:40:06,641: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[08fec16a-968b-4850-a316-c4f41fa6a1d1] succeeded in 5.501711340999464s: None 2024-04-15T03:40:07.207560033Z [2024-04-15 03:40:07,206: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:40:07.210369017Z [2024-04-15 03:40:07,210: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:07.237671127Z [2024-04-15 03:40:07,237: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:40:07.239404855Z [2024-04-15 03:40:07,239: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:07.239556166Z [2024-04-15 03:40:07,239: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:07.239732049Z [2024-04-15 03:40:07,239: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:07.239871988Z [2024-04-15 03:40:07,239: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:40:07.240614779Z [2024-04-15 03:40:07,240: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:40:07.240808386Z [2024-04-15 03:40:07,240: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:07.319050338Z [2024-04-15 03:40:07,318: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:08.009091099Z [2024-04-15 03:40:08,008: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bfde1c36-50c8-44d0-b564-a152c45d89ab] succeeded in 2.253634032998889s: None 2024-04-15T03:40:08.182149642Z [2024-04-15 03:40:08,181: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2d7cf02b-e5a5-4186-b4f4-9e941e99a364] received 2024-04-15T03:40:08.199231442Z [2024-04-15 03:40:08,198: INFO/ForkPoolWorker-15] [2d7cf02b-e5a5-4186-b4f4-9e941e99a364] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:40:08.495924311Z [2024-04-15 03:40:08,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:40:09.546800309Z [2024-04-15 03:40:09,546: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:40:09.549711806Z [2024-04-15 03:40:09,549: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:09.571613460Z [2024-04-15 03:40:09,571: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:40:09.572402190Z [2024-04-15 03:40:09,572: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:09.572439202Z [2024-04-15 03:40:09,572: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:09.572618737Z [2024-04-15 03:40:09,572: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:09.572673856Z [2024-04-15 03:40:09,572: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:40:09.573134636Z [2024-04-15 03:40:09,573: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:40:09.573167326Z [2024-04-15 03:40:09,573: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:09.673617368Z [2024-04-15 03:40:09,673: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:10.186415198Z [2024-04-15 03:40:10,185: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2d7cf02b-e5a5-4186-b4f4-9e941e99a364] succeeded in 2.001020662000883s: None 2024-04-15T03:40:11.074895748Z [2024-04-15 03:40:11,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b0b2536-f2d2-4943-ae29-56a46606f4f6] received 2024-04-15T03:40:11.086064962Z [2024-04-15 03:40:11,085: INFO/ForkPoolWorker-15] [0b0b2536-f2d2-4943-ae29-56a46606f4f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:40:11.372875836Z [2024-04-15 03:40:11,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:40:12.447910062Z [2024-04-15 03:40:12,447: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:40:12.450840373Z [2024-04-15 03:40:12,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:40:12.490320806Z [2024-04-15 03:40:12,490: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:40:12.491974467Z [2024-04-15 03:40:12,491: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:40:12.492066264Z [2024-04-15 03:40:12,491: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:40:12.492290842Z [2024-04-15 03:40:12,492: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:40:12.492347174Z [2024-04-15 03:40:12,492: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:40:12.492683374Z [2024-04-15 03:40:12,492: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:40:12.492745697Z [2024-04-15 03:40:12,492: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:40:12.592536774Z [2024-04-15 03:40:12,592: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:13.229258287Z [2024-04-15 03:40:13,228: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b0b2536-f2d2-4943-ae29-56a46606f4f6] succeeded in 2.148651440998947s: None 2024-04-15T03:40:42.606919165Z [2024-04-15 03:40:42,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[423c6d07-1e3b-4219-900d-50788becd4b9] received 2024-04-15T03:40:42.618118135Z [2024-04-15 03:40:42,617: INFO/ForkPoolWorker-15] [423c6d07-1e3b-4219-900d-50788becd4b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240415034041_721035', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py'] 2024-04-15T03:40:42.896120639Z [2024-04-15 03:40:42,883: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py 2024-04-15T03:40:43.128210373Z [2024-04-15 03:40:43,127: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:40:43.798834571Z [2024-04-15 03:40:43,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[423c6d07-1e3b-4219-900d-50788becd4b9] succeeded in 1.1900857649998215s: None 2024-04-15T03:41:00.429192044Z [2024-04-15 03:41:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[084eba4d-5a9f-44c8-90ff-d76b59d59219] received 2024-04-15T03:41:00.433482164Z [2024-04-15 03:41:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d46be58-f59f-46e4-9585-d997ce121915] received 2024-04-15T03:41:00.436017802Z [2024-04-15 03:41:00,435: INFO/ForkPoolWorker-15] [084eba4d-5a9f-44c8-90ff-d76b59d59219] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:41:00.443923865Z [2024-04-15 03:41:00,443: INFO/ForkPoolWorker-16] [1d46be58-f59f-46e4-9585-d997ce121915] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:41:00.701051758Z [2024-04-15 03:41:00,698: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:41:00.736776749Z [2024-04-15 03:41:00,732: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:41:01.875515697Z [2024-04-15 03:41:01,874: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:41:01.884133296Z [2024-04-15 03:41:01,881: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:41:01.940377848Z [2024-04-15 03:41:01,940: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:41:01.941480618Z [2024-04-15 03:41:01,941: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:41:01.941856824Z [2024-04-15 03:41:01,941: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:41:01.942035159Z [2024-04-15 03:41:01,941: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:41:01.943486504Z [2024-04-15 03:41:01,942: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:41:01.943498626Z [2024-04-15 03:41:01,942: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:41:01.943501992Z [2024-04-15 03:41:01,942: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:41:02.072069094Z [2024-04-15 03:41:02,071: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:41:02.159830999Z [2024-04-15 03:41:02,159: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:41:02.168455908Z [2024-04-15 03:41:02,168: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:41:02.210229048Z [2024-04-15 03:41:02,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:41:02.212714298Z [2024-04-15 03:41:02,212: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:41:02.212995141Z [2024-04-15 03:41:02,212: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:41:02.213146599Z [2024-04-15 03:41:02,212: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:41:02.213228656Z [2024-04-15 03:41:02,213: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:41:02.213464648Z [2024-04-15 03:41:02,213: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:41:02.213636700Z [2024-04-15 03:41:02,213: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:41:02.297124833Z [2024-04-15 03:41:02,296: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:41:03.533055409Z [2024-04-15 03:41:03,532: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[084eba4d-5a9f-44c8-90ff-d76b59d59219] succeeded in 3.101295573000243s: None 2024-04-15T03:41:05.150056206Z [2024-04-15 03:41:05,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d46be58-f59f-46e4-9585-d997ce121915] succeeded in 4.714238626000224s: None 2024-04-15T03:42:00.759823930Z [2024-04-15 03:42:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd3b36ba-89ef-4583-9100-2a4ff1e838f7] received 2024-04-15T03:42:00.766775943Z [2024-04-15 03:42:00,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0c2279e-a05f-4990-9e4c-03b957782c2c] received 2024-04-15T03:42:00.766916606Z [2024-04-15 03:42:00,766: INFO/ForkPoolWorker-15] [bd3b36ba-89ef-4583-9100-2a4ff1e838f7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:42:00.772124054Z [2024-04-15 03:42:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[519dee62-4f4a-495a-8869-e1affa2357be] received 2024-04-15T03:42:00.775986358Z [2024-04-15 03:42:00,775: INFO/ForkPoolWorker-16] [a0c2279e-a05f-4990-9e4c-03b957782c2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:42:00.795965079Z [2024-04-15 03:42:00,790: INFO/ForkPoolWorker-1] [519dee62-4f4a-495a-8869-e1affa2357be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:42:01.095697678Z [2024-04-15 03:42:01,088: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:42:01.289633470Z [2024-04-15 03:42:01,278: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:42:01.388368651Z [2024-04-15 03:42:01,368: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:42:01.483867366Z [2024-04-15 03:42:01,483: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:42:02.455008593Z [2024-04-15 03:42:02,454: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bd3b36ba-89ef-4583-9100-2a4ff1e838f7] succeeded in 1.6934693420007534s: None 2024-04-15T03:42:03.063808011Z [2024-04-15 03:42:03,063: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:42:03.066934023Z [2024-04-15 03:42:03,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:42:03.098097347Z [2024-04-15 03:42:03,097: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:42:03.099833304Z [2024-04-15 03:42:03,099: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:42:03.100015952Z [2024-04-15 03:42:03,099: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:42:03.100304969Z [2024-04-15 03:42:03,099: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:42:03.100460053Z [2024-04-15 03:42:03,100: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:42:03.102309119Z [2024-04-15 03:42:03,102: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:42:03.102323258Z [2024-04-15 03:42:03,102: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:42:03.165211832Z [2024-04-15 03:42:03,164: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:42:03.169928327Z [2024-04-15 03:42:03,169: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:42:03.194014680Z [2024-04-15 03:42:03,192: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:42:03.203374156Z [2024-04-15 03:42:03,203: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:42:03.210883548Z [2024-04-15 03:42:03,210: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:42:03.210987182Z [2024-04-15 03:42:03,210: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:42:03.211199450Z [2024-04-15 03:42:03,210: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:42:03.211317108Z [2024-04-15 03:42:03,211: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:42:03.211729347Z [2024-04-15 03:42:03,211: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:42:03.211820527Z [2024-04-15 03:42:03,211: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:42:03.296958188Z [2024-04-15 03:42:03,296: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:42:04.740153240Z [2024-04-15 03:42:04,739: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0c2279e-a05f-4990-9e4c-03b957782c2c] succeeded in 3.9717841479996423s: None 2024-04-15T03:42:05.378885453Z [2024-04-15 03:42:05,378: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[519dee62-4f4a-495a-8869-e1affa2357be] succeeded in 4.603184065001187s: None 2024-04-15T03:43:00.636923548Z [2024-04-15 03:43:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[516ee86f-ba1a-4274-bf5f-b8a4894b801e] received 2024-04-15T03:43:00.642138470Z [2024-04-15 03:43:00,641: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[017a033b-3d94-44d3-b806-047df5ddabd7] received 2024-04-15T03:43:00.660030309Z [2024-04-15 03:43:00,659: INFO/ForkPoolWorker-15] [516ee86f-ba1a-4274-bf5f-b8a4894b801e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:43:00.660783191Z [2024-04-15 03:43:00,660: INFO/ForkPoolWorker-16] [017a033b-3d94-44d3-b806-047df5ddabd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:43:00.961590605Z [2024-04-15 03:43:00,958: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:43:00.992326496Z [2024-04-15 03:43:00,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:43:02.343540715Z [2024-04-15 03:43:02,343: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:43:02.347531051Z [2024-04-15 03:43:02,347: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:43:02.381873922Z [2024-04-15 03:43:02,381: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:43:02.383322575Z [2024-04-15 03:43:02,383: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:43:02.383432803Z [2024-04-15 03:43:02,383: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:43:02.383608449Z [2024-04-15 03:43:02,383: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:43:02.383727726Z [2024-04-15 03:43:02,383: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:43:02.385417708Z [2024-04-15 03:43:02,385: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:43:02.385561401Z [2024-04-15 03:43:02,385: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:43:02.445971398Z [2024-04-15 03:43:02,445: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:43:02.448983058Z [2024-04-15 03:43:02,448: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:43:02.470501326Z [2024-04-15 03:43:02,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:43:02.472047155Z [2024-04-15 03:43:02,471: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:43:02.473539610Z [2024-04-15 03:43:02,473: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:43:02.473699558Z [2024-04-15 03:43:02,473: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:43:02.473812763Z [2024-04-15 03:43:02,473: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:43:02.474103006Z [2024-04-15 03:43:02,473: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:43:02.474565225Z [2024-04-15 03:43:02,474: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:43:02.489693047Z [2024-04-15 03:43:02,489: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:43:02.553345101Z [2024-04-15 03:43:02,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:43:04.128042135Z [2024-04-15 03:43:04,122: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[516ee86f-ba1a-4274-bf5f-b8a4894b801e] succeeded in 3.4797963949986297s: None 2024-04-15T03:43:04.422246890Z [2024-04-15 03:43:04,421: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[017a033b-3d94-44d3-b806-047df5ddabd7] succeeded in 3.7757069939998473s: None 2024-04-15T03:44:00.517158220Z [2024-04-15 03:44:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[28776e17-a5a7-458f-a848-9df4792a3f67] received 2024-04-15T03:44:00.523147783Z [2024-04-15 03:44:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2907d45-e679-4000-8d4d-56894528c1f1] received 2024-04-15T03:44:00.524643072Z [2024-04-15 03:44:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fc46e8d-660d-473f-bb25-f5873ac55e9f] received 2024-04-15T03:44:00.525546287Z [2024-04-15 03:44:00,525: INFO/ForkPoolWorker-15] [28776e17-a5a7-458f-a848-9df4792a3f67] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:44:00.543100864Z [2024-04-15 03:44:00,542: INFO/ForkPoolWorker-16] [a2907d45-e679-4000-8d4d-56894528c1f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:44:00.548863704Z [2024-04-15 03:44:00,548: INFO/ForkPoolWorker-1] [2fc46e8d-660d-473f-bb25-f5873ac55e9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:44:00.830394278Z [2024-04-15 03:44:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:44:00.837545316Z [2024-04-15 03:44:00,830: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:44:00.909171746Z [2024-04-15 03:44:00,901: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:44:01.112341003Z [2024-04-15 03:44:01,112: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:44:01.981070229Z [2024-04-15 03:44:01,979: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[28776e17-a5a7-458f-a848-9df4792a3f67] succeeded in 1.4610921269995742s: None 2024-04-15T03:44:02.261455712Z [2024-04-15 03:44:02,261: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:44:02.264637110Z [2024-04-15 03:44:02,264: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:44:02.303830990Z [2024-04-15 03:44:02,303: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:44:02.306290577Z [2024-04-15 03:44:02,305: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:44:02.306381514Z [2024-04-15 03:44:02,306: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:44:02.306496741Z [2024-04-15 03:44:02,306: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:44:02.306505964Z [2024-04-15 03:44:02,306: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:44:02.314240845Z [2024-04-15 03:44:02,307: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:44:02.314563500Z [2024-04-15 03:44:02,314: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:44:02.432470219Z [2024-04-15 03:44:02,432: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:44:02.492071072Z [2024-04-15 03:44:02,491: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:44:02.495213885Z [2024-04-15 03:44:02,494: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:44:02.515496667Z [2024-04-15 03:44:02,515: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:44:02.517032233Z [2024-04-15 03:44:02,516: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:44:02.517159116Z [2024-04-15 03:44:02,516: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:44:02.517366290Z [2024-04-15 03:44:02,517: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:44:02.517489022Z [2024-04-15 03:44:02,517: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:44:02.517781210Z [2024-04-15 03:44:02,517: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:44:02.517965497Z [2024-04-15 03:44:02,517: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:44:02.592589113Z [2024-04-15 03:44:02,592: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:44:04.217119263Z [2024-04-15 03:44:04,216: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fc46e8d-660d-473f-bb25-f5873ac55e9f] succeeded in 3.6852622299993527s: None 2024-04-15T03:44:04.637478312Z [2024-04-15 03:44:04,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a2907d45-e679-4000-8d4d-56894528c1f1] succeeded in 4.109586046999539s: None 2024-04-15T03:45:00.435636705Z [2024-04-15 03:45:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c34d3e91-11af-4f1f-ac8c-a6775d0b5138] received 2024-04-15T03:45:00.438067563Z [2024-04-15 03:45:00,437: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c1923be-46a5-4669-b155-cfdf90d969c3] received 2024-04-15T03:45:00.445192715Z [2024-04-15 03:45:00,444: INFO/ForkPoolWorker-15] [c34d3e91-11af-4f1f-ac8c-a6775d0b5138] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:45:00.447809488Z [2024-04-15 03:45:00,447: INFO/ForkPoolWorker-16] [7c1923be-46a5-4669-b155-cfdf90d969c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:00.454614855Z [2024-04-15 03:45:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79464445-1199-40b6-9f12-19b086bcd0fd] received 2024-04-15T03:45:00.465466931Z [2024-04-15 03:45:00,465: INFO/ForkPoolWorker-1] [79464445-1199-40b6-9f12-19b086bcd0fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:45:00.771330838Z [2024-04-15 03:45:00,764: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:45:00.830124859Z [2024-04-15 03:45:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:45:00.866023011Z [2024-04-15 03:45:00,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:45:02.694734118Z [2024-04-15 03:45:02,694: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:45:02.698474702Z [2024-04-15 03:45:02,698: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:02.728086908Z [2024-04-15 03:45:02,727: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:45:02.729596629Z [2024-04-15 03:45:02,729: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:02.729623569Z [2024-04-15 03:45:02,729: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:02.729768004Z [2024-04-15 03:45:02,729: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:02.729803524Z [2024-04-15 03:45:02,729: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:45:02.730372703Z [2024-04-15 03:45:02,730: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:45:02.730414244Z [2024-04-15 03:45:02,730: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:02.814103487Z [2024-04-15 03:45:02,809: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:03.031944299Z [2024-04-15 03:45:03,031: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:45:03.035075471Z [2024-04-15 03:45:03,034: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:03.065642340Z [2024-04-15 03:45:03,065: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:45:03.067381442Z [2024-04-15 03:45:03,067: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:03.067561698Z [2024-04-15 03:45:03,067: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:03.067719007Z [2024-04-15 03:45:03,067: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:03.067793352Z [2024-04-15 03:45:03,067: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:45:03.068171343Z [2024-04-15 03:45:03,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:45:03.068363657Z [2024-04-15 03:45:03,068: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:03.134088642Z [2024-04-15 03:45:03,133: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:45:03.139303048Z [2024-04-15 03:45:03,138: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:03.168270406Z [2024-04-15 03:45:03,168: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:45:03.170319817Z [2024-04-15 03:45:03,170: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:03.170535413Z [2024-04-15 03:45:03,170: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:03.170791234Z [2024-04-15 03:45:03,170: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:03.171044904Z [2024-04-15 03:45:03,170: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:45:03.171356756Z [2024-04-15 03:45:03,171: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:45:03.171878143Z [2024-04-15 03:45:03,171: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:03.180919922Z [2024-04-15 03:45:03,180: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:03.307737088Z [2024-04-15 03:45:03,307: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:03.472085246Z [2024-04-15 03:45:03,471: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7c1923be-46a5-4669-b155-cfdf90d969c3] succeeded in 3.031135727000219s: None 2024-04-15T03:45:04.285947785Z [2024-04-15 03:45:04,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e86c758-2c02-4595-b01a-28195db7d86c] received 2024-04-15T03:45:04.297305047Z [2024-04-15 03:45:04,297: INFO/ForkPoolWorker-16] [4e86c758-2c02-4595-b01a-28195db7d86c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:04.576519523Z [2024-04-15 03:45:04,573: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:45:04.955625194Z [2024-04-15 03:45:04,955: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79464445-1199-40b6-9f12-19b086bcd0fd] succeeded in 4.498459025999182s: None 2024-04-15T03:45:05.328393549Z [2024-04-15 03:45:05,327: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c34d3e91-11af-4f1f-ac8c-a6775d0b5138] succeeded in 4.890022432000478s: None 2024-04-15T03:45:05.732627390Z [2024-04-15 03:45:05,732: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:45:05.735951645Z [2024-04-15 03:45:05,735: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:05.776256559Z [2024-04-15 03:45:05,775: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:45:05.777707660Z [2024-04-15 03:45:05,777: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:05.777715119Z [2024-04-15 03:45:05,777: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:05.777948452Z [2024-04-15 03:45:05,777: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:05.778041562Z [2024-04-15 03:45:05,777: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:45:05.778391651Z [2024-04-15 03:45:05,778: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:45:05.778397817Z [2024-04-15 03:45:05,778: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:05.877754703Z [2024-04-15 03:45:05,877: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:06.622520923Z [2024-04-15 03:45:06,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4e86c758-2c02-4595-b01a-28195db7d86c] succeeded in 2.330640386999221s: None 2024-04-15T03:45:06.674855324Z [2024-04-15 03:45:06,674: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58484564-f20c-4280-92d6-130b0cb0cb01] received 2024-04-15T03:45:06.685189834Z [2024-04-15 03:45:06,684: INFO/ForkPoolWorker-15] [58484564-f20c-4280-92d6-130b0cb0cb01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:45:06.967900066Z [2024-04-15 03:45:06,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:45:08.004924726Z [2024-04-15 03:45:08,004: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:45:08.008120712Z [2024-04-15 03:45:08,007: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:08.046743876Z [2024-04-15 03:45:08,046: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:45:08.048180045Z [2024-04-15 03:45:08,047: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:08.048336591Z [2024-04-15 03:45:08,048: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:08.048619618Z [2024-04-15 03:45:08,048: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:08.048755400Z [2024-04-15 03:45:08,048: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:45:08.049111153Z [2024-04-15 03:45:08,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:45:08.049353391Z [2024-04-15 03:45:08,049: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:08.153630856Z [2024-04-15 03:45:08,153: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:08.814184257Z [2024-04-15 03:45:08,813: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58484564-f20c-4280-92d6-130b0cb0cb01] succeeded in 2.1361433809997834s: None 2024-04-15T03:45:09.282570185Z [2024-04-15 03:45:09,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5fced27b-6c41-4083-ae82-aff5aa98944d] received 2024-04-15T03:45:09.306667881Z [2024-04-15 03:45:09,306: INFO/ForkPoolWorker-15] [5fced27b-6c41-4083-ae82-aff5aa98944d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:45:09.633950626Z [2024-04-15 03:45:09,630: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:45:10.711956586Z [2024-04-15 03:45:10,711: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:45:10.714895792Z [2024-04-15 03:45:10,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:45:10.753369188Z [2024-04-15 03:45:10,753: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:45:10.755674537Z [2024-04-15 03:45:10,755: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:45:10.755702923Z [2024-04-15 03:45:10,755: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:45:10.757365440Z [2024-04-15 03:45:10,755: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:45:10.757887994Z [2024-04-15 03:45:10,757: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:45:10.758492430Z [2024-04-15 03:45:10,758: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:45:10.758778468Z [2024-04-15 03:45:10,758: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:45:10.845449651Z [2024-04-15 03:45:10,845: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:45:11.314044768Z [2024-04-15 03:45:11,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5fced27b-6c41-4083-ae82-aff5aa98944d] succeeded in 2.0283617050008615s: None 2024-04-15T03:46:00.401017271Z [2024-04-15 03:46:00,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da46c917-ecad-4822-8580-235568a4a8ca] received 2024-04-15T03:46:00.406680899Z [2024-04-15 03:46:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8f5b696-af14-4dfe-a451-18879e0077df] received 2024-04-15T03:46:00.410036218Z [2024-04-15 03:46:00,409: INFO/ForkPoolWorker-15] [da46c917-ecad-4822-8580-235568a4a8ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:46:00.413303665Z [2024-04-15 03:46:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92d448bd-eb77-4958-a0f9-22fd18a8599c] received 2024-04-15T03:46:00.417301402Z [2024-04-15 03:46:00,417: INFO/ForkPoolWorker-16] [f8f5b696-af14-4dfe-a451-18879e0077df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:46:00.424059447Z [2024-04-15 03:46:00,423: INFO/ForkPoolWorker-1] [92d448bd-eb77-4958-a0f9-22fd18a8599c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:46:00.695173149Z [2024-04-15 03:46:00,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:46:00.708869677Z [2024-04-15 03:46:00,705: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:46:00.709496682Z [2024-04-15 03:46:00,706: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:46:00.921414831Z [2024-04-15 03:46:00,921: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:46:01.562426539Z [2024-04-15 03:46:01,561: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da46c917-ecad-4822-8580-235568a4a8ca] succeeded in 1.1587145140001667s: None 2024-04-15T03:46:02.175230831Z [2024-04-15 03:46:02,174: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:46:02.181219466Z [2024-04-15 03:46:02,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:46:02.250731729Z [2024-04-15 03:46:02,250: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:46:02.254751305Z [2024-04-15 03:46:02,254: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:46:02.255058597Z [2024-04-15 03:46:02,254: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:46:02.255279600Z [2024-04-15 03:46:02,255: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:46:02.255422903Z [2024-04-15 03:46:02,255: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:46:02.255763953Z [2024-04-15 03:46:02,255: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:46:02.255952269Z [2024-04-15 03:46:02,255: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:46:02.311326603Z [2024-04-15 03:46:02,310: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:46:02.314719191Z [2024-04-15 03:46:02,314: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:46:02.347363888Z [2024-04-15 03:46:02,347: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:46:02.363275698Z [2024-04-15 03:46:02,363: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:46:02.365850893Z [2024-04-15 03:46:02,365: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:46:02.365865365Z [2024-04-15 03:46:02,365: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:46:02.366193291Z [2024-04-15 03:46:02,365: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:46:02.366254464Z [2024-04-15 03:46:02,366: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:46:02.366541191Z [2024-04-15 03:46:02,366: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:46:02.366582169Z [2024-04-15 03:46:02,366: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:46:02.454641301Z [2024-04-15 03:46:02,454: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:46:03.975059523Z [2024-04-15 03:46:03,974: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[92d448bd-eb77-4958-a0f9-22fd18a8599c] succeeded in 3.5592774050001026s: None 2024-04-15T03:46:04.251463953Z [2024-04-15 03:46:04,250: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f8f5b696-af14-4dfe-a451-18879e0077df] succeeded in 3.841549667999061s: None 2024-04-15T03:47:00.711906010Z [2024-04-15 03:47:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1818d2ae-a204-4bb4-89eb-d767bf31ccc3] received 2024-04-15T03:47:00.714600224Z [2024-04-15 03:47:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90d2d9c6-0a02-4b0e-8286-51c036f5de47] received 2024-04-15T03:47:00.724307984Z [2024-04-15 03:47:00,723: INFO/ForkPoolWorker-15] [1818d2ae-a204-4bb4-89eb-d767bf31ccc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:47:00.729895405Z [2024-04-15 03:47:00,729: INFO/ForkPoolWorker-16] [90d2d9c6-0a02-4b0e-8286-51c036f5de47] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:47:01.042717198Z [2024-04-15 03:47:01,035: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:47:01.058511904Z [2024-04-15 03:47:01,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:47:02.258607261Z [2024-04-15 03:47:02,258: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:47:02.261871558Z [2024-04-15 03:47:02,261: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:47:02.309143574Z [2024-04-15 03:47:02,308: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:47:02.317638002Z [2024-04-15 03:47:02,316: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:47:02.317663538Z [2024-04-15 03:47:02,316: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:47:02.317669093Z [2024-04-15 03:47:02,316: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:47:02.317673915Z [2024-04-15 03:47:02,317: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:47:02.321762964Z [2024-04-15 03:47:02,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:47:02.321788892Z [2024-04-15 03:47:02,320: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:47:02.558612408Z [2024-04-15 03:47:02,558: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:47:02.654423768Z [2024-04-15 03:47:02,654: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:47:02.657751506Z [2024-04-15 03:47:02,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:47:02.700104038Z [2024-04-15 03:47:02,699: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:47:02.701526643Z [2024-04-15 03:47:02,701: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:47:02.701595578Z [2024-04-15 03:47:02,701: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:47:02.701736264Z [2024-04-15 03:47:02,701: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:47:02.701748802Z [2024-04-15 03:47:02,701: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:47:02.703005959Z [2024-04-15 03:47:02,702: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:47:02.703022884Z [2024-04-15 03:47:02,702: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:47:02.805201916Z [2024-04-15 03:47:02,804: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:47:04.166180614Z [2024-04-15 03:47:04,165: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1818d2ae-a204-4bb4-89eb-d767bf31ccc3] succeeded in 3.4497978999988845s: None 2024-04-15T03:47:04.796045625Z [2024-04-15 03:47:04,795: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90d2d9c6-0a02-4b0e-8286-51c036f5de47] succeeded in 4.078982040000483s: None 2024-04-15T03:48:00.844525774Z [2024-04-15 03:48:00,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58641f2a-26f8-47d4-8685-5659c9e22577] received 2024-04-15T03:48:00.860078253Z [2024-04-15 03:48:00,859: INFO/ForkPoolWorker-15] [58641f2a-26f8-47d4-8685-5659c9e22577] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:48:00.904337543Z [2024-04-15 03:48:00,904: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dccd5434-5644-431f-b8d0-a92c16c1ff5f] received 2024-04-15T03:48:00.907292236Z [2024-04-15 03:48:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0b6f60b-105b-45e4-89d1-a7b3a06e48d9] received 2024-04-15T03:48:00.924742713Z [2024-04-15 03:48:00,924: INFO/ForkPoolWorker-1] [e0b6f60b-105b-45e4-89d1-a7b3a06e48d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:48:00.934702039Z [2024-04-15 03:48:00,934: INFO/ForkPoolWorker-16] [dccd5434-5644-431f-b8d0-a92c16c1ff5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:48:01.334981789Z [2024-04-15 03:48:01,327: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:48:01.458909917Z [2024-04-15 03:48:01,451: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:48:01.473732133Z [2024-04-15 03:48:01,469: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:48:01.896887332Z [2024-04-15 03:48:01,896: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:48:02.764580800Z [2024-04-15 03:48:02,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[58641f2a-26f8-47d4-8685-5659c9e22577] succeeded in 1.917627838000044s: None 2024-04-15T03:48:03.367767154Z [2024-04-15 03:48:03,367: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:48:03.372369630Z [2024-04-15 03:48:03,371: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:48:03.410103619Z [2024-04-15 03:48:03,406: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:48:03.412700927Z [2024-04-15 03:48:03,411: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:48:03.451065658Z [2024-04-15 03:48:03,450: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:48:03.461367436Z [2024-04-15 03:48:03,461: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:48:03.461505331Z [2024-04-15 03:48:03,461: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:48:03.461583106Z [2024-04-15 03:48:03,461: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:48:03.461777159Z [2024-04-15 03:48:03,461: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:48:03.461993688Z [2024-04-15 03:48:03,461: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:48:03.462396728Z [2024-04-15 03:48:03,462: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:48:03.463222399Z [2024-04-15 03:48:03,462: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:48:03.468691976Z [2024-04-15 03:48:03,468: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:48:03.468741440Z [2024-04-15 03:48:03,468: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:48:03.469007254Z [2024-04-15 03:48:03,468: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:48:03.469086201Z [2024-04-15 03:48:03,468: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:48:03.469355748Z [2024-04-15 03:48:03,469: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:48:03.469446082Z [2024-04-15 03:48:03,469: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:48:03.566967397Z [2024-04-15 03:48:03,566: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:48:03.587305959Z [2024-04-15 03:48:03,587: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:48:05.305241734Z [2024-04-15 03:48:05,303: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e0b6f60b-105b-45e4-89d1-a7b3a06e48d9] succeeded in 4.393418715000735s: None 2024-04-15T03:48:06.615549238Z [2024-04-15 03:48:06,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dccd5434-5644-431f-b8d0-a92c16c1ff5f] succeeded in 5.704342794000695s: None 2024-04-15T03:49:00.688830140Z [2024-04-15 03:49:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[469ef80d-0667-4607-9460-8d7fec9d1cac] received 2024-04-15T03:49:00.692395059Z [2024-04-15 03:49:00,692: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[814f5453-c014-4ae2-9513-cdbccd7066e1] received 2024-04-15T03:49:00.706121290Z [2024-04-15 03:49:00,705: INFO/ForkPoolWorker-15] [469ef80d-0667-4607-9460-8d7fec9d1cac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:49:00.706903160Z [2024-04-15 03:49:00,706: INFO/ForkPoolWorker-16] [814f5453-c014-4ae2-9513-cdbccd7066e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:49:01.068276447Z [2024-04-15 03:49:01,064: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:49:01.090460722Z [2024-04-15 03:49:01,087: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:49:02.342734182Z [2024-04-15 03:49:02,342: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:49:02.346054639Z [2024-04-15 03:49:02,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:49:02.369763455Z [2024-04-15 03:49:02,369: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:49:02.373175271Z [2024-04-15 03:49:02,372: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:49:02.381429432Z [2024-04-15 03:49:02,377: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:49:02.381494805Z [2024-04-15 03:49:02,378: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:49:02.381503169Z [2024-04-15 03:49:02,378: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:49:02.381510387Z [2024-04-15 03:49:02,378: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:49:02.381517517Z [2024-04-15 03:49:02,378: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:49:02.381522296Z [2024-04-15 03:49:02,378: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:49:02.381527012Z [2024-04-15 03:49:02,379: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:49:02.409095825Z [2024-04-15 03:49:02,408: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:49:02.410442428Z [2024-04-15 03:49:02,410: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:49:02.410599110Z [2024-04-15 03:49:02,410: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:49:02.411211483Z [2024-04-15 03:49:02,410: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:49:02.411347786Z [2024-04-15 03:49:02,411: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:49:02.411923218Z [2024-04-15 03:49:02,411: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:49:02.411935393Z [2024-04-15 03:49:02,411: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:49:02.467369695Z [2024-04-15 03:49:02,467: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:49:02.503173208Z [2024-04-15 03:49:02,502: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:49:04.391492553Z [2024-04-15 03:49:04,390: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[814f5453-c014-4ae2-9513-cdbccd7066e1] succeeded in 3.6969227230001707s: None 2024-04-15T03:49:04.744776886Z [2024-04-15 03:49:04,743: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[469ef80d-0667-4607-9460-8d7fec9d1cac] succeeded in 4.050415970001268s: None 2024-04-15T03:50:00.587703877Z [2024-04-15 03:50:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f77d170b-9ee6-40c6-9010-f48cb7af238a] received 2024-04-15T03:50:00.594015325Z [2024-04-15 03:50:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0aa97997-5d85-47fe-bf72-911ce53d8644] received 2024-04-15T03:50:00.606106763Z [2024-04-15 03:50:00,605: INFO/ForkPoolWorker-16] [0aa97997-5d85-47fe-bf72-911ce53d8644] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:50:00.608300215Z [2024-04-15 03:50:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ece7048-9289-4ff9-b62d-4e4fba189ba1] received 2024-04-15T03:50:00.609106491Z [2024-04-15 03:50:00,608: INFO/ForkPoolWorker-15] [f77d170b-9ee6-40c6-9010-f48cb7af238a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:00.612225926Z [2024-04-15 03:50:00,611: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f33b77a4-7fa7-483a-80da-ac6bb0fbadfa] received 2024-04-15T03:50:00.627867012Z [2024-04-15 03:50:00,627: INFO/ForkPoolWorker-1] [7ece7048-9289-4ff9-b62d-4e4fba189ba1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:50:00.633868708Z [2024-04-15 03:50:00,633: INFO/ForkPoolWorker-2] [f33b77a4-7fa7-483a-80da-ac6bb0fbadfa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:50:00.965517631Z [2024-04-15 03:50:00,961: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:50:01.024136737Z [2024-04-15 03:50:01,021: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:50:01.234868245Z [2024-04-15 03:50:01,230: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:50:01.312177301Z [2024-04-15 03:50:01,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:50:01.622047997Z [2024-04-15 03:50:01,621: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:02.458408216Z [2024-04-15 03:50:02,458: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0aa97997-5d85-47fe-bf72-911ce53d8644] succeeded in 1.8625817259999167s: None 2024-04-15T03:50:02.980344041Z [2024-04-15 03:50:02,978: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:50:02.986108510Z [2024-04-15 03:50:02,984: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:03.013317098Z [2024-04-15 03:50:03,013: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:50:03.014785416Z [2024-04-15 03:50:03,014: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:03.014798200Z [2024-04-15 03:50:03,014: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:03.014931497Z [2024-04-15 03:50:03,014: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:03.015051636Z [2024-04-15 03:50:03,014: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:50:03.015514471Z [2024-04-15 03:50:03,015: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:50:03.015522567Z [2024-04-15 03:50:03,015: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:03.023771492Z [2024-04-15 03:50:03,023: INFO/ForkPoolWorker-2] Getting VIM list 2024-04-15T03:50:03.031293358Z [2024-04-15 03:50:03,030: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:03.082997678Z [2024-04-15 03:50:03,082: INFO/ForkPoolWorker-2] Connected to database osm version 1.2 2024-04-15T03:50:03.085059310Z [2024-04-15 03:50:03,084: INFO/ForkPoolWorker-2] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:03.085439587Z [2024-04-15 03:50:03,084: INFO/ForkPoolWorker-2] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:03.087644043Z [2024-04-15 03:50:03,087: INFO/ForkPoolWorker-2] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:03.087874455Z [2024-04-15 03:50:03,087: INFO/ForkPoolWorker-2] Getting VIM list OK 2024-04-15T03:50:03.088556386Z [2024-04-15 03:50:03,088: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:50:03.088809272Z [2024-04-15 03:50:03,088: INFO/ForkPoolWorker-2] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:03.109348835Z [2024-04-15 03:50:03,109: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:03.188165111Z [2024-04-15 03:50:03,187: INFO/ForkPoolWorker-2] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:03.269814855Z [2024-04-15 03:50:03,269: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:50:03.273342673Z [2024-04-15 03:50:03,272: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:03.303178125Z [2024-04-15 03:50:03,302: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:50:03.305846020Z [2024-04-15 03:50:03,305: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:03.306378561Z [2024-04-15 03:50:03,306: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:03.306657208Z [2024-04-15 03:50:03,306: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:03.306833087Z [2024-04-15 03:50:03,306: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:50:03.307254686Z [2024-04-15 03:50:03,307: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:50:03.307440903Z [2024-04-15 03:50:03,307: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:03.388052314Z [2024-04-15 03:50:03,387: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:03.730100867Z [2024-04-15 03:50:03,729: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f77d170b-9ee6-40c6-9010-f48cb7af238a] succeeded in 3.131821218999903s: None 2024-04-15T03:50:04.436381729Z [2024-04-15 03:50:04,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68d2f152-bc4b-49ac-a906-bbdc267221ab] received 2024-04-15T03:50:04.453188755Z [2024-04-15 03:50:04,452: INFO/ForkPoolWorker-15] [68d2f152-bc4b-49ac-a906-bbdc267221ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:04.672021344Z [2024-04-15 03:50:04,671: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f33b77a4-7fa7-483a-80da-ac6bb0fbadfa] succeeded in 4.054822283000249s: None 2024-04-15T03:50:04.759655704Z [2024-04-15 03:50:04,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:50:05.218290407Z [2024-04-15 03:50:05,217: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ece7048-9289-4ff9-b62d-4e4fba189ba1] succeeded in 4.6037899179991655s: None 2024-04-15T03:50:05.888969504Z [2024-04-15 03:50:05,888: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:50:05.892139757Z [2024-04-15 03:50:05,891: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:05.925754183Z [2024-04-15 03:50:05,925: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:50:05.927153161Z [2024-04-15 03:50:05,926: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:05.927319650Z [2024-04-15 03:50:05,927: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:05.927618002Z [2024-04-15 03:50:05,927: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:05.927772304Z [2024-04-15 03:50:05,927: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:50:05.928313720Z [2024-04-15 03:50:05,928: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:50:05.928507436Z [2024-04-15 03:50:05,928: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:06.010612691Z [2024-04-15 03:50:06,010: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:06.781553144Z [2024-04-15 03:50:06,780: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68d2f152-bc4b-49ac-a906-bbdc267221ab] succeeded in 2.342592518998572s: None 2024-04-15T03:50:06.843894645Z [2024-04-15 03:50:06,843: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2ba02b3-e90e-41d8-8ac7-01f5f776a9ae] received 2024-04-15T03:50:06.849379559Z [2024-04-15 03:50:06,849: INFO/ForkPoolWorker-15] [f2ba02b3-e90e-41d8-8ac7-01f5f776a9ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:50:07.134675806Z [2024-04-15 03:50:07,131: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:50:08.171933795Z [2024-04-15 03:50:08,171: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:50:08.174967157Z [2024-04-15 03:50:08,174: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:08.205234904Z [2024-04-15 03:50:08,204: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:50:08.209285544Z [2024-04-15 03:50:08,208: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:08.209319536Z [2024-04-15 03:50:08,209: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:08.209602949Z [2024-04-15 03:50:08,209: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:08.209813007Z [2024-04-15 03:50:08,209: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:50:08.210512119Z [2024-04-15 03:50:08,210: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:50:08.210789058Z [2024-04-15 03:50:08,210: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:08.315521856Z [2024-04-15 03:50:08,315: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:08.921526969Z [2024-04-15 03:50:08,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f2ba02b3-e90e-41d8-8ac7-01f5f776a9ae] succeeded in 2.0754819710000447s: None 2024-04-15T03:50:09.481750059Z [2024-04-15 03:50:09,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b7c5b76-ecc7-4c09-b9ea-c0b9e86cd036] received 2024-04-15T03:50:09.487389143Z [2024-04-15 03:50:09,487: INFO/ForkPoolWorker-15] [1b7c5b76-ecc7-4c09-b9ea-c0b9e86cd036] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:50:09.805940849Z [2024-04-15 03:50:09,802: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:50:11.025871931Z [2024-04-15 03:50:11,025: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:50:11.028683178Z [2024-04-15 03:50:11,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:50:11.078809160Z [2024-04-15 03:50:11,078: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:50:11.081618157Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:50:11.081634822Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:50:11.081743974Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:50:11.081772280Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:50:11.082078929Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:50:11.082089128Z [2024-04-15 03:50:11,081: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:50:11.203653871Z [2024-04-15 03:50:11,203: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:50:11.742509881Z [2024-04-15 03:50:11,740: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b7c5b76-ecc7-4c09-b9ea-c0b9e86cd036] succeeded in 2.258110620001389s: None 2024-04-15T03:51:00.412416446Z [2024-04-15 03:51:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07f5ffb6-7759-416d-9508-d55c5ceb6478] received 2024-04-15T03:51:00.420072199Z [2024-04-15 03:51:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5713763-56cb-499b-b33c-06a07c3a183d] received 2024-04-15T03:51:00.433989839Z [2024-04-15 03:51:00,433: INFO/ForkPoolWorker-16] [b5713763-56cb-499b-b33c-06a07c3a183d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:51:00.437070618Z [2024-04-15 03:51:00,436: INFO/ForkPoolWorker-15] [07f5ffb6-7759-416d-9508-d55c5ceb6478] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:51:00.676809220Z [2024-04-15 03:51:00,673: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:51:00.725881479Z [2024-04-15 03:51:00,722: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:51:01.884867905Z [2024-04-15 03:51:01,884: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:51:01.896673249Z [2024-04-15 03:51:01,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:51:01.962833572Z [2024-04-15 03:51:01,962: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:51:01.963874195Z [2024-04-15 03:51:01,963: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:51:01.963894521Z [2024-04-15 03:51:01,963: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:51:01.964049118Z [2024-04-15 03:51:01,963: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:51:01.964181570Z [2024-04-15 03:51:01,963: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:51:01.964463100Z [2024-04-15 03:51:01,964: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:51:01.964513041Z [2024-04-15 03:51:01,964: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:51:02.036196380Z [2024-04-15 03:51:02,035: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:51:02.181076869Z [2024-04-15 03:51:02,179: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:51:02.186779334Z [2024-04-15 03:51:02,186: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:51:02.220794782Z [2024-04-15 03:51:02,220: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:51:02.226342003Z [2024-04-15 03:51:02,226: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:51:02.226505664Z [2024-04-15 03:51:02,226: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:51:02.226710226Z [2024-04-15 03:51:02,226: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:51:02.226776868Z [2024-04-15 03:51:02,226: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:51:02.227063918Z [2024-04-15 03:51:02,226: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:51:02.227149085Z [2024-04-15 03:51:02,227: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:51:02.371071111Z [2024-04-15 03:51:02,370: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:51:03.613822765Z [2024-04-15 03:51:03,613: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b5713763-56cb-499b-b33c-06a07c3a183d] succeeded in 3.189806047001184s: None 2024-04-15T03:51:04.266106530Z [2024-04-15 03:51:04,265: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[07f5ffb6-7759-416d-9508-d55c5ceb6478] succeeded in 3.8498637520006014s: None 2024-04-15T03:52:00.829757539Z [2024-04-15 03:52:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a54fb706-de70-4cef-8619-6161a5fd6a27] received 2024-04-15T03:52:00.833097706Z [2024-04-15 03:52:00,830: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3ac2ac2-34f2-4a7c-8b5e-eb3103045632] received 2024-04-15T03:52:00.842582191Z [2024-04-15 03:52:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[086f887d-642c-4afc-9187-8efcd180fa71] received 2024-04-15T03:52:00.844393971Z [2024-04-15 03:52:00,844: INFO/ForkPoolWorker-15] [a54fb706-de70-4cef-8619-6161a5fd6a27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:52:00.848939414Z [2024-04-15 03:52:00,848: INFO/ForkPoolWorker-16] [c3ac2ac2-34f2-4a7c-8b5e-eb3103045632] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:52:00.870227898Z [2024-04-15 03:52:00,863: INFO/ForkPoolWorker-1] [086f887d-642c-4afc-9187-8efcd180fa71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:52:01.178792980Z [2024-04-15 03:52:01,175: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:52:01.237694858Z [2024-04-15 03:52:01,233: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:52:01.582847129Z [2024-04-15 03:52:01,574: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:52:02.171670328Z [2024-04-15 03:52:02,171: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:52:02.772245901Z [2024-04-15 03:52:02,771: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:52:02.775256296Z [2024-04-15 03:52:02,774: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:52:02.793017030Z [2024-04-15 03:52:02,792: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3ac2ac2-34f2-4a7c-8b5e-eb3103045632] succeeded in 1.9583295930005988s: None 2024-04-15T03:52:02.805522119Z [2024-04-15 03:52:02,805: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:52:02.812632049Z [2024-04-15 03:52:02,812: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:52:02.813037108Z [2024-04-15 03:52:02,812: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:52:02.813348218Z [2024-04-15 03:52:02,813: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:52:02.813524917Z [2024-04-15 03:52:02,813: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:52:02.813823055Z [2024-04-15 03:52:02,813: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:52:02.814042024Z [2024-04-15 03:52:02,813: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:52:02.866739345Z [2024-04-15 03:52:02,866: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:52:02.876879589Z [2024-04-15 03:52:02,876: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:52:02.920465451Z [2024-04-15 03:52:02,919: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:52:02.954928269Z [2024-04-15 03:52:02,954: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:52:02.956241460Z [2024-04-15 03:52:02,956: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:52:02.956459108Z [2024-04-15 03:52:02,956: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:52:02.956615173Z [2024-04-15 03:52:02,956: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:52:02.958059807Z [2024-04-15 03:52:02,956: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:52:02.958071336Z [2024-04-15 03:52:02,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:52:02.958074707Z [2024-04-15 03:52:02,957: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:52:03.085877642Z [2024-04-15 03:52:03,085: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:52:04.444960282Z [2024-04-15 03:52:04,444: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a54fb706-de70-4cef-8619-6161a5fd6a27] succeeded in 3.6153457300006266s: None 2024-04-15T03:52:05.488651835Z [2024-04-15 03:52:05,487: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[086f887d-642c-4afc-9187-8efcd180fa71] succeeded in 4.637037176000376s: None 2024-04-15T03:53:00.654936468Z [2024-04-15 03:53:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46955310-dc66-4f36-9503-70c5d4f9cf4a] received 2024-04-15T03:53:00.658921868Z [2024-04-15 03:53:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[700880d6-8975-4b3f-8eae-f6ea1d8d0021] received 2024-04-15T03:53:00.674883134Z [2024-04-15 03:53:00,674: INFO/ForkPoolWorker-15] [46955310-dc66-4f36-9503-70c5d4f9cf4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:53:00.676582865Z [2024-04-15 03:53:00,676: INFO/ForkPoolWorker-16] [700880d6-8975-4b3f-8eae-f6ea1d8d0021] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:53:00.986988074Z [2024-04-15 03:53:00,983: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:53:01.013310712Z [2024-04-15 03:53:01,010: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:53:02.205335561Z [2024-04-15 03:53:02,204: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:53:02.209746309Z [2024-04-15 03:53:02,209: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:53:02.250715994Z [2024-04-15 03:53:02,250: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:53:02.252435429Z [2024-04-15 03:53:02,252: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:53:02.252522161Z [2024-04-15 03:53:02,252: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:53:02.252690193Z [2024-04-15 03:53:02,252: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:53:02.252774679Z [2024-04-15 03:53:02,252: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:53:02.253067471Z [2024-04-15 03:53:02,252: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:53:02.253142778Z [2024-04-15 03:53:02,253: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:53:02.342251182Z [2024-04-15 03:53:02,341: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:53:02.450995002Z [2024-04-15 03:53:02,450: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:53:02.454339147Z [2024-04-15 03:53:02,453: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:53:02.486768281Z [2024-04-15 03:53:02,486: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:53:02.487810447Z [2024-04-15 03:53:02,487: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:53:02.487933476Z [2024-04-15 03:53:02,487: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:53:02.488119883Z [2024-04-15 03:53:02,487: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:53:02.488306118Z [2024-04-15 03:53:02,488: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:53:02.488490697Z [2024-04-15 03:53:02,488: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:53:02.488647436Z [2024-04-15 03:53:02,488: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:53:02.559006755Z [2024-04-15 03:53:02,558: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:53:04.493185285Z [2024-04-15 03:53:04,492: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[700880d6-8975-4b3f-8eae-f6ea1d8d0021] succeeded in 3.8261026830004994s: None 2024-04-15T03:53:04.867010011Z [2024-04-15 03:53:04,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[46955310-dc66-4f36-9503-70c5d4f9cf4a] succeeded in 4.20987888899981s: None 2024-04-15T03:54:00.552054286Z [2024-04-15 03:54:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9fcec69-4b63-470d-9e40-fba35bbe3b97] received 2024-04-15T03:54:00.559297159Z [2024-04-15 03:54:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0b99b66-9c3b-4cc4-99ca-943973874bf8] received 2024-04-15T03:54:00.565804406Z [2024-04-15 03:54:00,565: INFO/ForkPoolWorker-15] [b9fcec69-4b63-470d-9e40-fba35bbe3b97] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:54:00.571483129Z [2024-04-15 03:54:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ed9a813f-d7c8-48e9-a264-b92ebae7002b] received 2024-04-15T03:54:00.580716416Z [2024-04-15 03:54:00,580: INFO/ForkPoolWorker-16] [b0b99b66-9c3b-4cc4-99ca-943973874bf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:54:00.588208734Z [2024-04-15 03:54:00,587: INFO/ForkPoolWorker-1] [ed9a813f-d7c8-48e9-a264-b92ebae7002b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:54:00.891573606Z [2024-04-15 03:54:00,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:54:00.901663304Z [2024-04-15 03:54:00,897: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:54:00.930044156Z [2024-04-15 03:54:00,926: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:54:01.158476856Z [2024-04-15 03:54:01,158: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:54:01.863926509Z [2024-04-15 03:54:01,863: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b9fcec69-4b63-470d-9e40-fba35bbe3b97] succeeded in 1.3088678759995673s: None 2024-04-15T03:54:02.493508410Z [2024-04-15 03:54:02,493: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:54:02.496848220Z [2024-04-15 03:54:02,496: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:54:02.544241061Z [2024-04-15 03:54:02,544: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:54:02.546040291Z [2024-04-15 03:54:02,545: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:54:02.546073943Z [2024-04-15 03:54:02,545: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:54:02.546240324Z [2024-04-15 03:54:02,546: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:54:02.546286230Z [2024-04-15 03:54:02,546: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:54:02.546545102Z [2024-04-15 03:54:02,546: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:54:02.546698786Z [2024-04-15 03:54:02,546: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:54:02.687395433Z [2024-04-15 03:54:02,687: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:54:02.705288974Z [2024-04-15 03:54:02,704: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:54:02.708427271Z [2024-04-15 03:54:02,707: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:54:02.736677301Z [2024-04-15 03:54:02,736: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:54:02.737982152Z [2024-04-15 03:54:02,737: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:54:02.741327392Z [2024-04-15 03:54:02,740: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:54:02.741346906Z [2024-04-15 03:54:02,740: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:54:02.741353188Z [2024-04-15 03:54:02,740: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:54:02.741358121Z [2024-04-15 03:54:02,741: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:54:02.741362830Z [2024-04-15 03:54:02,741: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:54:02.840394135Z [2024-04-15 03:54:02,839: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:54:04.416119987Z [2024-04-15 03:54:04,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0b99b66-9c3b-4cc4-99ca-943973874bf8] succeeded in 3.8504811250004423s: None 2024-04-15T03:54:05.288350925Z [2024-04-15 03:54:05,287: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ed9a813f-d7c8-48e9-a264-b92ebae7002b] succeeded in 4.7136502859993925s: None 2024-04-15T03:55:00.447593011Z [2024-04-15 03:55:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7167a2a1-6248-43df-be5e-70f0bb97c6e6] received 2024-04-15T03:55:00.452884845Z [2024-04-15 03:55:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04399b6-1b84-46d6-b37c-e31580422f67] received 2024-04-15T03:55:00.454532232Z [2024-04-15 03:55:00,454: INFO/ForkPoolWorker-15] [7167a2a1-6248-43df-be5e-70f0bb97c6e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:55:00.461152745Z [2024-04-15 03:55:00,460: INFO/ForkPoolWorker-16] [c04399b6-1b84-46d6-b37c-e31580422f67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'extract_metrics_from_vnfrs', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:00.462065023Z [2024-04-15 03:55:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d2aca6c-b3de-43f7-afa1-9f5004b9935a] received 2024-04-15T03:55:00.471365312Z [2024-04-15 03:55:00,471: INFO/ForkPoolWorker-1] [0d2aca6c-b3de-43f7-afa1-9f5004b9935a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:55:00.761014375Z [2024-04-15 03:55:00,757: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:55:00.776007354Z [2024-04-15 03:55:00,771: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:55:00.876769098Z [2024-04-15 03:55:00,873: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:55:02.391705239Z [2024-04-15 03:55:02,391: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:55:02.394832077Z [2024-04-15 03:55:02,394: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:02.418205721Z [2024-04-15 03:55:02,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:55:02.422759993Z [2024-04-15 03:55:02,422: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:02.422784338Z [2024-04-15 03:55:02,422: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:02.422860073Z [2024-04-15 03:55:02,422: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:02.422902486Z [2024-04-15 03:55:02,422: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:55:02.423109078Z [2024-04-15 03:55:02,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:55:02.423141092Z [2024-04-15 03:55:02,423: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:02.504958656Z [2024-04-15 03:55:02,504: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:02.605698072Z [2024-04-15 03:55:02,605: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:55:02.609047052Z [2024-04-15 03:55:02,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:02.632891166Z [2024-04-15 03:55:02,632: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:55:02.635321574Z [2024-04-15 03:55:02,635: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:02.635932166Z [2024-04-15 03:55:02,635: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:02.636292111Z [2024-04-15 03:55:02,636: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:02.636856208Z [2024-04-15 03:55:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:55:02.637802996Z [2024-04-15 03:55:02,637: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:55:02.638255180Z [2024-04-15 03:55:02,638: INFO/ForkPoolWorker-1] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:02.670372656Z [2024-04-15 03:55:02,669: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:55:02.673529574Z [2024-04-15 03:55:02,673: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:02.697957888Z [2024-04-15 03:55:02,697: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:55:02.698838363Z [2024-04-15 03:55:02,698: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:02.698853379Z [2024-04-15 03:55:02,698: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:02.698947114Z [2024-04-15 03:55:02,698: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:02.698978894Z [2024-04-15 03:55:02,698: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:55:02.699298996Z [2024-04-15 03:55:02,699: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:55:02.699317557Z [2024-04-15 03:55:02,699: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:02.726553817Z [2024-04-15 03:55:02,726: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:02.778309061Z [2024-04-15 03:55:02,778: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:03.441245158Z [2024-04-15 03:55:03,440: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c04399b6-1b84-46d6-b37c-e31580422f67] succeeded in 2.985872074001236s: None 2024-04-15T03:55:04.085660336Z [2024-04-15 03:55:04,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6eee4a8-fa74-4110-9016-1f154aa7e599] received 2024-04-15T03:55:04.101545000Z [2024-04-15 03:55:04,101: INFO/ForkPoolWorker-16] [c6eee4a8-fa74-4110-9016-1f154aa7e599] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'split_metrics', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:04.378107161Z [2024-04-15 03:55:04,375: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:55:04.482714225Z [2024-04-15 03:55:04,481: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d2aca6c-b3de-43f7-afa1-9f5004b9935a] succeeded in 4.018777997000143s: None 2024-04-15T03:55:05.349512621Z [2024-04-15 03:55:05,348: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7167a2a1-6248-43df-be5e-70f0bb97c6e6] succeeded in 4.900191867000103s: None 2024-04-15T03:55:05.451488590Z [2024-04-15 03:55:05,451: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:55:05.454751335Z [2024-04-15 03:55:05,454: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:05.488734932Z [2024-04-15 03:55:05,488: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:55:05.489797935Z [2024-04-15 03:55:05,489: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:05.489890158Z [2024-04-15 03:55:05,489: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:05.490650779Z [2024-04-15 03:55:05,490: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:05.490885982Z [2024-04-15 03:55:05,490: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:55:05.491294510Z [2024-04-15 03:55:05,490: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:55:05.491313575Z [2024-04-15 03:55:05,491: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:05.561365852Z [2024-04-15 03:55:05,561: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:06.255273983Z [2024-04-15 03:55:06,254: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6eee4a8-fa74-4110-9016-1f154aa7e599] succeeded in 2.163231635999182s: None 2024-04-15T03:55:06.538432848Z [2024-04-15 03:55:06,538: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8649bfdf-3e73-4e0e-b66a-3cdf2c75089c] received 2024-04-15T03:55:06.548600002Z [2024-04-15 03:55:06,548: INFO/ForkPoolWorker-15] [8649bfdf-3e73-4e0e-b66a-3cdf2c75089c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'collect_metrics', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0'] 2024-04-15T03:55:06.837241789Z [2024-04-15 03:55:06,833: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:55:07.869378817Z [2024-04-15 03:55:07,868: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:55:07.872543353Z [2024-04-15 03:55:07,871: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:07.904704210Z [2024-04-15 03:55:07,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:55:07.907555306Z [2024-04-15 03:55:07,907: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:07.907611915Z [2024-04-15 03:55:07,907: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:07.907883857Z [2024-04-15 03:55:07,907: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:07.907966905Z [2024-04-15 03:55:07,907: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:55:07.908209222Z [2024-04-15 03:55:07,908: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:55:07.908431128Z [2024-04-15 03:55:07,908: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:08.019853459Z [2024-04-15 03:55:08,019: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:08.618307575Z [2024-04-15 03:55:08,617: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8649bfdf-3e73-4e0e-b66a-3cdf2c75089c] succeeded in 2.0755503279997356s: None 2024-04-15T03:55:08.873121362Z [2024-04-15 03:55:08,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[998d6d66-c29e-4c12-bc3f-e542a657c205] received 2024-04-15T03:55:08.883842662Z [2024-04-15 03:55:08,883: INFO/ForkPoolWorker-15] [998d6d66-c29e-4c12-bc3f-e542a657c205] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f', 'send_prometheus', 'scheduled__2024-04-15T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py'] 2024-04-15T03:55:09.195633370Z [2024-04-15 03:55:09,192: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py 2024-04-15T03:55:10.443354484Z [2024-04-15 03:55:10,443: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:55:10.446780937Z [2024-04-15 03:55:10,446: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:55:10.482898258Z [2024-04-15 03:55:10,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:55:10.484757706Z [2024-04-15 03:55:10,484: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:55:10.485050588Z [2024-04-15 03:55:10,484: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:55:10.485329492Z [2024-04-15 03:55:10,485: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:55:10.485507069Z [2024-04-15 03:55:10,485: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:55:10.486328181Z [2024-04-15 03:55:10,485: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics 2024-04-15T03:55:10.486353468Z [2024-04-15 03:55:10,485: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:55:10.567791168Z [2024-04-15 03:55:10,567: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:55:11.101296711Z [2024-04-15 03:55:11,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[998d6d66-c29e-4c12-bc3f-e542a657c205] succeeded in 2.225322825001058s: None 2024-04-15T03:56:00.247868612Z [2024-04-15 03:56:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[419c45c9-0951-4192-b52f-e58a719c2bde] received 2024-04-15T03:56:00.256167794Z [2024-04-15 03:56:00,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56891cd1-e345-4d9a-94ac-3723e71ada38] received 2024-04-15T03:56:00.260648294Z [2024-04-15 03:56:00,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a439f0e-a56c-47eb-a48d-f9504152cce8] received 2024-04-15T03:56:00.269354032Z [2024-04-15 03:56:00,268: INFO/ForkPoolWorker-1] [5a439f0e-a56c-47eb-a48d-f9504152cce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:56:00.272184152Z [2024-04-15 03:56:00,271: INFO/ForkPoolWorker-15] [419c45c9-0951-4192-b52f-e58a719c2bde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:56:00.274621268Z [2024-04-15 03:56:00,274: INFO/ForkPoolWorker-16] [56891cd1-e345-4d9a-94ac-3723e71ada38] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:56:00.589374366Z [2024-04-15 03:56:00,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:56:00.740432082Z [2024-04-15 03:56:00,732: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:56:00.818948266Z [2024-04-15 03:56:00,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:56:01.333044470Z [2024-04-15 03:56:01,332: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:56:02.451806779Z [2024-04-15 03:56:02,451: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56891cd1-e345-4d9a-94ac-3723e71ada38] succeeded in 2.192369417000009s: None 2024-04-15T03:56:02.732383198Z [2024-04-15 03:56:02,732: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:56:02.740150556Z [2024-04-15 03:56:02,739: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:56:02.800771176Z [2024-04-15 03:56:02,799: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:56:02.800939422Z [2024-04-15 03:56:02,799: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:56:02.804146702Z [2024-04-15 03:56:02,803: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:56:02.809420416Z [2024-04-15 03:56:02,809: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:56:02.809588953Z [2024-04-15 03:56:02,809: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:56:02.809773363Z [2024-04-15 03:56:02,809: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:56:02.809842111Z [2024-04-15 03:56:02,809: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:56:02.810165277Z [2024-04-15 03:56:02,810: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:56:02.810603216Z [2024-04-15 03:56:02,810: INFO/ForkPoolWorker-15] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:56:02.994263777Z [2024-04-15 03:56:02,994: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:56:03.008406573Z [2024-04-15 03:56:03,008: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:56:03.008492690Z [2024-04-15 03:56:03,008: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:56:03.009034756Z [2024-04-15 03:56:03,008: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:56:03.009146743Z [2024-04-15 03:56:03,009: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:56:03.009436349Z [2024-04-15 03:56:03,009: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:56:03.010081355Z [2024-04-15 03:56:03,009: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:56:03.053315951Z [2024-04-15 03:56:03,053: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:56:03.122949408Z [2024-04-15 03:56:03,122: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:56:04.798032043Z [2024-04-15 03:56:04,795: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[419c45c9-0951-4192-b52f-e58a719c2bde] succeeded in 4.545199062999018s: None 2024-04-15T03:56:05.569719580Z [2024-04-15 03:56:05,568: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5a439f0e-a56c-47eb-a48d-f9504152cce8] succeeded in 5.307253852999565s: None 2024-04-15T03:57:00.657863443Z [2024-04-15 03:57:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[540986aa-2d65-4d31-a478-3a9255fcaedd] received 2024-04-15T03:57:00.661935863Z [2024-04-15 03:57:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afcd61cc-b5bb-47e2-bc0d-305eacc5ac08] received 2024-04-15T03:57:00.676455935Z [2024-04-15 03:57:00,676: INFO/ForkPoolWorker-15] [540986aa-2d65-4d31-a478-3a9255fcaedd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:57:00.678758622Z [2024-04-15 03:57:00,678: INFO/ForkPoolWorker-16] [afcd61cc-b5bb-47e2-bc0d-305eacc5ac08] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:57:00.976029549Z [2024-04-15 03:57:00,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:57:00.992422963Z [2024-04-15 03:57:00,986: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:57:02.427067860Z [2024-04-15 03:57:02,426: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:57:02.430549486Z [2024-04-15 03:57:02,430: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:57:02.434452357Z [2024-04-15 03:57:02,434: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:57:02.437388763Z [2024-04-15 03:57:02,437: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:57:02.454247212Z [2024-04-15 03:57:02,454: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:57:02.455371244Z [2024-04-15 03:57:02,455: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:57:02.455658485Z [2024-04-15 03:57:02,455: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:57:02.455844646Z [2024-04-15 03:57:02,455: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:57:02.456839489Z [2024-04-15 03:57:02,456: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:57:02.457609190Z [2024-04-15 03:57:02,457: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:57:02.457884911Z [2024-04-15 03:57:02,457: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:57:02.468403882Z [2024-04-15 03:57:02,468: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:57:02.470379161Z [2024-04-15 03:57:02,470: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:57:02.471089643Z [2024-04-15 03:57:02,470: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:57:02.471235944Z [2024-04-15 03:57:02,471: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:57:02.471384913Z [2024-04-15 03:57:02,471: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:57:02.471620126Z [2024-04-15 03:57:02,471: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:57:02.471696725Z [2024-04-15 03:57:02,471: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:57:02.546073087Z [2024-04-15 03:57:02,545: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:57:02.554166461Z [2024-04-15 03:57:02,553: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:57:04.150161370Z [2024-04-15 03:57:04,149: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[afcd61cc-b5bb-47e2-bc0d-305eacc5ac08] succeeded in 3.4829470589993434s: None 2024-04-15T03:57:04.503847320Z [2024-04-15 03:57:04,503: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[540986aa-2d65-4d31-a478-3a9255fcaedd] succeeded in 3.838846912000008s: None 2024-04-15T03:58:01.118523472Z [2024-04-15 03:58:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57bcb0a6-a951-4a5b-ac2a-d5905c09c425] received 2024-04-15T03:58:01.122012724Z [2024-04-15 03:58:01,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04b9555e-6c5c-4efd-8e31-c65e1a2dd50e] received 2024-04-15T03:58:01.124268253Z [2024-04-15 03:58:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[773090cd-0e10-4f5e-83c5-995559609ee7] received 2024-04-15T03:58:01.138771599Z [2024-04-15 03:58:01,138: INFO/ForkPoolWorker-15] [57bcb0a6-a951-4a5b-ac2a-d5905c09c425] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-04-15T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py'] 2024-04-15T03:58:01.141594776Z [2024-04-15 03:58:01,141: INFO/ForkPoolWorker-16] [04b9555e-6c5c-4efd-8e31-c65e1a2dd50e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:58:01.151466605Z [2024-04-15 03:58:01,151: INFO/ForkPoolWorker-1] [773090cd-0e10-4f5e-83c5-995559609ee7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:58:01.495839770Z [2024-04-15 03:58:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:58:01.532394164Z [2024-04-15 03:58:01,529: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:58:01.783799354Z [2024-04-15 03:58:01,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py 2024-04-15T03:58:02.204057714Z [2024-04-15 03:58:02,203: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:58:02.832471396Z [2024-04-15 03:58:02,832: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57bcb0a6-a951-4a5b-ac2a-d5905c09c425] succeeded in 1.7122404149995418s: None 2024-04-15T03:58:02.971977711Z [2024-04-15 03:58:02,971: INFO/ForkPoolWorker-1] Getting VIM list 2024-04-15T03:58:02.975097295Z [2024-04-15 03:58:02,974: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:58:03.034345048Z [2024-04-15 03:58:03,034: INFO/ForkPoolWorker-1] Connected to database osm version 1.2 2024-04-15T03:58:03.036433887Z [2024-04-15 03:58:03,036: INFO/ForkPoolWorker-1] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:58:03.036775486Z [2024-04-15 03:58:03,036: INFO/ForkPoolWorker-1] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:58:03.036964375Z [2024-04-15 03:58:03,036: INFO/ForkPoolWorker-1] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:58:03.037056214Z [2024-04-15 03:58:03,036: INFO/ForkPoolWorker-1] Getting VIM list OK 2024-04-15T03:58:03.037346022Z [2024-04-15 03:58:03,037: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:58:03.038123319Z [2024-04-15 03:58:03,037: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:58:03.149957745Z [2024-04-15 03:58:03,149: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:58:03.153102019Z [2024-04-15 03:58:03,152: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:58:03.164605287Z [2024-04-15 03:58:03,164: INFO/ForkPoolWorker-1] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:58:03.192009634Z [2024-04-15 03:58:03,191: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:58:03.194719408Z [2024-04-15 03:58:03,194: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:58:03.194899083Z [2024-04-15 03:58:03,194: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:58:03.195115092Z [2024-04-15 03:58:03,194: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:58:03.195207379Z [2024-04-15 03:58:03,195: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:58:03.195968691Z [2024-04-15 03:58:03,195: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:58:03.196068279Z [2024-04-15 03:58:03,195: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:58:03.283821953Z [2024-04-15 03:58:03,283: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:58:04.966025231Z [2024-04-15 03:58:04,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[04b9555e-6c5c-4efd-8e31-c65e1a2dd50e] succeeded in 3.838152693999291s: None 2024-04-15T03:58:05.310896739Z [2024-04-15 03:58:05,310: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[773090cd-0e10-4f5e-83c5-995559609ee7] succeeded in 4.1800467489993025s: None 2024-04-15T03:59:00.678604670Z [2024-04-15 03:59:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[880f1447-a106-446d-9e0b-6638da0b5dde] received 2024-04-15T03:59:00.682693287Z [2024-04-15 03:59:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f623472-7b7b-49d1-9174-4d58bb75f9d3] received 2024-04-15T03:59:00.697531086Z [2024-04-15 03:59:00,697: INFO/ForkPoolWorker-15] [880f1447-a106-446d-9e0b-6638da0b5dde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py'] 2024-04-15T03:59:00.701416284Z [2024-04-15 03:59:00,701: INFO/ForkPoolWorker-16] [3f623472-7b7b-49d1-9174-4d58bb75f9d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_ac231340-6e28-42af-a241-50b013558a9f', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-04-15T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py'] 2024-04-15T03:59:00.993023983Z [2024-04-15 03:59:00,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py 2024-04-15T03:59:01.033995121Z [2024-04-15 03:59:01,030: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py 2024-04-15T03:59:02.255073215Z [2024-04-15 03:59:02,254: INFO/ForkPoolWorker-15] Getting VIM list 2024-04-15T03:59:02.258786794Z [2024-04-15 03:59:02,258: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:59:02.287698808Z [2024-04-15 03:59:02,287: INFO/ForkPoolWorker-15] Connected to database osm version 1.2 2024-04-15T03:59:02.289796584Z [2024-04-15 03:59:02,289: INFO/ForkPoolWorker-15] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:59:02.289854781Z [2024-04-15 03:59:02,289: INFO/ForkPoolWorker-15] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:59:02.290139716Z [2024-04-15 03:59:02,289: INFO/ForkPoolWorker-15] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:59:02.290206079Z [2024-04-15 03:59:02,290: INFO/ForkPoolWorker-15] Getting VIM list OK 2024-04-15T03:59:02.290479206Z [2024-04-15 03:59:02,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status 2024-04-15T03:59:02.290539947Z [2024-04-15 03:59:02,290: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:59:02.385470830Z [2024-04-15 03:59:02,385: INFO/ForkPoolWorker-15] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:59:02.500777060Z [2024-04-15 03:59:02,500: INFO/ForkPoolWorker-16] Getting VIM list 2024-04-15T03:59:02.504002931Z [2024-04-15 03:59:02,503: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'HYjD0Dr9pFOxIaodbnQyhHESzKea5xcS'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}} 2024-04-15T03:59:02.527489409Z [2024-04-15 03:59:02,527: INFO/ForkPoolWorker-16] Connected to database osm version 1.2 2024-04-15T03:59:02.528391171Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] Read VIM 953053d5-318b-4757-a30c-fe6ee797bdd4 (_system-osm-vim) 2024-04-15T03:59:02.528407503Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] Read VIM ac231340-6e28-42af-a241-50b013558a9f (osm) 2024-04-15T03:59:02.528518652Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] [{'_id': '953053d5-318b-4757-a30c-fe6ee797bdd4', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': 'ac231340-6e28-42af-a241-50b013558a9f', 'name': 'osm', 'vim_type': 'openstack'}] 2024-04-15T03:59:02.528559938Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] Getting VIM list OK 2024-04-15T03:59:02.528755520Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status 2024-04-15T03:59:02.528779777Z [2024-04-15 03:59:02,528: INFO/ForkPoolWorker-16] Creating DAG vim_status_ac231340-6e28-42af-a241-50b013558a9f 2024-04-15T03:59:02.622419694Z [2024-04-15 03:59:02,622: INFO/ForkPoolWorker-16] Running on host airflow-worker-0.airflow-worker.osm.svc.cluster.local 2024-04-15T03:59:04.096801531Z [2024-04-15 03:59:04,094: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f623472-7b7b-49d1-9174-4d58bb75f9d3] succeeded in 3.407904718998907s: None 2024-04-15T03:59:05.440021561Z [2024-04-15 03:59:05,439: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[880f1447-a106-446d-9e0b-6638da0b5dde] succeeded in 4.757327465000344s: None 2024-04-15T01:25:24.336285306Z 2024-04-15T01:25:24.384301068Z Cleaning logs every 900 seconds 2024-04-15T01:25:24.384319950Z Trimming airflow logs to 15 days. 2024-04-15T01:30:00.483008396Z Trimming airflow logs to 15 days. 2024-04-15T01:30:01.511404070Z Trimming airflow logs to 15 days. 2024-04-15T01:45:00.540305946Z Trimming airflow logs to 15 days. 2024-04-15T01:45:01.566031578Z Trimming airflow logs to 15 days. 2024-04-15T02:00:00.610268592Z Trimming airflow logs to 15 days. 2024-04-15T02:00:01.648209239Z Trimming airflow logs to 15 days. 2024-04-15T02:15:00.706102033Z Trimming airflow logs to 15 days. 2024-04-15T02:15:01.749336035Z Trimming airflow logs to 15 days. 2024-04-15T02:30:00.845772692Z Trimming airflow logs to 15 days. 2024-04-15T02:30:01.946336324Z Trimming airflow logs to 15 days. 2024-04-15T02:45:01.010730238Z Trimming airflow logs to 15 days. 2024-04-15T03:00:00.061830616Z Trimming airflow logs to 15 days. 2024-04-15T03:00:01.120390840Z Trimming airflow logs to 15 days. 2024-04-15T03:15:00.213340621Z Trimming airflow logs to 15 days. 2024-04-15T03:15:01.274641922Z Trimming airflow logs to 15 days. 2024-04-15T03:30:00.363054725Z Trimming airflow logs to 15 days. 2024-04-15T03:30:01.430204654Z Trimming airflow logs to 15 days. 2024-04-15T03:45:00.542670553Z Trimming airflow logs to 15 days. 2024-04-15T03:45:01.613599979Z Trimming airflow logs to 15 days.