2024-02-23T23:31:26.043089383Z .
2024-02-23T23:31:26.948051404Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0.
2024-02-23T23:31:28.225854936Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
2024-02-23T23:31:46.715183166Z 
2024-02-23T23:31:48.380161751Z /home/airflow/.local/lib/python3.10/site-packages/airflow/configuration.py:384 FutureWarning: The auth_backends setting in [api] has had airflow.api.auth.backend.session added in the running config, which is needed by the UI. Please update your config before Apache Airflow 3.0.
2024-02-23T23:31:50.911189123Z /home/airflow/.local/lib/python3.10/site-packages/airflow/models/base.py:49 MovedIn20Warning: Deprecated API features detected! These feature(s) are not compatible with SQLAlchemy 2.0. To prevent incompatible upgrades prior to updating applications, ensure requirements files are pinned to "sqlalchemy<2.0". Set environment variable SQLALCHEMY_WARN_20=1 to show all deprecation warnings.  Set environment variable SQLALCHEMY_SILENCE_UBER_WARNING=1 to silence this message. (Background on SQLAlchemy 2.0 at: https://sqlalche.me/e/b8d9)
2024-02-23T23:31:58.194328970Z [2024-02-23 23:31:58 +0000] [16] [INFO] Starting gunicorn 20.1.0
2024-02-23T23:31:58.265600136Z [2024-02-23 23:31:58 +0000] [16] [INFO] Listening at: http://[::]:8793 (16)
2024-02-23T23:31:58.267117996Z [2024-02-23 23:31:58 +0000] [16] [INFO] Using worker: sync
2024-02-23T23:31:58.322102558Z [2024-02-23 23:31:58 +0000] [17] [INFO] Booting worker with pid: 17
2024-02-23T23:31:58.348040664Z [2024-02-23 23:31:58 +0000] [18] [INFO] Booting worker with pid: 18
2024-02-23T23:31:59.646650381Z  
2024-02-23T23:31:59.646672713Z  -------------- celery@airflow-worker-0 v5.2.7 (dawn-chorus)
2024-02-23T23:31:59.646679178Z --- ***** ----- 
2024-02-23T23:31:59.646683755Z -- ******* ---- Linux-5.15.0-47-generic-x86_64-with-glibc2.31 2024-02-23 23:31:59
2024-02-23T23:31:59.646687885Z - *** --- * --- 
2024-02-23T23:31:59.646692281Z - ** ---------- [config]
2024-02-23T23:31:59.646696702Z - ** ---------- .> app:         airflow.executors.celery_executor:0x7fc2bfca5780
2024-02-23T23:31:59.646700316Z - ** ---------- .> transport:   redis://:**@airflow-redis:6379/0
2024-02-23T23:31:59.646711391Z - ** ---------- .> results:     postgresql://postgres:**@airflow-postgresql.osm:5432/postgres
2024-02-23T23:31:59.646718814Z - *** --- * --- .> concurrency: 16 (prefork)
2024-02-23T23:31:59.646722352Z -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
2024-02-23T23:31:59.646725798Z --- ***** ----- 
2024-02-23T23:31:59.646729461Z  -------------- [queues]
2024-02-23T23:31:59.646732966Z                 .> default          exchange=default(direct) key=default
2024-02-23T23:31:59.646736410Z                 
2024-02-23T23:31:59.646739731Z 
2024-02-23T23:31:59.646743232Z [tasks]
2024-02-23T23:31:59.646746685Z   . airflow.executors.celery_executor.execute_command
2024-02-23T23:31:59.646749905Z 
2024-02-23T23:32:06.667786242Z [2024-02-23 23:32:06,662: INFO/MainProcess] Connected to redis://:**@airflow-redis:6379/0
2024-02-23T23:32:06.690518154Z [2024-02-23 23:32:06,690: INFO/MainProcess] mingle: searching for neighbors
2024-02-23T23:32:07.709940841Z [2024-02-23 23:32:07,709: INFO/MainProcess] mingle: all alone
2024-02-23T23:32:07.729845120Z [2024-02-23 23:32:07,728: INFO/MainProcess] celery@airflow-worker-0 ready.
2024-02-23T23:33:02.280603987Z [2024-02-23 23:33:02,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[283260da-55d7-4d13-9f6f-aad5e7f80398] received
2024-02-23T23:33:02.413902056Z [2024-02-23 23:33:02,401: INFO/ForkPoolWorker-15] [283260da-55d7-4d13-9f6f-aad5e7f80398] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:33:02.889999721Z [2024-02-23 23:33:02,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:33:03.323970319Z [2024-02-23 23:33:03,323: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:33:34.052965457Z [2024-02-23 23:33:34,050: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[283260da-55d7-4d13-9f6f-aad5e7f80398] succeeded in 31.763440357000036s: None
2024-02-23T23:33:44.667107369Z [2024-02-23 23:33:44,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a373325b-c86a-4ae7-83ac-961bf99808c8] received
2024-02-23T23:33:44.685573652Z [2024-02-23 23:33:44,685: INFO/ForkPoolWorker-15] [a373325b-c86a-4ae7-83ac-961bf99808c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:33:44.993024620Z [2024-02-23 23:33:44,989: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:33:45.235985103Z [2024-02-23 23:33:45,235: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:34:07.598920913Z [2024-02-23 23:34:07,598: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a373325b-c86a-4ae7-83ac-961bf99808c8] succeeded in 22.930533079000043s: None
2024-02-23T23:34:09.584673071Z [2024-02-23 23:34:09,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b05cf5c1-59a0-455d-a725-78e60423d14e] received
2024-02-23T23:34:09.599639999Z [2024-02-23 23:34:09,599: INFO/ForkPoolWorker-15] [b05cf5c1-59a0-455d-a725-78e60423d14e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:34:09.985183825Z [2024-02-23 23:34:09,980: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:34:10.214910395Z [2024-02-23 23:34:10,214: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:34:10.753290327Z [2024-02-23 23:34:10,752: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b05cf5c1-59a0-455d-a725-78e60423d14e] succeeded in 1.1665438740000127s: None
2024-02-23T23:36:00.299982733Z [2024-02-23 23:36:00,299: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08e85b4f-05a0-4fdc-a7c2-fc117867b2c1] received
2024-02-23T23:36:00.314875392Z [2024-02-23 23:36:00,314: INFO/ForkPoolWorker-15] [08e85b4f-05a0-4fdc-a7c2-fc117867b2c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:36:00.600062003Z [2024-02-23 23:36:00,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:36:00.865432556Z [2024-02-23 23:36:00,864: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:36:01.569884156Z [2024-02-23 23:36:01,569: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08e85b4f-05a0-4fdc-a7c2-fc117867b2c1] succeeded in 1.2666696899999579s: None
2024-02-23T23:38:00.926684075Z [2024-02-23 23:38:00,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c38d0d0-a5e4-4354-99af-ca57e00575fc] received
2024-02-23T23:38:00.942201736Z [2024-02-23 23:38:00,941: INFO/ForkPoolWorker-15] [3c38d0d0-a5e4-4354-99af-ca57e00575fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:38:01.303538728Z [2024-02-23 23:38:01,300: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:38:01.548251093Z [2024-02-23 23:38:01,547: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:38:02.146349481Z [2024-02-23 23:38:02,145: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3c38d0d0-a5e4-4354-99af-ca57e00575fc] succeeded in 1.2150764059999801s: None
2024-02-23T23:39:11.995758753Z [2024-02-23 23:39:11,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4aaa7833-fc0d-4f6d-95cf-db1931d7de41] received
2024-02-23T23:39:12.009177595Z [2024-02-23 23:39:12,008: INFO/ForkPoolWorker-15] [4aaa7833-fc0d-4f6d-95cf-db1931d7de41] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:39:12.278886220Z [2024-02-23 23:39:12,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:39:12.431723088Z [2024-02-23 23:39:12,431: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-23T23:39:12.435813195Z [2024-02-23 23:39:12,435: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:12.453916315Z [2024-02-23 23:39:12,453: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:39:12.454884639Z [2024-02-23 23:39:12,454: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:39:12.455013118Z [2024-02-23 23:39:12,454: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:39:12.455074451Z [2024-02-23 23:39:12,454: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-23T23:39:12.455279332Z [2024-02-23 23:39:12,455: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:39:12.541718480Z [2024-02-23 23:39:12,541: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:13.140113233Z [2024-02-23 23:39:13,139: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4aaa7833-fc0d-4f6d-95cf-db1931d7de41] succeeded in 1.1416729659999874s: None
2024-02-23T23:39:20.577942463Z [2024-02-23 23:39:20,577: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd73d9f-b49a-4bb5-8932-92d6d198fb3d] received
2024-02-23T23:39:20.587127631Z [2024-02-23 23:39:20,586: INFO/ForkPoolWorker-15] [afd73d9f-b49a-4bb5-8932-92d6d198fb3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:39:20.881718982Z [2024-02-23 23:39:20,877: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:39:22.164304272Z [2024-02-23 23:39:22,163: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:39:22.167371425Z [2024-02-23 23:39:22,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:22.191270020Z [2024-02-23 23:39:22,190: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:39:22.193447406Z [2024-02-23 23:39:22,193: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:22.193461794Z [2024-02-23 23:39:22,193: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:22.193816902Z [2024-02-23 23:39:22,193: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:22.193829037Z [2024-02-23 23:39:22,193: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:39:22.194340269Z [2024-02-23 23:39:22,194: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:39:22.194500651Z [2024-02-23 23:39:22,194: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:22.268217437Z [2024-02-23 23:39:22,267: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:22.920850136Z [2024-02-23 23:39:22,920: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[afd73d9f-b49a-4bb5-8932-92d6d198fb3d] succeeded in 2.3412120790001154s: None
2024-02-23T23:39:23.396139334Z [2024-02-23 23:39:23,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d76d2bc-d6d8-472e-92cb-773c9c3b62e6] received
2024-02-23T23:39:23.421105448Z [2024-02-23 23:39:23,420: INFO/ForkPoolWorker-15] [1d76d2bc-d6d8-472e-92cb-773c9c3b62e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:39:23.758954251Z [2024-02-23 23:39:23,755: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:39:24.652065879Z [2024-02-23 23:39:24,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab5d0ba9-4679-4210-aa5f-f3aa4f612527] received
2024-02-23T23:39:24.748252214Z [2024-02-23 23:39:24,747: INFO/ForkPoolWorker-16] [ab5d0ba9-4679-4210-aa5f-f3aa4f612527] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:39:25.180279777Z [2024-02-23 23:39:25,179: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:39:25.193816106Z [2024-02-23 23:39:25,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:25.220968340Z [2024-02-23 23:39:25,217: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:39:25.277606609Z [2024-02-23 23:39:25,277: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:39:25.279696819Z [2024-02-23 23:39:25,279: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:25.279893340Z [2024-02-23 23:39:25,279: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:25.280169142Z [2024-02-23 23:39:25,279: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:25.280389163Z [2024-02-23 23:39:25,280: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:39:25.281005743Z [2024-02-23 23:39:25,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:39:25.281164784Z [2024-02-23 23:39:25,281: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:25.368553314Z [2024-02-23 23:39:25,368: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:26.252009143Z [2024-02-23 23:39:26,250: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d76d2bc-d6d8-472e-92cb-773c9c3b62e6] succeeded in 2.837969338999983s: None
2024-02-23T23:39:26.780489334Z [2024-02-23 23:39:26,780: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:39:26.783551042Z [2024-02-23 23:39:26,783: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:26.806006980Z [2024-02-23 23:39:26,805: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:39:26.807375768Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:26.807387284Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:26.807541891Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:26.807566631Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:39:26.807802456Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:39:26.807840582Z [2024-02-23 23:39:26,807: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:26.890735988Z [2024-02-23 23:39:26,890: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:27.214684972Z [2024-02-23 23:39:27,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cdff6bec-00b8-48a2-8429-afd5061a2ba9] received
2024-02-23T23:39:27.218695071Z [2024-02-23 23:39:27,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b93b490-130d-4ea8-8f84-691f91d04afe] received
2024-02-23T23:39:27.270125599Z [2024-02-23 23:39:27,269: INFO/ForkPoolWorker-1] [5b93b490-130d-4ea8-8f84-691f91d04afe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:39:27.418611059Z [2024-02-23 23:39:27,418: INFO/ForkPoolWorker-15] [cdff6bec-00b8-48a2-8429-afd5061a2ba9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:39:27.905889400Z [2024-02-23 23:39:27,902: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:39:28.056066048Z [2024-02-23 23:39:28,052: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:39:28.955997995Z [2024-02-23 23:39:28,955: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ab5d0ba9-4679-4210-aa5f-f3aa4f612527] succeeded in 4.293937568000047s: None
2024-02-23T23:39:29.559948429Z [2024-02-23 23:39:29,559: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:39:29.563091648Z [2024-02-23 23:39:29,562: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:29.628006075Z [2024-02-23 23:39:29,627: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:39:29.629536234Z [2024-02-23 23:39:29,629: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:29.629569889Z [2024-02-23 23:39:29,629: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:29.629724568Z [2024-02-23 23:39:29,629: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:29.629794160Z [2024-02-23 23:39:29,629: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:39:29.630154931Z [2024-02-23 23:39:29,630: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:39:29.630201163Z [2024-02-23 23:39:29,630: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:29.718163213Z [2024-02-23 23:39:29,717: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:29.731692693Z [2024-02-23 23:39:29,731: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:39:29.735053045Z [2024-02-23 23:39:29,734: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:29.750310201Z [2024-02-23 23:39:29,750: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:39:29.751473711Z [2024-02-23 23:39:29,751: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:29.751747055Z [2024-02-23 23:39:29,751: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:29.752121039Z [2024-02-23 23:39:29,751: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:29.754372788Z [2024-02-23 23:39:29,754: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:39:29.755079809Z [2024-02-23 23:39:29,754: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:39:29.755264420Z [2024-02-23 23:39:29,755: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:29.836459051Z [2024-02-23 23:39:29,836: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:30.457228141Z [2024-02-23 23:39:30,455: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cdff6bec-00b8-48a2-8429-afd5061a2ba9] succeeded in 3.2172155220000604s: None
2024-02-23T23:39:31.187344119Z [2024-02-23 23:39:31,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99f1247b-800a-4817-ad18-0d8249faf655] received
2024-02-23T23:39:31.226576955Z [2024-02-23 23:39:31,225: INFO/ForkPoolWorker-15] [99f1247b-800a-4817-ad18-0d8249faf655] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:39:31.995279939Z [2024-02-23 23:39:31,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5b93b490-130d-4ea8-8f84-691f91d04afe] succeeded in 4.772415254999942s: None
2024-02-23T23:39:32.106507616Z [2024-02-23 23:39:32,099: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:39:33.993873280Z [2024-02-23 23:39:33,993: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:39:33.997301864Z [2024-02-23 23:39:33,996: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:39:34.021977675Z [2024-02-23 23:39:34,021: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:39:34.023293200Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:39:34.023343636Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:39:34.023499194Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:39:34.023581373Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:39:34.023794091Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:39:34.023812604Z [2024-02-23 23:39:34,023: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:39:34.114628843Z [2024-02-23 23:39:34,114: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:39:34.990222924Z [2024-02-23 23:39:34,989: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[99f1247b-800a-4817-ad18-0d8249faf655] succeeded in 3.7899309300000823s: None
2024-02-23T23:40:00.923121088Z [2024-02-23 23:40:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56ee9bf5-cf7c-46aa-8901-2dbdd345c832] received
2024-02-23T23:40:00.930106786Z [2024-02-23 23:40:00,929: INFO/ForkPoolWorker-15] [56ee9bf5-cf7c-46aa-8901-2dbdd345c832] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:00.930893388Z [2024-02-23 23:40:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25f7fba6-8c2c-4c0e-b207-1f080a9ad094] received
2024-02-23T23:40:00.933715272Z [2024-02-23 23:40:00,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e76243b1-6314-4662-a3b8-b46566206121] received
2024-02-23T23:40:00.938447863Z [2024-02-23 23:40:00,938: INFO/ForkPoolWorker-16] [25f7fba6-8c2c-4c0e-b207-1f080a9ad094] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:40:00.940031998Z [2024-02-23 23:40:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75121f84-38d5-44df-91ea-013937a88074] received
2024-02-23T23:40:00.942243964Z [2024-02-23 23:40:00,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9913a1a-ff13-4b00-8c03-87271f1d4395] received
2024-02-23T23:40:00.970700710Z [2024-02-23 23:40:00,970: INFO/ForkPoolWorker-1] [e76243b1-6314-4662-a3b8-b46566206121] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:40:01.006494234Z [2024-02-23 23:40:01,006: INFO/ForkPoolWorker-3] [d9913a1a-ff13-4b00-8c03-87271f1d4395] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:40:01.030554695Z [2024-02-23 23:40:01,030: INFO/ForkPoolWorker-2] [75121f84-38d5-44df-91ea-013937a88074] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:40:01.270139036Z [2024-02-23 23:40:01,263: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:01.337119783Z [2024-02-23 23:40:01,334: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:40:01.564517112Z [2024-02-23 23:40:01,556: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:40:01.571102629Z [2024-02-23 23:40:01,567: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:40:01.745366617Z [2024-02-23 23:40:01,745: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:01.799635089Z [2024-02-23 23:40:01,789: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:40:02.078827297Z [2024-02-23 23:40:02,078: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:40:02.089235009Z [2024-02-23 23:40:02,088: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:02.139481119Z [2024-02-23 23:40:02,139: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:40:02.144810295Z [2024-02-23 23:40:02,144: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:40:02.144840249Z [2024-02-23 23:40:02,144: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:40:02.144878656Z [2024-02-23 23:40:02,144: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:40:02.145075255Z [2024-02-23 23:40:02,144: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:40:02.294404444Z [2024-02-23 23:40:02,294: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:02.474501695Z [2024-02-23 23:40:02,474: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25f7fba6-8c2c-4c0e-b207-1f080a9ad094] succeeded in 1.5417409829999542s: None
2024-02-23T23:40:03.084711208Z [2024-02-23 23:40:03,084: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:03.088144804Z [2024-02-23 23:40:03,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:03.139677930Z [2024-02-23 23:40:03,139: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:03.140982922Z [2024-02-23 23:40:03,140: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:03.141002095Z [2024-02-23 23:40:03,140: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:03.141254892Z [2024-02-23 23:40:03,141: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:03.141333483Z [2024-02-23 23:40:03,141: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:03.141764036Z [2024-02-23 23:40:03,141: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:03.141787359Z [2024-02-23 23:40:03,141: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:03.155329585Z [2024-02-23 23:40:03,154: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[75121f84-38d5-44df-91ea-013937a88074] succeeded in 2.212723872999959s: None
2024-02-23T23:40:03.234241404Z [2024-02-23 23:40:03,233: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:03.240785427Z [2024-02-23 23:40:03,240: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:40:03.248136896Z [2024-02-23 23:40:03,247: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:03.283014846Z [2024-02-23 23:40:03,282: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:40:03.284336705Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:03.284359570Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:03.284530029Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:03.284565263Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:40:03.284830182Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:40:03.285350843Z [2024-02-23 23:40:03,284: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:03.342262023Z [2024-02-23 23:40:03,341: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:40:03.346341340Z [2024-02-23 23:40:03,345: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:03.373565020Z [2024-02-23 23:40:03,373: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:03.375688999Z [2024-02-23 23:40:03,375: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:40:03.377368317Z [2024-02-23 23:40:03,377: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:03.377543290Z [2024-02-23 23:40:03,377: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:03.377726415Z [2024-02-23 23:40:03,377: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:03.377858658Z [2024-02-23 23:40:03,377: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:40:03.378219916Z [2024-02-23 23:40:03,378: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:40:03.378329346Z [2024-02-23 23:40:03,378: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:03.461822833Z [2024-02-23 23:40:03,461: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:03.877948266Z [2024-02-23 23:40:03,876: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56ee9bf5-cf7c-46aa-8901-2dbdd345c832] succeeded in 2.9520797850000235s: None
2024-02-23T23:40:04.302767361Z [2024-02-23 23:40:04,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1c3e9b4-5ec3-4835-a7a3-aa18df7a7e67] received
2024-02-23T23:40:04.311189714Z [2024-02-23 23:40:04,310: INFO/ForkPoolWorker-15] [d1c3e9b4-5ec3-4835-a7a3-aa18df7a7e67] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:04.585144744Z [2024-02-23 23:40:04,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:04.966783759Z [2024-02-23 23:40:04,966: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e76243b1-6314-4662-a3b8-b46566206121] succeeded in 4.030741294999871s: None
2024-02-23T23:40:05.785320729Z [2024-02-23 23:40:05,784: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[d9913a1a-ff13-4b00-8c03-87271f1d4395] succeeded in 4.826131712999995s: None
2024-02-23T23:40:05.972899935Z [2024-02-23 23:40:05,972: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:05.976819178Z [2024-02-23 23:40:05,976: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:06.025258124Z [2024-02-23 23:40:06,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:06.039381045Z [2024-02-23 23:40:06,039: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:06.039609502Z [2024-02-23 23:40:06,039: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:06.039959173Z [2024-02-23 23:40:06,039: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:06.040311273Z [2024-02-23 23:40:06,040: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:06.040776989Z [2024-02-23 23:40:06,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:06.041010493Z [2024-02-23 23:40:06,040: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:06.152043902Z [2024-02-23 23:40:06,151: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:07.096168594Z [2024-02-23 23:40:07,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf65d476-6c68-4c05-b020-6a12d5284918] received
2024-02-23T23:40:07.117381618Z [2024-02-23 23:40:07,116: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d1c3e9b4-5ec3-4835-a7a3-aa18df7a7e67] succeeded in 2.8105905750001057s: None
2024-02-23T23:40:07.133818678Z [2024-02-23 23:40:07,133: INFO/ForkPoolWorker-16] [cf65d476-6c68-4c05-b020-6a12d5284918] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:40:07.554817009Z [2024-02-23 23:40:07,551: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:09.054509863Z [2024-02-23 23:40:09,054: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:40:09.057969272Z [2024-02-23 23:40:09,057: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:09.080766596Z [2024-02-23 23:40:09,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:40:09.083126776Z [2024-02-23 23:40:09,082: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:09.083239143Z [2024-02-23 23:40:09,083: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:09.083447741Z [2024-02-23 23:40:09,083: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:09.083554605Z [2024-02-23 23:40:09,083: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:40:09.084067984Z [2024-02-23 23:40:09,083: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:09.084428719Z [2024-02-23 23:40:09,084: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:09.250960518Z [2024-02-23 23:40:09,250: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:09.929930758Z [2024-02-23 23:40:09,929: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[cf65d476-6c68-4c05-b020-6a12d5284918] succeeded in 2.830534071000102s: None
2024-02-23T23:40:10.699726475Z [2024-02-23 23:40:10,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51e650d0-554e-40d1-9a12-e8753245bdd1] received
2024-02-23T23:40:10.712156104Z [2024-02-23 23:40:10,711: INFO/ForkPoolWorker-15] [51e650d0-554e-40d1-9a12-e8753245bdd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:11.036052214Z [2024-02-23 23:40:11,030: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:12.357730240Z [2024-02-23 23:40:12,357: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:12.365928290Z [2024-02-23 23:40:12,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:12.433475092Z [2024-02-23 23:40:12,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:12.443094720Z [2024-02-23 23:40:12,442: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:12.443124754Z [2024-02-23 23:40:12,442: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:12.443186163Z [2024-02-23 23:40:12,443: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:40:12.443198672Z [2024-02-23 23:40:12,443: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:12.443462085Z [2024-02-23 23:40:12,443: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:12.443512399Z [2024-02-23 23:40:12,443: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:12.572373600Z [2024-02-23 23:40:12,572: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:13.304170120Z [2024-02-23 23:40:13,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[51e650d0-554e-40d1-9a12-e8753245bdd1] succeeded in 2.5999906060001194s: None
2024-02-23T23:40:23.383508280Z [2024-02-23 23:40:23,383: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[861902a8-5521-4ae6-8e24-95683593f67c] received
2024-02-23T23:40:23.393185291Z [2024-02-23 23:40:23,392: INFO/ForkPoolWorker-15] [861902a8-5521-4ae6-8e24-95683593f67c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:23.755684702Z [2024-02-23 23:40:23,752: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:24.802779563Z [2024-02-23 23:40:24,802: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:24.806091036Z [2024-02-23 23:40:24,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:24.831343575Z [2024-02-23 23:40:24,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:24.833009723Z [2024-02-23 23:40:24,832: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:24.833055105Z [2024-02-23 23:40:24,832: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:24.833144948Z [2024-02-23 23:40:24,832: INFO/ForkPoolWorker-15] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:24.833343837Z [2024-02-23 23:40:24,833: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:24.833395286Z [2024-02-23 23:40:24,833: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:24.833736268Z [2024-02-23 23:40:24,833: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:24.833894570Z [2024-02-23 23:40:24,833: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:24.841472556Z [2024-02-23 23:40:24,841: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:24.930040658Z [2024-02-23 23:40:24,929: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.extract_metrics_from_vnfrs scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:25.599441497Z [2024-02-23 23:40:25,598: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[861902a8-5521-4ae6-8e24-95683593f67c] succeeded in 2.2134062830000403s: None
2024-02-23T23:40:25.702664305Z [2024-02-23 23:40:25,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8e51842-a63b-44e4-ab73-28eb14330d3b] received
2024-02-23T23:40:25.711038769Z [2024-02-23 23:40:25,710: INFO/ForkPoolWorker-15] [c8e51842-a63b-44e4-ab73-28eb14330d3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'split_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:25.979076523Z [2024-02-23 23:40:25,976: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:27.010472872Z [2024-02-23 23:40:27,010: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:27.013695175Z [2024-02-23 23:40:27,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:27.041695518Z [2024-02-23 23:40:27,041: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:27.043178751Z [2024-02-23 23:40:27,042: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:27.043298421Z [2024-02-23 23:40:27,043: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:27.043447194Z [2024-02-23 23:40:27,043: INFO/ForkPoolWorker-15] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:27.043720553Z [2024-02-23 23:40:27,043: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:27.043869414Z [2024-02-23 23:40:27,043: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:27.044342591Z [2024-02-23 23:40:27,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:27.044356394Z [2024-02-23 23:40:27,044: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:27.050455014Z [2024-02-23 23:40:27,050: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:27.114945116Z [2024-02-23 23:40:27,114: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.split_metrics scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:27.708707968Z [2024-02-23 23:40:27,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b364c222-9683-4722-8aa8-9c05d275be15] received
2024-02-23T23:40:27.729102127Z [2024-02-23 23:40:27,728: INFO/ForkPoolWorker-16] [b364c222-9683-4722-8aa8-9c05d275be15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'collect_metrics', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:40:27.775943457Z [2024-02-23 23:40:27,775: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c8e51842-a63b-44e4-ab73-28eb14330d3b] succeeded in 2.071626038999966s: None
2024-02-23T23:40:27.857705365Z [2024-02-23 23:40:27,857: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08aeb832-4831-4a2d-ab94-6ab769fdb039] received
2024-02-23T23:40:27.869473740Z [2024-02-23 23:40:27,869: INFO/ForkPoolWorker-15] [08aeb832-4831-4a2d-ab94-6ab769fdb039] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:40:28.039868946Z [2024-02-23 23:40:28,036: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:28.138956594Z [2024-02-23 23:40:28,135: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:40:29.122369181Z [2024-02-23 23:40:29,121: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:40:29.125657375Z [2024-02-23 23:40:29,125: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:29.143835111Z [2024-02-23 23:40:29,143: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:40:29.145039704Z [2024-02-23 23:40:29,144: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:29.145139267Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:29.145234736Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:29.145378742Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:29.145471705Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:40:29.145757711Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:29.145911547Z [2024-02-23 23:40:29,145: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:29.152710052Z [2024-02-23 23:40:29,152: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:29.245078121Z [2024-02-23 23:40:29,244: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.collect_metrics scheduled__2024-02-23T23:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:29.253205478Z [2024-02-23 23:40:29,252: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:40:29.256580672Z [2024-02-23 23:40:29,256: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:29.275928216Z [2024-02-23 23:40:29,275: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:40:29.277049561Z [2024-02-23 23:40:29,276: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:29.277163599Z [2024-02-23 23:40:29,276: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:29.277255007Z [2024-02-23 23:40:29,277: INFO/ForkPoolWorker-15] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:29.277420397Z [2024-02-23 23:40:29,277: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:29.277555947Z [2024-02-23 23:40:29,277: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:40:29.277810047Z [2024-02-23 23:40:29,277: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:40:29.277912498Z [2024-02-23 23:40:29,277: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:29.282237718Z [2024-02-23 23:40:29,281: INFO/ForkPoolWorker-15] Creating DAG vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:29.350744012Z [2024-02-23 23:40:29,350: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:29.765109180Z [2024-02-23 23:40:29,764: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b364c222-9683-4722-8aa8-9c05d275be15] succeeded in 2.0526901979999366s: None
2024-02-23T23:40:30.265378861Z [2024-02-23 23:40:30,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[552c2d44-a335-4604-94ea-4ce60bff28e7] received
2024-02-23T23:40:30.271304318Z [2024-02-23 23:40:30,271: INFO/ForkPoolWorker-16] [552c2d44-a335-4604-94ea-4ce60bff28e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'send_prometheus', 'scheduled__2024-02-23T23:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:40:30.274041418Z [2024-02-23 23:40:30,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[225124e7-38d4-416a-a628-47c0b2c465f8] received
2024-02-23T23:40:30.285256030Z [2024-02-23 23:40:30,284: INFO/ForkPoolWorker-1] [225124e7-38d4-416a-a628-47c0b2c465f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:40:30.547524919Z [2024-02-23 23:40:30,544: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:40:30.574433444Z [2024-02-23 23:40:30,571: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:40:30.716949574Z [2024-02-23 23:40:30,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[08aeb832-4831-4a2d-ab94-6ab769fdb039] succeeded in 2.8557507349999014s: None
2024-02-23T23:40:31.950043422Z [2024-02-23 23:40:31,949: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:40:31.953721441Z [2024-02-23 23:40:31,952: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:31.976478283Z [2024-02-23 23:40:31,976: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:40:31.977716890Z [2024-02-23 23:40:31,977: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:31.977926511Z [2024-02-23 23:40:31,977: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:31.978034425Z [2024-02-23 23:40:31,977: INFO/ForkPoolWorker-1] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:31.978221089Z [2024-02-23 23:40:31,978: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:31.978342722Z [2024-02-23 23:40:31,978: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:40:31.978830764Z [2024-02-23 23:40:31,978: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:40:31.978896028Z [2024-02-23 23:40:31,978: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:31.984127323Z [2024-02-23 23:40:31,983: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:32.044969067Z [2024-02-23 23:40:32,044: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:40:32.048029977Z [2024-02-23 23:40:32,047: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:40:32.067085232Z [2024-02-23 23:40:32,066: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:32.078460172Z [2024-02-23 23:40:32,078: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:40:32.079615546Z [2024-02-23 23:40:32,079: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:40:32.079712137Z [2024-02-23 23:40:32,079: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:40:32.079827602Z [2024-02-23 23:40:32,079: INFO/ForkPoolWorker-16] Read VIM 004f77f4-8a7b-4f78-acfd-21ab376b412d (basic01_357750)
2024-02-23T23:40:32.079982153Z [2024-02-23 23:40:32,079: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '004f77f4-8a7b-4f78-acfd-21ab376b412d', 'name': 'basic01_357750', 'vim_type': 'openstack'}]
2024-02-23T23:40:32.080045918Z [2024-02-23 23:40:32,079: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:40:32.080350414Z [2024-02-23 23:40:32,080: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:40:32.080433749Z [2024-02-23 23:40:32,080: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:40:32.086205347Z [2024-02-23 23:40:32,086: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d
2024-02-23T23:40:32.159048756Z [2024-02-23 23:40:32,158: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d.send_prometheus scheduled__2024-02-23T23:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:40:32.847250134Z [2024-02-23 23:40:32,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[552c2d44-a335-4604-94ea-4ce60bff28e7] succeeded in 2.580586198999981s: None
2024-02-23T23:40:34.110070582Z [2024-02-23 23:40:34,109: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[225124e7-38d4-416a-a628-47c0b2c465f8] succeeded in 3.8335912730001382s: None
2024-02-23T23:40:59.405173075Z [2024-02-23 23:40:59,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4f88274-e6ad-4f45-b65f-c2864c3f0e21] received
2024-02-23T23:40:59.417247456Z [2024-02-23 23:40:59,416: INFO/ForkPoolWorker-15] [f4f88274-e6ad-4f45-b65f-c2864c3f0e21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:40:59.695230701Z [2024-02-23 23:40:59,692: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:00.724089888Z [2024-02-23 23:41:00,723: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:41:00.728594507Z [2024-02-23 23:41:00,728: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:00.770494197Z [2024-02-23 23:41:00,770: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:41:00.774660933Z [2024-02-23 23:41:00,774: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:00.774687793Z [2024-02-23 23:41:00,774: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:00.774692885Z [2024-02-23 23:41:00,774: INFO/ForkPoolWorker-15] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:00.775761606Z [2024-02-23 23:41:00,774: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:00.775792368Z [2024-02-23 23:41:00,774: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:41:00.775802285Z [2024-02-23 23:41:00,775: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:00.775809213Z [2024-02-23 23:41:00,775: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:00.798758621Z [2024-02-23 23:41:00,797: INFO/ForkPoolWorker-15] Creating DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:00.911725315Z [2024-02-23 23:41:00,911: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:01.084680791Z [2024-02-23 23:41:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8078558-df5b-435b-a686-c34a641958ec] received
2024-02-23T23:41:01.088658697Z [2024-02-23 23:41:01,088: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cff661a3-589e-405d-97ff-5a9c48cfdcde] received
2024-02-23T23:41:01.097445237Z [2024-02-23 23:41:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6d67d4b-46d7-489a-b742-47347249e79c] received
2024-02-23T23:41:01.100665382Z [2024-02-23 23:41:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a10b438f-37a0-40cd-b529-1ad3d8eeec9a] received
2024-02-23T23:41:01.106459840Z [2024-02-23 23:41:01,106: INFO/ForkPoolWorker-2] [b6d67d4b-46d7-489a-b742-47347249e79c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:41:01.106930580Z [2024-02-23 23:41:01,106: INFO/ForkPoolWorker-16] [e8078558-df5b-435b-a686-c34a641958ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:41:01.111887376Z [2024-02-23 23:41:01,111: INFO/ForkPoolWorker-3] [a10b438f-37a0-40cd-b529-1ad3d8eeec9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:41:01.112066262Z [2024-02-23 23:41:01,105: INFO/ForkPoolWorker-1] [cff661a3-589e-405d-97ff-5a9c48cfdcde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:41:01.130393025Z [2024-02-23 23:41:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be6d2bf5-d36d-4e4b-8c84-7b27d317737a] received
2024-02-23T23:41:01.134515413Z [2024-02-23 23:41:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a54950ef-a2d1-4acb-8843-9e9552dde967] received
2024-02-23T23:41:01.195072363Z [2024-02-23 23:41:01,194: INFO/ForkPoolWorker-4] [be6d2bf5-d36d-4e4b-8c84-7b27d317737a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:41:01.331271434Z [2024-02-23 23:41:01,330: INFO/ForkPoolWorker-5] [a54950ef-a2d1-4acb-8843-9e9552dde967] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:41:01.710852989Z [2024-02-23 23:41:01,707: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:01.868271697Z [2024-02-23 23:41:01,864: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:41:01.961075560Z [2024-02-23 23:41:01,949: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:02.031239071Z [2024-02-23 23:41:02,030: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-23T23:41:02.035072080Z [2024-02-23 23:41:02,034: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:02.078820991Z [2024-02-23 23:41:02,078: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:41:02.084576997Z [2024-02-23 23:41:02,084: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:41:02.084611057Z [2024-02-23 23:41:02,084: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:41:02.084681760Z [2024-02-23 23:41:02,084: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-23T23:41:02.084914385Z [2024-02-23 23:41:02,084: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:41:02.137109866Z [2024-02-23 23:41:02,133: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:02.209019759Z [2024-02-23 23:41:02,208: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:02.223887524Z [2024-02-23 23:41:02,219: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:02.323259649Z [2024-02-23 23:41:02,304: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:03.089712692Z [2024-02-23 23:41:03,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f4f88274-e6ad-4f45-b65f-c2864c3f0e21] succeeded in 3.6810117309998986s: None
2024-02-23T23:41:03.151579258Z [2024-02-23 23:41:03,151: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[a10b438f-37a0-40cd-b529-1ad3d8eeec9a] succeeded in 2.048981170000161s: None
2024-02-23T23:41:03.286442526Z [2024-02-23 23:41:03,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ecaac7e-8cee-4104-a66d-46a2ef40ecc8] received
2024-02-23T23:41:03.299225513Z [2024-02-23 23:41:03,298: INFO/ForkPoolWorker-15] [9ecaac7e-8cee-4104-a66d-46a2ef40ecc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:41:03.675598623Z [2024-02-23 23:41:03,671: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:04.231050220Z [2024-02-23 23:41:04,230: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:41:04.234981453Z [2024-02-23 23:41:04,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.286933665Z [2024-02-23 23:41:04,286: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:41:04.288283645Z [2024-02-23 23:41:04,287: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:41:04.289330004Z [2024-02-23 23:41:04,289: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.290598209Z [2024-02-23 23:41:04,289: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.291176863Z [2024-02-23 23:41:04,290: INFO/ForkPoolWorker-1] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.291485464Z [2024-02-23 23:41:04,291: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.291646563Z [2024-02-23 23:41:04,291: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:41:04.291964216Z [2024-02-23 23:41:04,291: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:04.292352626Z [2024-02-23 23:41:04,292: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.292468402Z [2024-02-23 23:41:04,291: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.298516914Z [2024-02-23 23:41:04,298: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.304507673Z [2024-02-23 23:41:04,304: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:04.306230014Z [2024-02-23 23:41:04,305: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:04.307420378Z [2024-02-23 23:41:04,307: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:41:04.310243589Z [2024-02-23 23:41:04,309: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.326971902Z [2024-02-23 23:41:04,326: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:41:04.331694361Z [2024-02-23 23:41:04,331: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.342232607Z [2024-02-23 23:41:04,341: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:41:04.346176927Z [2024-02-23 23:41:04,345: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.346392858Z [2024-02-23 23:41:04,346: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.346647184Z [2024-02-23 23:41:04,346: INFO/ForkPoolWorker-1] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.346958105Z [2024-02-23 23:41:04,346: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.347109694Z [2024-02-23 23:41:04,346: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:41:04.347452384Z [2024-02-23 23:41:04,347: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:04.347651858Z [2024-02-23 23:41:04,347: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.350031123Z [2024-02-23 23:41:04,349: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.355988708Z [2024-02-23 23:41:04,355: ERROR/ForkPoolWorker-1] [cff661a3-589e-405d-97ff-5a9c48cfdcde] Failed to execute task Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:41:04.356046980Z Traceback (most recent call last):
2024-02-23T23:41:04.356062165Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:41:04.356066733Z     args.func(args)
2024-02-23T23:41:04.356070805Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:41:04.356075392Z     return func(*args, **kwargs)
2024-02-23T23:41:04.356091670Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:41:04.356094766Z     return f(*args, **kwargs)
2024-02-23T23:41:04.356097947Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:41:04.356101040Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:41:04.356104133Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:41:04.356107142Z     raise AirflowException(
2024-02-23T23:41:04.356117704Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:41:04.369630652Z [2024-02-23 23:41:04,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:41:04.369664802Z [2024-02-23 23:41:04,367: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.369669315Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.369672952Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.369676658Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.369680605Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:41:04.369683710Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:04.369686757Z [2024-02-23 23:41:04,368: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.373556676Z [2024-02-23 23:41:04,373: INFO/ForkPoolWorker-16] Creating DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.377744498Z [2024-02-23 23:41:04,377: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:41:04.384072086Z [2024-02-23 23:41:04,382: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.384108021Z [2024-02-23 23:41:04,383: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.384111736Z [2024-02-23 23:41:04,383: INFO/ForkPoolWorker-2] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.384117405Z [2024-02-23 23:41:04,383: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.384121299Z [2024-02-23 23:41:04,383: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:41:04.384124960Z [2024-02-23 23:41:04,383: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:04.384298517Z [2024-02-23 23:41:04,384: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.388626813Z [2024-02-23 23:41:04,388: INFO/ForkPoolWorker-2] Creating DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.411166136Z [2024-02-23 23:41:04,410: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cff661a3-589e-405d-97ff-5a9c48cfdcde] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cff661a3-589e-405d-97ff-5a9c48cfdcde')
2024-02-23T23:41:04.411200474Z Traceback (most recent call last):
2024-02-23T23:41:04.411204859Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:41:04.411207950Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:41:04.411211066Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:41:04.411214055Z     return self.run(*args, **kwargs)
2024-02-23T23:41:04.411217684Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:41:04.411221311Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:41:04.411224312Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:41:04.411227905Z     raise AirflowException(msg)
2024-02-23T23:41:04.411231630Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cff661a3-589e-405d-97ff-5a9c48cfdcde
2024-02-23T23:41:04.442507756Z [2024-02-23 23:41:04,441: INFO/ForkPoolWorker-5] Getting VIM list
2024-02-23T23:41:04.448278859Z [2024-02-23 23:41:04,447: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.471054089Z [2024-02-23 23:41:04,470: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-23T23:41:04.479011546Z [2024-02-23 23:41:04,478: INFO/ForkPoolWorker-5] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.479069521Z [2024-02-23 23:41:04,478: INFO/ForkPoolWorker-5] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.479156244Z [2024-02-23 23:41:04,479: INFO/ForkPoolWorker-5] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.479314349Z [2024-02-23 23:41:04,479: INFO/ForkPoolWorker-5] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.479423431Z [2024-02-23 23:41:04,479: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-02-23T23:41:04.479653285Z [2024-02-23 23:41:04,479: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:04.479748906Z [2024-02-23 23:41:04,479: INFO/ForkPoolWorker-5] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.486555102Z [2024-02-23 23:41:04,486: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:04.486852235Z [2024-02-23 23:41:04,486: INFO/ForkPoolWorker-5] Creating DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.491509060Z [2024-02-23 23:41:04,491: WARNING/ForkPoolWorker-5] Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:04.493079082Z [2024-02-23 23:41:04,492: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:04.494232490Z [2024-02-23 23:41:04,494: INFO/ForkPoolWorker-5] Getting VIM list
2024-02-23T23:41:04.499398062Z [2024-02-23 23:41:04,499: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.515932624Z [2024-02-23 23:41:04,515: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:04.532816208Z [2024-02-23 23:41:04,532: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-23T23:41:04.535019095Z [2024-02-23 23:41:04,534: INFO/ForkPoolWorker-5] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.535175447Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.535291074Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.535450549Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.535524835Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-02-23T23:41:04.535788246Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:04.535924374Z [2024-02-23 23:41:04,535: INFO/ForkPoolWorker-5] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.538268178Z [2024-02-23 23:41:04,538: INFO/ForkPoolWorker-5] Creating DAG vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:04.541922666Z [2024-02-23 23:41:04,541: ERROR/ForkPoolWorker-5] [a54950ef-a2d1-4acb-8843-9e9552dde967] Failed to execute task Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:41:04.541937609Z Traceback (most recent call last):
2024-02-23T23:41:04.541942098Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:41:04.541946054Z     args.func(args)
2024-02-23T23:41:04.541949922Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:41:04.541953529Z     return func(*args, **kwargs)
2024-02-23T23:41:04.541956558Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:41:04.541962234Z     return f(*args, **kwargs)
2024-02-23T23:41:04.541965599Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:41:04.541968633Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:41:04.541971645Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:41:04.541974591Z     raise AirflowException(
2024-02-23T23:41:04.541978421Z airflow.exceptions.AirflowException: Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:41:04.593143219Z [2024-02-23 23:41:04,592: ERROR/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[a54950ef-a2d1-4acb-8843-9e9552dde967] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a54950ef-a2d1-4acb-8843-9e9552dde967')
2024-02-23T23:41:04.593169279Z Traceback (most recent call last):
2024-02-23T23:41:04.593173329Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:41:04.593176466Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:41:04.593179856Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:41:04.593182883Z     return self.run(*args, **kwargs)
2024-02-23T23:41:04.593188327Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:41:04.593193518Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:41:04.593196587Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:41:04.593201089Z     raise AirflowException(msg)
2024-02-23T23:41:04.593205288Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id a54950ef-a2d1-4acb-8843-9e9552dde967
2024-02-23T23:41:04.868503839Z [2024-02-23 23:41:04,868: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-23T23:41:04.871986590Z [2024-02-23 23:41:04,871: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:04.911634883Z [2024-02-23 23:41:04,910: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-23T23:41:04.917310713Z [2024-02-23 23:41:04,917: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:04.919183614Z [2024-02-23 23:41:04,917: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:04.919205958Z [2024-02-23 23:41:04,919: INFO/ForkPoolWorker-4] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:04.919354449Z [2024-02-23 23:41:04,919: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:04.919402689Z [2024-02-23 23:41:04,919: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-23T23:41:04.919678345Z [2024-02-23 23:41:04,919: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:04.919731321Z [2024-02-23 23:41:04,919: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:04.932644775Z [2024-02-23 23:41:04,931: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:05.073804961Z [2024-02-23 23:41:05,073: INFO/ForkPoolWorker-4] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:05.349158365Z [2024-02-23 23:41:05,348: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:41:05.352451390Z [2024-02-23 23:41:05,352: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:05.367449909Z [2024-02-23 23:41:05,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:41:05.368595467Z [2024-02-23 23:41:05,368: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:05.368604145Z [2024-02-23 23:41:05,368: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:05.368665000Z [2024-02-23 23:41:05,368: INFO/ForkPoolWorker-15] Read VIM 282b6020-99a0-40a4-9c13-8a3b2a54ca96 (basic01_120549)
2024-02-23T23:41:05.368785871Z [2024-02-23 23:41:05,368: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'name': 'basic01_120549', 'vim_type': 'openstack'}]
2024-02-23T23:41:05.368821567Z [2024-02-23 23:41:05,368: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:41:05.369374565Z [2024-02-23 23:41:05,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:05.369392177Z [2024-02-23 23:41:05,369: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:05.373751508Z [2024-02-23 23:41:05,373: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96
2024-02-23T23:41:05.449227495Z [2024-02-23 23:41:05,448: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:41:06.458415696Z [2024-02-23 23:41:06,457: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8078558-df5b-435b-a686-c34a641958ec] succeeded in 5.37158015s: None
2024-02-23T23:41:06.485502437Z [2024-02-23 23:41:06,484: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b6d67d4b-46d7-489a-b742-47347249e79c] succeeded in 5.38570925199997s: None
2024-02-23T23:41:06.910877929Z [2024-02-23 23:41:06,910: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[be6d2bf5-d36d-4e4b-8c84-7b27d317737a] succeeded in 5.775568559000021s: None
2024-02-23T23:41:07.286613087Z [2024-02-23 23:41:07,285: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ecaac7e-8cee-4104-a66d-46a2ef40ecc8] succeeded in 3.9982411830001183s: None
2024-02-23T23:41:16.148691467Z [2024-02-23 23:41:16,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47672aff-17db-4fde-bb43-ec31950ecfb0] received
2024-02-23T23:41:16.152377483Z [2024-02-23 23:41:16,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58563c68-3938-4a89-8930-37be023c299c] received
2024-02-23T23:41:16.158245752Z [2024-02-23 23:41:16,157: INFO/ForkPoolWorker-16] [58563c68-3938-4a89-8930-37be023c299c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:41:16.166701461Z [2024-02-23 23:41:16,166: INFO/ForkPoolWorker-15] [47672aff-17db-4fde-bb43-ec31950ecfb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:41:16.418392473Z [2024-02-23 23:41:16,415: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:16.468129789Z [2024-02-23 23:41:16,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:17.452619092Z [2024-02-23 23:41:17,452: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:41:17.455806981Z [2024-02-23 23:41:17,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:17.477072917Z [2024-02-23 23:41:17,476: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:41:17.478573784Z [2024-02-23 23:41:17,478: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:17.478628030Z [2024-02-23 23:41:17,478: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:17.478879520Z [2024-02-23 23:41:17,478: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:41:17.478929372Z [2024-02-23 23:41:17,478: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:41:17.479264821Z [2024-02-23 23:41:17,479: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:17.479308745Z [2024-02-23 23:41:17,479: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:17.486106885Z [2024-02-23 23:41:17,485: WARNING/ForkPoolWorker-16] Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:17.486894924Z [2024-02-23 23:41:17,486: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:41:17.487619882Z [2024-02-23 23:41:17,487: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:41:17.490012169Z [2024-02-23 23:41:17,489: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:17.505121719Z [2024-02-23 23:41:17,504: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:41:17.506867371Z [2024-02-23 23:41:17,506: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:17.507566589Z [2024-02-23 23:41:17,507: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:17.507766379Z [2024-02-23 23:41:17,507: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:41:17.507845369Z [2024-02-23 23:41:17,507: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:41:17.508230688Z [2024-02-23 23:41:17,507: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:41:17.508250422Z [2024-02-23 23:41:17,508: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:17.512195097Z [2024-02-23 23:41:17,511: ERROR/ForkPoolWorker-16] [58563c68-3938-4a89-8930-37be023c299c] Failed to execute task Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:41:17.512236557Z Traceback (most recent call last):
2024-02-23T23:41:17.512248689Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:41:17.512257799Z     args.func(args)
2024-02-23T23:41:17.512267048Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:41:17.512278309Z     return func(*args, **kwargs)
2024-02-23T23:41:17.512286534Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:41:17.512295082Z     return f(*args, **kwargs)
2024-02-23T23:41:17.512303314Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:41:17.512311801Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:41:17.512320012Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:41:17.512328687Z     raise AirflowException(
2024-02-23T23:41:17.512337870Z airflow.exceptions.AirflowException: Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:41:17.548958042Z [2024-02-23 23:41:17,548: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:41:17.552336772Z [2024-02-23 23:41:17,551: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:17.557080736Z [2024-02-23 23:41:17,556: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[58563c68-3938-4a89-8930-37be023c299c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 58563c68-3938-4a89-8930-37be023c299c')
2024-02-23T23:41:17.557095419Z Traceback (most recent call last):
2024-02-23T23:41:17.557099525Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:41:17.557102528Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:41:17.557105598Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:41:17.557108706Z     return self.run(*args, **kwargs)
2024-02-23T23:41:17.557112468Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:41:17.557119209Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:41:17.557122202Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:41:17.557126205Z     raise AirflowException(msg)
2024-02-23T23:41:17.557129853Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 58563c68-3938-4a89-8930-37be023c299c
2024-02-23T23:41:17.577129559Z [2024-02-23 23:41:17,576: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:41:17.578405909Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:17.578417331Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:17.578559303Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:41:17.578567242Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:41:17.578891750Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:17.578925331Z [2024-02-23 23:41:17,578: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:17.589195726Z [2024-02-23 23:41:17,588: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:17.590012474Z [2024-02-23 23:41:17,589: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:41:17.590760702Z [2024-02-23 23:41:17,590: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:41:17.593173006Z [2024-02-23 23:41:17,592: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:41:17.606871506Z [2024-02-23 23:41:17,606: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:41:17.608219811Z [2024-02-23 23:41:17,607: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:41:17.608233007Z [2024-02-23 23:41:17,608: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:41:17.608377328Z [2024-02-23 23:41:17,608: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:41:17.608429441Z [2024-02-23 23:41:17,608: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:41:17.608774445Z [2024-02-23 23:41:17,608: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:41:17.608787055Z [2024-02-23 23:41:17,608: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:41:17.612699053Z [2024-02-23 23:41:17,612: ERROR/ForkPoolWorker-15] [47672aff-17db-4fde-bb43-ec31950ecfb0] Failed to execute task Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:41:17.612709682Z Traceback (most recent call last):
2024-02-23T23:41:17.612713917Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:41:17.612721309Z     args.func(args)
2024-02-23T23:41:17.612725003Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:41:17.612728752Z     return func(*args, **kwargs)
2024-02-23T23:41:17.612731857Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:41:17.612735028Z     return f(*args, **kwargs)
2024-02-23T23:41:17.612738156Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:41:17.612753577Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:41:17.612757053Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:41:17.612760033Z     raise AirflowException(
2024-02-23T23:41:17.612763711Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:41:17.663982819Z [2024-02-23 23:41:17,663: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47672aff-17db-4fde-bb43-ec31950ecfb0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 47672aff-17db-4fde-bb43-ec31950ecfb0')
2024-02-23T23:41:17.664001370Z Traceback (most recent call last):
2024-02-23T23:41:17.664005863Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:41:17.664019994Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:41:17.664027389Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:41:17.664030956Z     return self.run(*args, **kwargs)
2024-02-23T23:41:17.664034348Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:41:17.664038341Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:41:17.664041454Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:41:17.664045618Z     raise AirflowException(msg)
2024-02-23T23:41:17.664049126Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 47672aff-17db-4fde-bb43-ec31950ecfb0
2024-02-23T23:42:01.221878331Z [2024-02-23 23:42:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1193f49-8446-402a-a7f5-e7ed8af894c3] received
2024-02-23T23:42:01.224186986Z [2024-02-23 23:42:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2701749a-e634-4641-a619-2cbeaf1437be] received
2024-02-23T23:42:01.241932530Z [2024-02-23 23:42:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5609071c-0337-42be-b041-403aacee5aee] received
2024-02-23T23:42:01.241960465Z [2024-02-23 23:42:01,233: INFO/ForkPoolWorker-1] [5609071c-0337-42be-b041-403aacee5aee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:42:01.257968212Z [2024-02-23 23:42:01,250: INFO/ForkPoolWorker-15] [b1193f49-8446-402a-a7f5-e7ed8af894c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:42:01.262455090Z [2024-02-23 23:42:01,259: INFO/ForkPoolWorker-16] [2701749a-e634-4641-a619-2cbeaf1437be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:42:01.270693326Z [2024-02-23 23:42:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0204bcaa-9992-4cd4-b39c-85a2f83ec24d] received
2024-02-23T23:42:01.277986330Z [2024-02-23 23:42:01,277: INFO/ForkPoolWorker-2] [0204bcaa-9992-4cd4-b39c-85a2f83ec24d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:42:01.293907096Z [2024-02-23 23:42:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02583544-4d6d-4de7-ad01-11b861a2d8ba] received
2024-02-23T23:42:01.307392879Z [2024-02-23 23:42:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8630b6b2-05ab-4d93-9a4b-402818fce362] received
2024-02-23T23:42:01.313495668Z [2024-02-23 23:42:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8afd5fdb-9244-4325-b9f6-3aeb8b947e62] received
2024-02-23T23:42:01.338156861Z [2024-02-23 23:42:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39f9d9dc-e26a-43d6-a320-b5c664dff3df] received
2024-02-23T23:42:01.338180619Z [2024-02-23 23:42:01,331: INFO/ForkPoolWorker-4] [8630b6b2-05ab-4d93-9a4b-402818fce362] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:42:01.343143441Z [2024-02-23 23:42:01,342: INFO/ForkPoolWorker-5] [8afd5fdb-9244-4325-b9f6-3aeb8b947e62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:42:01.349031618Z [2024-02-23 23:42:01,348: INFO/ForkPoolWorker-3] [02583544-4d6d-4de7-ad01-11b861a2d8ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:42:01.661334857Z [2024-02-23 23:42:01,657: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:42:01.731298614Z [2024-02-23 23:42:01,730: INFO/ForkPoolWorker-6] [39f9d9dc-e26a-43d6-a320-b5c664dff3df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:42:01.754011216Z [2024-02-23 23:42:01,750: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:01.880517602Z [2024-02-23 23:42:01,870: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:02.187997843Z [2024-02-23 23:42:02,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:42:02.362183611Z [2024-02-23 23:42:02,352: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:02.401909518Z [2024-02-23 23:42:02,395: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:02.468995692Z [2024-02-23 23:42:02,468: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:42:02.473004690Z [2024-02-23 23:42:02,472: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:02.511852855Z [2024-02-23 23:42:02,511: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:42:02.514721166Z [2024-02-23 23:42:02,514: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:42:02.514943601Z [2024-02-23 23:42:02,514: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:42:02.515143553Z [2024-02-23 23:42:02,514: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:42:02.515491441Z [2024-02-23 23:42:02,515: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:42:02.641522012Z [2024-02-23 23:42:02,635: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:42:02.917067578Z [2024-02-23 23:42:02,914: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:03.421711019Z [2024-02-23 23:42:03,421: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:42:03.593064204Z [2024-02-23 23:42:03,571: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:04.278817449Z [2024-02-23 23:42:04,278: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:42:04.292901310Z [2024-02-23 23:42:04,281: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:04.492444287Z [2024-02-23 23:42:04,492: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:42:04.498725584Z [2024-02-23 23:42:04,498: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:04.498757155Z [2024-02-23 23:42:04,498: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:04.498769616Z [2024-02-23 23:42:04,498: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:04.498802533Z [2024-02-23 23:42:04,498: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:42:04.499062448Z [2024-02-23 23:42:04,498: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:04.499076331Z [2024-02-23 23:42:04,499: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:04.533262525Z [2024-02-23 23:42:04,532: WARNING/ForkPoolWorker-1] Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:04.578070079Z [2024-02-23 23:42:04,533: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:04.579169563Z [2024-02-23 23:42:04,578: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:42:04.589919530Z [2024-02-23 23:42:04,589: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:04.595627776Z [2024-02-23 23:42:04,595: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0204bcaa-9992-4cd4-b39c-85a2f83ec24d] succeeded in 3.3254119380001157s: None
2024-02-23T23:42:04.642094582Z [2024-02-23 23:42:04,641: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:42:04.643890156Z [2024-02-23 23:42:04,643: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:04.643902162Z [2024-02-23 23:42:04,643: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:04.644012778Z [2024-02-23 23:42:04,643: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:04.644023329Z [2024-02-23 23:42:04,643: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:42:04.644295025Z [2024-02-23 23:42:04,644: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:04.644306807Z [2024-02-23 23:42:04,644: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:04.649106602Z [2024-02-23 23:42:04,648: ERROR/ForkPoolWorker-1] [5609071c-0337-42be-b041-403aacee5aee] Failed to execute task Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:04.649166034Z Traceback (most recent call last):
2024-02-23T23:42:04.649172418Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:04.649176298Z     args.func(args)
2024-02-23T23:42:04.649179930Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:04.649185069Z     return func(*args, **kwargs)
2024-02-23T23:42:04.649188262Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:04.649191438Z     return f(*args, **kwargs)
2024-02-23T23:42:04.649194440Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:04.649197725Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:04.649201152Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:04.649204129Z     raise AirflowException(
2024-02-23T23:42:04.649208776Z airflow.exceptions.AirflowException: Dag 'vim_status_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:04.654201494Z [2024-02-23 23:42:04,653: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:42:04.663266121Z [2024-02-23 23:42:04,662: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:04.684281375Z [2024-02-23 23:42:04,683: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1193f49-8446-402a-a7f5-e7ed8af894c3] succeeded in 3.457970332000059s: None
2024-02-23T23:42:04.689136313Z [2024-02-23 23:42:04,688: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5609071c-0337-42be-b041-403aacee5aee] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5609071c-0337-42be-b041-403aacee5aee')
2024-02-23T23:42:04.689187710Z Traceback (most recent call last):
2024-02-23T23:42:04.689192415Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:04.689195471Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:04.689198836Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:04.689201744Z     return self.run(*args, **kwargs)
2024-02-23T23:42:04.689206229Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:04.689209773Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:04.689212748Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:04.689217054Z     raise AirflowException(msg)
2024-02-23T23:42:04.689237661Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 5609071c-0337-42be-b041-403aacee5aee
2024-02-23T23:42:04.730795736Z [2024-02-23 23:42:04,730: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:42:04.735070499Z [2024-02-23 23:42:04,734: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:04.735294612Z [2024-02-23 23:42:04,734: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:04.735572878Z [2024-02-23 23:42:04,735: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:04.735743391Z [2024-02-23 23:42:04,735: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:42:04.736223911Z [2024-02-23 23:42:04,736: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:04.736399177Z [2024-02-23 23:42:04,736: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:04.748589641Z [2024-02-23 23:42:04,748: WARNING/ForkPoolWorker-3] Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:04.749756192Z [2024-02-23 23:42:04,748: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:04.750743775Z [2024-02-23 23:42:04,750: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:42:04.753554800Z [2024-02-23 23:42:04,753: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:04.804654948Z [2024-02-23 23:42:04,804: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:42:04.808306954Z [2024-02-23 23:42:04,808: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:04.808522423Z [2024-02-23 23:42:04,808: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:04.808746666Z [2024-02-23 23:42:04,808: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:04.808931305Z [2024-02-23 23:42:04,808: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:42:04.809279933Z [2024-02-23 23:42:04,809: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:04.809450402Z [2024-02-23 23:42:04,809: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:04.812913555Z [2024-02-23 23:42:04,812: ERROR/ForkPoolWorker-3] [02583544-4d6d-4de7-ad01-11b861a2d8ba] Failed to execute task Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:04.812928131Z Traceback (most recent call last):
2024-02-23T23:42:04.812953726Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:04.812958708Z     args.func(args)
2024-02-23T23:42:04.812962030Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:04.812965784Z     return func(*args, **kwargs)
2024-02-23T23:42:04.812968728Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:04.812971683Z     return f(*args, **kwargs)
2024-02-23T23:42:04.812974725Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:04.812977843Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:04.812980745Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:04.812983574Z     raise AirflowException(
2024-02-23T23:42:04.812987457Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:04.888500365Z [2024-02-23 23:42:04,887: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[02583544-4d6d-4de7-ad01-11b861a2d8ba] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 02583544-4d6d-4de7-ad01-11b861a2d8ba')
2024-02-23T23:42:04.888524438Z Traceback (most recent call last):
2024-02-23T23:42:04.888528897Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:04.888532083Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:04.888535169Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:04.888538621Z     return self.run(*args, **kwargs)
2024-02-23T23:42:04.888542356Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:04.888558974Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:04.888562555Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:04.888565901Z     raise AirflowException(msg)
2024-02-23T23:42:04.888569565Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 02583544-4d6d-4de7-ad01-11b861a2d8ba
2024-02-23T23:42:04.989446965Z [2024-02-23 23:42:04,988: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-23T23:42:04.993062307Z [2024-02-23 23:42:04,992: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.055109716Z [2024-02-23 23:42:05,054: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-23T23:42:05.061369771Z [2024-02-23 23:42:05,061: INFO/ForkPoolWorker-5] Getting VIM list
2024-02-23T23:42:05.064066054Z [2024-02-23 23:42:05,063: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.065065436Z [2024-02-23 23:42:05,064: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.066242450Z [2024-02-23 23:42:05,065: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.066444402Z [2024-02-23 23:42:05,066: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.066563410Z [2024-02-23 23:42:05,066: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-23T23:42:05.066950827Z [2024-02-23 23:42:05,066: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:05.067058077Z [2024-02-23 23:42:05,066: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.111243885Z [2024-02-23 23:42:05,111: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-23T23:42:05.112519788Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.112547234Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.112683962Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.112700232Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-02-23T23:42:05.112919057Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:05.112967407Z [2024-02-23 23:42:05,112: INFO/ForkPoolWorker-5] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.171044923Z [2024-02-23 23:42:05,170: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:42:05.179423055Z [2024-02-23 23:42:05,176: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.188075014Z [2024-02-23 23:42:05,187: INFO/ForkPoolWorker-4] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:42:05.205376668Z [2024-02-23 23:42:05,205: INFO/ForkPoolWorker-5] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:42:05.231019034Z [2024-02-23 23:42:05,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:42:05.238435106Z [2024-02-23 23:42:05,238: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.242131772Z [2024-02-23 23:42:05,238: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.242471920Z [2024-02-23 23:42:05,242: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.242667144Z [2024-02-23 23:42:05,242: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:42:05.243229031Z [2024-02-23 23:42:05,243: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:05.243815514Z [2024-02-23 23:42:05,243: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.251873616Z [2024-02-23 23:42:05,251: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:05.252855371Z [2024-02-23 23:42:05,252: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:05.255070071Z [2024-02-23 23:42:05,254: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:42:05.259417664Z [2024-02-23 23:42:05,259: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.301787876Z [2024-02-23 23:42:05,301: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:42:05.308874204Z [2024-02-23 23:42:05,308: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.309093541Z [2024-02-23 23:42:05,308: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.309376755Z [2024-02-23 23:42:05,309: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.309641803Z [2024-02-23 23:42:05,309: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:42:05.310211419Z [2024-02-23 23:42:05,309: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:05.310449162Z [2024-02-23 23:42:05,310: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.314101798Z [2024-02-23 23:42:05,313: ERROR/ForkPoolWorker-16] [2701749a-e634-4641-a619-2cbeaf1437be] Failed to execute task Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:05.314108793Z Traceback (most recent call last):
2024-02-23T23:42:05.314113094Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:05.314116928Z     args.func(args)
2024-02-23T23:42:05.314121086Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:05.314124579Z     return func(*args, **kwargs)
2024-02-23T23:42:05.314128226Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:05.314131997Z     return f(*args, **kwargs)
2024-02-23T23:42:05.314147852Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:05.314150972Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:05.314153921Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:05.314156922Z     raise AirflowException(
2024-02-23T23:42:05.314160481Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_004f77f4-8a7b-4f78-acfd-21ab376b412d' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:05.346946271Z [2024-02-23 23:42:05,346: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2701749a-e634-4641-a619-2cbeaf1437be] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2701749a-e634-4641-a619-2cbeaf1437be')
2024-02-23T23:42:05.346989749Z Traceback (most recent call last):
2024-02-23T23:42:05.346995889Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:05.347000866Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:05.347005742Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:05.347010724Z     return self.run(*args, **kwargs)
2024-02-23T23:42:05.347016476Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:05.347022406Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:05.347027483Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:05.347050900Z     raise AirflowException(msg)
2024-02-23T23:42:05.347057231Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 2701749a-e634-4641-a619-2cbeaf1437be
2024-02-23T23:42:05.904651708Z [2024-02-23 23:42:05,904: INFO/ForkPoolWorker-6] Getting VIM list
2024-02-23T23:42:05.907664648Z [2024-02-23 23:42:05,907: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.932032833Z [2024-02-23 23:42:05,931: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-02-23T23:42:05.933367718Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.933408484Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.933582929Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.933612196Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] Getting VIM list OK
2024-02-23T23:42:05.933889416Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:05.933941014Z [2024-02-23 23:42:05,933: INFO/ForkPoolWorker-6] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.942213232Z [2024-02-23 23:42:05,941: WARNING/ForkPoolWorker-6] Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:05.942811234Z [2024-02-23 23:42:05,942: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:05.943577396Z [2024-02-23 23:42:05,943: INFO/ForkPoolWorker-6] Getting VIM list
2024-02-23T23:42:05.946242121Z [2024-02-23 23:42:05,945: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:05.964632682Z [2024-02-23 23:42:05,964: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-02-23T23:42:05.966035908Z [2024-02-23 23:42:05,965: INFO/ForkPoolWorker-6] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:05.966086715Z [2024-02-23 23:42:05,965: INFO/ForkPoolWorker-6] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:05.966230759Z [2024-02-23 23:42:05,965: INFO/ForkPoolWorker-6] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:05.966250050Z [2024-02-23 23:42:05,966: INFO/ForkPoolWorker-6] Getting VIM list OK
2024-02-23T23:42:05.966504012Z [2024-02-23 23:42:05,966: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:05.966514152Z [2024-02-23 23:42:05,966: INFO/ForkPoolWorker-6] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:05.970265887Z [2024-02-23 23:42:05,969: ERROR/ForkPoolWorker-6] [39f9d9dc-e26a-43d6-a320-b5c664dff3df] Failed to execute task Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:05.970292829Z Traceback (most recent call last):
2024-02-23T23:42:05.970303079Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:05.970311071Z     args.func(args)
2024-02-23T23:42:05.970319391Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:05.970328253Z     return func(*args, **kwargs)
2024-02-23T23:42:05.970335255Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:05.970342220Z     return f(*args, **kwargs)
2024-02-23T23:42:05.970349282Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:05.970356364Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:05.970363254Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:05.970370516Z     raise AirflowException(
2024-02-23T23:42:05.970380024Z airflow.exceptions.AirflowException: Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:06.030346718Z [2024-02-23 23:42:06,026: ERROR/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[39f9d9dc-e26a-43d6-a320-b5c664dff3df] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 39f9d9dc-e26a-43d6-a320-b5c664dff3df')
2024-02-23T23:42:06.030414253Z Traceback (most recent call last):
2024-02-23T23:42:06.030421809Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:06.030474082Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:06.030480512Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:06.030486155Z     return self.run(*args, **kwargs)
2024-02-23T23:42:06.030492929Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:06.030499723Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:06.030505303Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:06.030511405Z     raise AirflowException(msg)
2024-02-23T23:42:06.030517869Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 39f9d9dc-e26a-43d6-a320-b5c664dff3df
2024-02-23T23:42:06.817694458Z [2024-02-23 23:42:06,816: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[8afd5fdb-9244-4325-b9f6-3aeb8b947e62] succeeded in 5.499383955999974s: None
2024-02-23T23:42:07.109055533Z [2024-02-23 23:42:07,108: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[8630b6b2-05ab-4d93-9a4b-402818fce362] succeeded in 5.803139815000122s: None
2024-02-23T23:42:16.999851726Z [2024-02-23 23:42:16,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa1288a8-39a0-4540-bccf-9af00ef5a1bf] received
2024-02-23T23:42:17.020105876Z [2024-02-23 23:42:17,019: INFO/ForkPoolWorker-15] [aa1288a8-39a0-4540-bccf-9af00ef5a1bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:42:17.121451900Z [2024-02-23 23:42:17,121: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acc04adc-7f6a-455b-8793-39b460f7ee7e] received
2024-02-23T23:42:17.132324391Z [2024-02-23 23:42:17,132: INFO/ForkPoolWorker-16] [acc04adc-7f6a-455b-8793-39b460f7ee7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:42:17.299572456Z [2024-02-23 23:42:17,295: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:17.439806635Z [2024-02-23 23:42:17,436: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:18.333598306Z [2024-02-23 23:42:18,333: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:42:18.336528218Z [2024-02-23 23:42:18,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:18.353336171Z [2024-02-23 23:42:18,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:42:18.354549372Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:18.354563677Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:18.354736321Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:18.354798615Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:42:18.354851826Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:18.354926084Z [2024-02-23 23:42:18,354: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:18.360710795Z [2024-02-23 23:42:18,360: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:18.361410891Z [2024-02-23 23:42:18,360: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:42:18.362168333Z [2024-02-23 23:42:18,361: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:42:18.364432054Z [2024-02-23 23:42:18,364: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:18.372333446Z [2024-02-23 23:42:18,372: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:42:18.373236541Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:18.373279454Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:18.373452200Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:18.373466754Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:42:18.373597822Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:42:18.373653418Z [2024-02-23 23:42:18,373: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:18.376393487Z [2024-02-23 23:42:18,375: ERROR/ForkPoolWorker-15] [aa1288a8-39a0-4540-bccf-9af00ef5a1bf] Failed to execute task Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:18.376405264Z Traceback (most recent call last):
2024-02-23T23:42:18.376409013Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:18.376412458Z     args.func(args)
2024-02-23T23:42:18.376415676Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:18.376420010Z     return func(*args, **kwargs)
2024-02-23T23:42:18.376422879Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:18.376425617Z     return f(*args, **kwargs)
2024-02-23T23:42:18.376428394Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:18.376431294Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:18.376434575Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:18.376437291Z     raise AirflowException(
2024-02-23T23:42:18.376451936Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:18.407580205Z [2024-02-23 23:42:18,406: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa1288a8-39a0-4540-bccf-9af00ef5a1bf] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa1288a8-39a0-4540-bccf-9af00ef5a1bf')
2024-02-23T23:42:18.407595676Z Traceback (most recent call last):
2024-02-23T23:42:18.407599088Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:18.407601638Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:18.407604175Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:18.407607214Z     return self.run(*args, **kwargs)
2024-02-23T23:42:18.407610282Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:18.407614901Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:18.407617464Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:18.407620719Z     raise AirflowException(msg)
2024-02-23T23:42:18.407623798Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id aa1288a8-39a0-4540-bccf-9af00ef5a1bf
2024-02-23T23:42:18.468454040Z [2024-02-23 23:42:18,467: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:42:18.471331564Z [2024-02-23 23:42:18,470: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:18.492618975Z [2024-02-23 23:42:18,492: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:42:18.493990802Z [2024-02-23 23:42:18,493: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:18.494046782Z [2024-02-23 23:42:18,493: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:18.494069392Z [2024-02-23 23:42:18,493: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:18.494185396Z [2024-02-23 23:42:18,493: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:42:18.494207330Z [2024-02-23 23:42:18,494: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:18.494216195Z [2024-02-23 23:42:18,494: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:18.500770740Z [2024-02-23 23:42:18,500: WARNING/ForkPoolWorker-16] Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:18.501480863Z [2024-02-23 23:42:18,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:42:18.502252569Z [2024-02-23 23:42:18,501: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:42:18.504860808Z [2024-02-23 23:42:18,504: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:42:18.526676452Z [2024-02-23 23:42:18,526: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:42:18.530240679Z [2024-02-23 23:42:18,529: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:42:18.530261101Z [2024-02-23 23:42:18,530: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:42:18.530316924Z [2024-02-23 23:42:18,530: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:42:18.530428211Z [2024-02-23 23:42:18,530: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:42:18.530643590Z [2024-02-23 23:42:18,530: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:42:18.530657046Z [2024-02-23 23:42:18,530: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:42:18.535978720Z [2024-02-23 23:42:18,534: ERROR/ForkPoolWorker-16] [acc04adc-7f6a-455b-8793-39b460f7ee7e] Failed to execute task Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:42:18.536015302Z Traceback (most recent call last):
2024-02-23T23:42:18.536024372Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:42:18.536030125Z     args.func(args)
2024-02-23T23:42:18.536035726Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:42:18.536041808Z     return func(*args, **kwargs)
2024-02-23T23:42:18.536047171Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:42:18.536052569Z     return f(*args, **kwargs)
2024-02-23T23:42:18.536057779Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:42:18.536062998Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:42:18.536068245Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:42:18.536073862Z     raise AirflowException(
2024-02-23T23:42:18.536079785Z airflow.exceptions.AirflowException: Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:42:18.570935524Z [2024-02-23 23:42:18,570: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acc04adc-7f6a-455b-8793-39b460f7ee7e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id acc04adc-7f6a-455b-8793-39b460f7ee7e')
2024-02-23T23:42:18.570952729Z Traceback (most recent call last):
2024-02-23T23:42:18.570956691Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:42:18.570959634Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:42:18.570962453Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:42:18.570965276Z     return self.run(*args, **kwargs)
2024-02-23T23:42:18.570968589Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:42:18.570986307Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:42:18.570989416Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:42:18.570992588Z     raise AirflowException(msg)
2024-02-23T23:42:18.570995919Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id acc04adc-7f6a-455b-8793-39b460f7ee7e
2024-02-23T23:43:00.708799699Z [2024-02-23 23:43:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[daf96822-b18a-4ba4-aeac-97a961a2d0bc] received
2024-02-23T23:43:00.714738774Z [2024-02-23 23:43:00,714: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c44ac05f-7dbd-43f6-9e5f-68e4e51123a0] received
2024-02-23T23:43:00.720551510Z [2024-02-23 23:43:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e702e9a3-f4eb-4a51-a2dc-31ff04655001] received
2024-02-23T23:43:00.721277497Z [2024-02-23 23:43:00,721: INFO/ForkPoolWorker-15] [daf96822-b18a-4ba4-aeac-97a961a2d0bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:43:00.725428330Z [2024-02-23 23:43:00,725: INFO/ForkPoolWorker-16] [c44ac05f-7dbd-43f6-9e5f-68e4e51123a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:43:00.735613654Z [2024-02-23 23:43:00,735: INFO/ForkPoolWorker-1] [e702e9a3-f4eb-4a51-a2dc-31ff04655001] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:43:00.754509603Z [2024-02-23 23:43:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f99c8a6-ee9d-47be-9627-6464f367c3e5] received
2024-02-23T23:43:00.760562265Z [2024-02-23 23:43:00,760: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660] received
2024-02-23T23:43:00.775793112Z [2024-02-23 23:43:00,775: INFO/ForkPoolWorker-2] [7f99c8a6-ee9d-47be-9627-6464f367c3e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:43:00.798271308Z [2024-02-23 23:43:00,797: INFO/ForkPoolWorker-3] [cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:43:01.436599876Z [2024-02-23 23:43:01,431: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:43:01.465291942Z [2024-02-23 23:43:01,460: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:43:01.598910753Z [2024-02-23 23:43:01,598: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-23T23:43:01.602856771Z [2024-02-23 23:43:01,602: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:01.632911502Z [2024-02-23 23:43:01,620: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:43:01.635023870Z [2024-02-23 23:43:01,634: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:43:01.642632419Z [2024-02-23 23:43:01,642: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:43:01.642726441Z [2024-02-23 23:43:01,642: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:43:01.642748462Z [2024-02-23 23:43:01,642: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-23T23:43:01.643020393Z [2024-02-23 23:43:01,642: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:43:01.727896377Z [2024-02-23 23:43:01,727: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:43:01.874315075Z [2024-02-23 23:43:01,866: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:43:01.909447372Z [2024-02-23 23:43:01,906: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:43:02.323886566Z [2024-02-23 23:43:02,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[daf96822-b18a-4ba4-aeac-97a961a2d0bc] succeeded in 1.6077653550000832s: None
2024-02-23T23:43:02.955213698Z [2024-02-23 23:43:02,954: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:43:02.958733232Z [2024-02-23 23:43:02,958: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:02.985605733Z [2024-02-23 23:43:02,985: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:43:02.987290612Z [2024-02-23 23:43:02,987: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:02.987437659Z [2024-02-23 23:43:02,987: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:02.987672212Z [2024-02-23 23:43:02,987: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:02.987870090Z [2024-02-23 23:43:02,987: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:43:02.988225144Z [2024-02-23 23:43:02,988: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:43:02.988520940Z [2024-02-23 23:43:02,988: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.082674119Z [2024-02-23 23:43:03,082: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:43:03.383990668Z [2024-02-23 23:43:03,383: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:43:03.387413729Z [2024-02-23 23:43:03,386: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:03.420473717Z [2024-02-23 23:43:03,420: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:43:03.421852472Z [2024-02-23 23:43:03,421: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:03.422089581Z [2024-02-23 23:43:03,421: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:03.422346294Z [2024-02-23 23:43:03,422: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:03.422783355Z [2024-02-23 23:43:03,422: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:43:03.423131335Z [2024-02-23 23:43:03,422: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:43:03.423242185Z [2024-02-23 23:43:03,423: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.465259761Z [2024-02-23 23:43:03,464: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:43:03.469572019Z [2024-02-23 23:43:03,468: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:03.492582688Z [2024-02-23 23:43:03,492: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:43:03.498295150Z [2024-02-23 23:43:03,498: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:03.498345860Z [2024-02-23 23:43:03,498: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:03.498542810Z [2024-02-23 23:43:03,498: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:03.498714260Z [2024-02-23 23:43:03,498: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:43:03.499109310Z [2024-02-23 23:43:03,498: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:43:03.499205262Z [2024-02-23 23:43:03,499: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.506538413Z [2024-02-23 23:43:03,506: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:43:03.507554798Z [2024-02-23 23:43:03,506: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:43:03.509065338Z [2024-02-23 23:43:03,508: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:43:03.511739846Z [2024-02-23 23:43:03,511: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:03.534437266Z [2024-02-23 23:43:03,533: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:43:03.544627184Z [2024-02-23 23:43:03,544: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:43:03.552108035Z [2024-02-23 23:43:03,551: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:03.552225036Z [2024-02-23 23:43:03,552: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:03.552590856Z [2024-02-23 23:43:03,552: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:03.552783705Z [2024-02-23 23:43:03,552: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:43:03.553478369Z [2024-02-23 23:43:03,553: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:43:03.553691048Z [2024-02-23 23:43:03,553: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.559394045Z [2024-02-23 23:43:03,558: ERROR/ForkPoolWorker-16] [c44ac05f-7dbd-43f6-9e5f-68e4e51123a0] Failed to execute task Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:43:03.559408981Z Traceback (most recent call last):
2024-02-23T23:43:03.559412964Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:43:03.559416733Z     args.func(args)
2024-02-23T23:43:03.559420365Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:43:03.559424296Z     return func(*args, **kwargs)
2024-02-23T23:43:03.559427450Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:43:03.559430691Z     return f(*args, **kwargs)
2024-02-23T23:43:03.559433790Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:43:03.559437037Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:43:03.559440173Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:43:03.559443188Z     raise AirflowException(
2024-02-23T23:43:03.559446793Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:43:03.635805063Z [2024-02-23 23:43:03,635: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c44ac05f-7dbd-43f6-9e5f-68e4e51123a0] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c44ac05f-7dbd-43f6-9e5f-68e4e51123a0')
2024-02-23T23:43:03.635828498Z Traceback (most recent call last):
2024-02-23T23:43:03.635833397Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:43:03.635836676Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:43:03.635839864Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:43:03.635842861Z     return self.run(*args, **kwargs)
2024-02-23T23:43:03.635847562Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:43:03.635864571Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:43:03.635867853Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:43:03.635871998Z     raise AirflowException(msg)
2024-02-23T23:43:03.635878257Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c44ac05f-7dbd-43f6-9e5f-68e4e51123a0
2024-02-23T23:43:03.737872529Z [2024-02-23 23:43:03,737: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:43:03.741346230Z [2024-02-23 23:43:03,740: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:03.773077969Z [2024-02-23 23:43:03,772: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:43:03.776806127Z [2024-02-23 23:43:03,776: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:03.777075290Z [2024-02-23 23:43:03,776: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:03.777356769Z [2024-02-23 23:43:03,777: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:03.777525838Z [2024-02-23 23:43:03,777: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:43:03.777892312Z [2024-02-23 23:43:03,777: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:43:03.778033786Z [2024-02-23 23:43:03,777: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.786223506Z [2024-02-23 23:43:03,785: WARNING/ForkPoolWorker-3] Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:43:03.788441684Z [2024-02-23 23:43:03,786: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:43:03.790082852Z [2024-02-23 23:43:03,789: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:43:03.794698025Z [2024-02-23 23:43:03,793: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:43:03.811656143Z [2024-02-23 23:43:03,811: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:43:03.813016953Z [2024-02-23 23:43:03,812: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:43:03.813195476Z [2024-02-23 23:43:03,813: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:43:03.813401326Z [2024-02-23 23:43:03,813: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:43:03.813528922Z [2024-02-23 23:43:03,813: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:43:03.813964229Z [2024-02-23 23:43:03,813: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:43:03.814212449Z [2024-02-23 23:43:03,814: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:43:03.818336652Z [2024-02-23 23:43:03,817: ERROR/ForkPoolWorker-3] [cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660] Failed to execute task Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse..
2024-02-23T23:43:03.818363875Z Traceback (most recent call last):
2024-02-23T23:43:03.818367762Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-23T23:43:03.818371538Z     args.func(args)
2024-02-23T23:43:03.818375071Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-23T23:43:03.818378461Z     return func(*args, **kwargs)
2024-02-23T23:43:03.818381418Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-23T23:43:03.818384537Z     return f(*args, **kwargs)
2024-02-23T23:43:03.818387454Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-23T23:43:03.818390791Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-23T23:43:03.818394269Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-23T23:43:03.818397291Z     raise AirflowException(
2024-02-23T23:43:03.818400832Z airflow.exceptions.AirflowException: Dag 'vim_status_282b6020-99a0-40a4-9c13-8a3b2a54ca96' could not be found; either it does not exist or it failed to parse.
2024-02-23T23:43:03.855315921Z [2024-02-23 23:43:03,854: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660')
2024-02-23T23:43:03.855332263Z Traceback (most recent call last):
2024-02-23T23:43:03.855336728Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-23T23:43:03.855339987Z     R = retval = fun(*args, **kwargs)
2024-02-23T23:43:03.855343369Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-23T23:43:03.855346475Z     return self.run(*args, **kwargs)
2024-02-23T23:43:03.855350454Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-23T23:43:03.855354401Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-23T23:43:03.855357587Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-23T23:43:03.855361532Z     raise AirflowException(msg)
2024-02-23T23:43:03.855365647Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id cb45f9c3-1cff-4b7d-bf46-8bee0aaa7660
2024-02-23T23:43:05.049918135Z [2024-02-23 23:43:05,049: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f99c8a6-ee9d-47be-9627-6464f367c3e5] succeeded in 4.287363714000094s: None
2024-02-23T23:43:05.253454041Z [2024-02-23 23:43:05,252: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e702e9a3-f4eb-4a51-a2dc-31ff04655001] succeeded in 4.530557818000034s: None
2024-02-23T23:44:01.172567438Z [2024-02-23 23:44:01,172: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f2d8f31-7daa-461e-b3d7-7110e3f718d1] received
2024-02-23T23:44:01.202360925Z [2024-02-23 23:44:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8b2d4dd-d699-493d-8660-760a8b85533a] received
2024-02-23T23:44:01.220942065Z [2024-02-23 23:44:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5fb0a88-bd83-4436-a6b3-391d46f59170] received
2024-02-23T23:44:01.237857374Z [2024-02-23 23:44:01,226: INFO/ForkPoolWorker-15] [6f2d8f31-7daa-461e-b3d7-7110e3f718d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:44:01.251017164Z [2024-02-23 23:44:01,249: INFO/ForkPoolWorker-16] [c8b2d4dd-d699-493d-8660-760a8b85533a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:44:01.253883529Z [2024-02-23 23:44:01,246: INFO/ForkPoolWorker-1] [b5fb0a88-bd83-4436-a6b3-391d46f59170] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:44:01.281050258Z [2024-02-23 23:44:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecb9ecdf-7886-4ff8-b128-9610c1df56e0] received
2024-02-23T23:44:01.322618209Z [2024-02-23 23:44:01,322: INFO/ForkPoolWorker-2] [ecb9ecdf-7886-4ff8-b128-9610c1df56e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:44:01.715999754Z [2024-02-23 23:44:01,712: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:44:01.994691719Z [2024-02-23 23:44:01,988: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:44:02.236604153Z [2024-02-23 23:44:02,227: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:44:02.243864421Z [2024-02-23 23:44:02,242: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:44:02.461848545Z [2024-02-23 23:44:02,461: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:44:02.477751399Z [2024-02-23 23:44:02,476: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:44:02.489958310Z [2024-02-23 23:44:02,481: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:44:02.489986577Z [2024-02-23 23:44:02,482: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:44:02.489991087Z [2024-02-23 23:44:02,482: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:44:02.585386666Z [2024-02-23 23:44:02,578: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:44:02.792858466Z [2024-02-23 23:44:02,792: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:44:02.839287096Z [2024-02-23 23:44:02,804: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:44:04.064345013Z [2024-02-23 23:44:04,064: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:44:04.772717107Z [2024-02-23 23:44:04,772: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ecb9ecdf-7886-4ff8-b128-9610c1df56e0] succeeded in 3.4987808559999394s: None
2024-02-23T23:44:05.393548149Z [2024-02-23 23:44:05,393: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5fb0a88-bd83-4436-a6b3-391d46f59170] succeeded in 4.170501852000143s: None
2024-02-23T23:44:05.851973635Z [2024-02-23 23:44:05,851: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:44:05.855380127Z [2024-02-23 23:44:05,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:44:05.906517632Z [2024-02-23 23:44:05,906: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:44:05.907949248Z [2024-02-23 23:44:05,907: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:44:05.909158271Z [2024-02-23 23:44:05,907: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:44:05.909168835Z [2024-02-23 23:44:05,908: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:44:05.909174400Z [2024-02-23 23:44:05,908: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:44:05.909177509Z [2024-02-23 23:44:05,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:44:05.909180562Z [2024-02-23 23:44:05,908: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:44:06.283668746Z [2024-02-23 23:44:06,283: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:44:06.288041595Z [2024-02-23 23:44:06,287: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:44:06.315816635Z [2024-02-23 23:44:06,315: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:44:06.340010641Z [2024-02-23 23:44:06,339: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:44:06.341405505Z [2024-02-23 23:44:06,341: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:44:06.341446982Z [2024-02-23 23:44:06,341: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:44:06.341593732Z [2024-02-23 23:44:06,341: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:44:06.341692615Z [2024-02-23 23:44:06,341: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:44:06.342390928Z [2024-02-23 23:44:06,342: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:44:06.342455223Z [2024-02-23 23:44:06,342: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:44:06.487985807Z [2024-02-23 23:44:06,487: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:44:08.371706167Z [2024-02-23 23:44:08,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c8b2d4dd-d699-493d-8660-760a8b85533a] succeeded in 7.1637914549999095s: None
2024-02-23T23:44:08.865954492Z [2024-02-23 23:44:08,865: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f2d8f31-7daa-461e-b3d7-7110e3f718d1] succeeded in 7.673088559000007s: None
2024-02-23T23:45:01.413212177Z [2024-02-23 23:45:01,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2414ec68-fa01-4a28-8b3f-786894c07829] received
2024-02-23T23:45:01.413951905Z [2024-02-23 23:45:01,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5ab503a-6f60-444f-991f-60e29ac92b6b] received
2024-02-23T23:45:01.423487513Z [2024-02-23 23:45:01,423: INFO/ForkPoolWorker-16] [c5ab503a-6f60-444f-991f-60e29ac92b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:45:01.429642395Z [2024-02-23 23:45:01,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e987812-82dc-4de3-9742-465c13bae4e1] received
2024-02-23T23:45:01.432433558Z [2024-02-23 23:45:01,432: INFO/ForkPoolWorker-15] [2414ec68-fa01-4a28-8b3f-786894c07829] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:45:01.432925681Z [2024-02-23 23:45:01,432: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad772cf-14db-4b21-8e63-2a4b9c1a6dec] received
2024-02-23T23:45:01.516525254Z [2024-02-23 23:45:01,516: INFO/ForkPoolWorker-1] [4e987812-82dc-4de3-9742-465c13bae4e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:45:01.537014213Z [2024-02-23 23:45:01,536: INFO/ForkPoolWorker-2] [5ad772cf-14db-4b21-8e63-2a4b9c1a6dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:45:02.293084498Z [2024-02-23 23:45:02,284: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:45:02.299958150Z [2024-02-23 23:45:02,289: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:45:02.597086843Z [2024-02-23 23:45:02,593: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:45:02.645872116Z [2024-02-23 23:45:02,621: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:45:02.972943205Z [2024-02-23 23:45:02,970: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-23T23:45:02.994653026Z [2024-02-23 23:45:02,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:03.122893902Z [2024-02-23 23:45:03,122: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:45:03.135542079Z [2024-02-23 23:45:03,135: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:45:03.136449993Z [2024-02-23 23:45:03,135: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:45:03.141476386Z [2024-02-23 23:45:03,141: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-23T23:45:03.141953526Z [2024-02-23 23:45:03,141: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:45:03.603162081Z [2024-02-23 23:45:03,602: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:04.781906746Z [2024-02-23 23:45:04,781: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e987812-82dc-4de3-9742-465c13bae4e1] succeeded in 3.3246259420000115s: None
2024-02-23T23:45:05.539469165Z [2024-02-23 23:45:05,527: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:45:05.543338434Z [2024-02-23 23:45:05,542: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:05.671514090Z [2024-02-23 23:45:05,669: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:45:05.682531529Z [2024-02-23 23:45:05,682: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:05.682666568Z [2024-02-23 23:45:05,682: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:05.682835735Z [2024-02-23 23:45:05,682: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:05.682850607Z [2024-02-23 23:45:05,682: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:45:05.683232896Z [2024-02-23 23:45:05,683: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:45:05.683435818Z [2024-02-23 23:45:05,683: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:05.829432029Z [2024-02-23 23:45:05,829: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:06.009921656Z [2024-02-23 23:45:06,009: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:45:06.015522928Z [2024-02-23 23:45:06,015: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:06.094031269Z [2024-02-23 23:45:06,093: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:45:06.096502611Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:06.096521405Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:06.096622511Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:06.096659727Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:45:06.096925677Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:45:06.096932669Z [2024-02-23 23:45:06,096: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:06.250562090Z [2024-02-23 23:45:06,250: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:06.290874761Z [2024-02-23 23:45:06,290: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:45:06.294604810Z [2024-02-23 23:45:06,294: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:06.357267010Z [2024-02-23 23:45:06,356: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:45:06.361552186Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:06.361574242Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:06.361578936Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:06.361583364Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:45:06.361586477Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:45:06.361589647Z [2024-02-23 23:45:06,359: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:06.506539130Z [2024-02-23 23:45:06,506: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:07.266736093Z [2024-02-23 23:45:07,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ee04770-eb57-4f2d-a46b-f91a4a1d21bd] received
2024-02-23T23:45:07.279085992Z [2024-02-23 23:45:07,278: INFO/ForkPoolWorker-1] [3ee04770-eb57-4f2d-a46b-f91a4a1d21bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:45:07.339311255Z [2024-02-23 23:45:07,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2414ec68-fa01-4a28-8b3f-786894c07829] succeeded in 5.927951823000058s: None
2024-02-23T23:45:07.631568278Z [2024-02-23 23:45:07,625: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:45:07.908052438Z [2024-02-23 23:45:07,907: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5ab503a-6f60-444f-991f-60e29ac92b6b] succeeded in 6.491718474999971s: None
2024-02-23T23:45:08.275565796Z [2024-02-23 23:45:08,274: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5ad772cf-14db-4b21-8e63-2a4b9c1a6dec] succeeded in 6.822301232999962s: None
2024-02-23T23:45:08.937353566Z [2024-02-23 23:45:08,936: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:45:08.940725780Z [2024-02-23 23:45:08,940: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:08.959430660Z [2024-02-23 23:45:08,959: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:45:08.961274433Z [2024-02-23 23:45:08,961: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:08.961372840Z [2024-02-23 23:45:08,961: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:08.961528163Z [2024-02-23 23:45:08,961: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:08.961646792Z [2024-02-23 23:45:08,961: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:45:08.961977204Z [2024-02-23 23:45:08,961: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:45:08.962084737Z [2024-02-23 23:45:08,962: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:09.065463465Z [2024-02-23 23:45:09,065: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:09.838919987Z [2024-02-23 23:45:09,838: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ee04770-eb57-4f2d-a46b-f91a4a1d21bd] succeeded in 2.5660629970000173s: None
2024-02-23T23:45:10.576225364Z [2024-02-23 23:45:10,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b70c4ec9-a6cd-44e6-bfb2-f314b87fdd9e] received
2024-02-23T23:45:10.584593044Z [2024-02-23 23:45:10,584: INFO/ForkPoolWorker-15] [b70c4ec9-a6cd-44e6-bfb2-f314b87fdd9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:45:10.931830841Z [2024-02-23 23:45:10,928: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:45:12.270784915Z [2024-02-23 23:45:12,270: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:45:12.274259965Z [2024-02-23 23:45:12,273: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:12.294940551Z [2024-02-23 23:45:12,294: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:45:12.296482060Z [2024-02-23 23:45:12,296: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:12.296539788Z [2024-02-23 23:45:12,296: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:12.296726146Z [2024-02-23 23:45:12,296: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:12.296787190Z [2024-02-23 23:45:12,296: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:45:12.297053130Z [2024-02-23 23:45:12,296: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:45:12.297170748Z [2024-02-23 23:45:12,297: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:12.403994872Z [2024-02-23 23:45:12,397: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:13.101805301Z [2024-02-23 23:45:13,101: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b70c4ec9-a6cd-44e6-bfb2-f314b87fdd9e] succeeded in 2.5228674180000326s: None
2024-02-23T23:45:13.993264547Z [2024-02-23 23:45:13,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3467101f-ab9b-4edc-803f-f39e17889d3f] received
2024-02-23T23:45:14.004458495Z [2024-02-23 23:45:14,004: INFO/ForkPoolWorker-15] [3467101f-ab9b-4edc-803f-f39e17889d3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:45:14.366808764Z [2024-02-23 23:45:14,363: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:45:15.544721451Z [2024-02-23 23:45:15,544: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:45:15.548347300Z [2024-02-23 23:45:15,547: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:45:15.566203514Z [2024-02-23 23:45:15,565: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:45:15.567462544Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:45:15.567481457Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:45:15.567582176Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:45:15.567595338Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:45:15.567821514Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:45:15.567854950Z [2024-02-23 23:45:15,567: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:45:15.649352616Z [2024-02-23 23:45:15,649: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:45:16.268805410Z [2024-02-23 23:45:16,268: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3467101f-ab9b-4edc-803f-f39e17889d3f] succeeded in 2.273841159000085s: None
2024-02-23T23:46:00.237887352Z [2024-02-23 23:46:00,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a97078a-23b1-4090-bbe4-b2f876946bb6] received
2024-02-23T23:46:00.244325940Z [2024-02-23 23:46:00,243: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82eeebf3-a9fd-46d9-b47e-c5c6de76d0c8] received
2024-02-23T23:46:00.245421846Z [2024-02-23 23:46:00,245: INFO/ForkPoolWorker-15] [3a97078a-23b1-4090-bbe4-b2f876946bb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:46:00.249679251Z [2024-02-23 23:46:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c15a3030-22e2-46f7-a42e-3a325e41c0d9] received
2024-02-23T23:46:00.258321954Z [2024-02-23 23:46:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a690e08c-00e1-4e93-9db7-4e52ef9d406a] received
2024-02-23T23:46:00.262011088Z [2024-02-23 23:46:00,261: INFO/ForkPoolWorker-1] [c15a3030-22e2-46f7-a42e-3a325e41c0d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:46:00.265950276Z [2024-02-23 23:46:00,265: INFO/ForkPoolWorker-16] [82eeebf3-a9fd-46d9-b47e-c5c6de76d0c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:46:00.268491770Z [2024-02-23 23:46:00,268: INFO/ForkPoolWorker-2] [a690e08c-00e1-4e93-9db7-4e52ef9d406a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:46:00.591298634Z [2024-02-23 23:46:00,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:46:00.627229832Z [2024-02-23 23:46:00,623: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:46:00.634456540Z [2024-02-23 23:46:00,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:46:00.739416477Z [2024-02-23 23:46:00,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:46:00.805319649Z [2024-02-23 23:46:00,804: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-23T23:46:00.809582442Z [2024-02-23 23:46:00,809: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:46:00.851822914Z [2024-02-23 23:46:00,851: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:46:00.852802392Z [2024-02-23 23:46:00,852: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:46:00.852908202Z [2024-02-23 23:46:00,852: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:46:00.853034159Z [2024-02-23 23:46:00,852: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-23T23:46:00.853276767Z [2024-02-23 23:46:00,853: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:46:00.928919118Z [2024-02-23 23:46:00,928: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:46:00.990977971Z [2024-02-23 23:46:00,990: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:46:01.558810162Z [2024-02-23 23:46:01,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a97078a-23b1-4090-bbe4-b2f876946bb6] succeeded in 1.3194368540000596s: None
2024-02-23T23:46:01.739781608Z [2024-02-23 23:46:01,739: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[82eeebf3-a9fd-46d9-b47e-c5c6de76d0c8] succeeded in 1.4933378379998885s: None
2024-02-23T23:46:02.102119976Z [2024-02-23 23:46:02,101: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:46:02.105505577Z [2024-02-23 23:46:02,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:46:02.110189760Z [2024-02-23 23:46:02,109: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:46:02.113902645Z [2024-02-23 23:46:02,113: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:46:02.126529080Z [2024-02-23 23:46:02,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:46:02.127943514Z [2024-02-23 23:46:02,127: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:46:02.128111059Z [2024-02-23 23:46:02,127: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:46:02.128291360Z [2024-02-23 23:46:02,128: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:46:02.128424307Z [2024-02-23 23:46:02,128: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:46:02.128800981Z [2024-02-23 23:46:02,128: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:46:02.128935780Z [2024-02-23 23:46:02,128: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:46:02.135007230Z [2024-02-23 23:46:02,134: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:46:02.136580100Z [2024-02-23 23:46:02,136: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:46:02.136704927Z [2024-02-23 23:46:02,136: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:46:02.136884569Z [2024-02-23 23:46:02,136: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:46:02.136977971Z [2024-02-23 23:46:02,136: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:46:02.137305119Z [2024-02-23 23:46:02,137: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:46:02.137431183Z [2024-02-23 23:46:02,137: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:46:02.228477748Z [2024-02-23 23:46:02,228: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:46:02.229719601Z [2024-02-23 23:46:02,229: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:46:04.374020477Z [2024-02-23 23:46:04,372: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c15a3030-22e2-46f7-a42e-3a325e41c0d9] succeeded in 4.1149279139999635s: None
2024-02-23T23:46:04.940665215Z [2024-02-23 23:46:04,940: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a690e08c-00e1-4e93-9db7-4e52ef9d406a] succeeded in 4.68030727900009s: None
2024-02-23T23:47:00.438938358Z [2024-02-23 23:47:00,438: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38485965-dcee-4394-9bf6-7cef580f3fe6] received
2024-02-23T23:47:00.442248373Z [2024-02-23 23:47:00,442: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea9f0953-a085-41ce-8295-7a66acebf0e4] received
2024-02-23T23:47:00.453009181Z [2024-02-23 23:47:00,452: INFO/ForkPoolWorker-15] [38485965-dcee-4394-9bf6-7cef580f3fe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:47:00.458834030Z [2024-02-23 23:47:00,458: INFO/ForkPoolWorker-16] [ea9f0953-a085-41ce-8295-7a66acebf0e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:47:00.463128801Z [2024-02-23 23:47:00,462: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b3b86c34-3dad-4715-95d2-933534e2259d] received
2024-02-23T23:47:00.473139093Z [2024-02-23 23:47:00,472: INFO/ForkPoolWorker-1] [b3b86c34-3dad-4715-95d2-933534e2259d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:47:00.742663276Z [2024-02-23 23:47:00,739: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:47:00.744227679Z [2024-02-23 23:47:00,741: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:47:00.799205073Z [2024-02-23 23:47:00,795: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:47:00.916335020Z [2024-02-23 23:47:00,915: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-23T23:47:00.920472798Z [2024-02-23 23:47:00,920: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:47:00.946635173Z [2024-02-23 23:47:00,946: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:47:00.947630454Z [2024-02-23 23:47:00,947: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:47:00.947845588Z [2024-02-23 23:47:00,947: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:47:00.947927549Z [2024-02-23 23:47:00,947: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-23T23:47:00.948207887Z [2024-02-23 23:47:00,948: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:47:01.047738387Z [2024-02-23 23:47:01,047: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:47:01.750071047Z [2024-02-23 23:47:01,749: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38485965-dcee-4394-9bf6-7cef580f3fe6] succeeded in 1.3066028750001806s: None
2024-02-23T23:47:01.982085600Z [2024-02-23 23:47:01,981: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:47:01.985824674Z [2024-02-23 23:47:01,985: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:47:02.007537637Z [2024-02-23 23:47:02,007: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:47:02.009109675Z [2024-02-23 23:47:02,008: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:47:02.009260862Z [2024-02-23 23:47:02,009: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:47:02.009473565Z [2024-02-23 23:47:02,009: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:47:02.009573838Z [2024-02-23 23:47:02,009: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:47:02.010354263Z [2024-02-23 23:47:02,009: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:47:02.010404777Z [2024-02-23 23:47:02,010: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:47:02.105614114Z [2024-02-23 23:47:02,105: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:47:02.170568088Z [2024-02-23 23:47:02,169: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:47:02.173269630Z [2024-02-23 23:47:02,172: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:47:02.195414012Z [2024-02-23 23:47:02,195: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:47:02.196892110Z [2024-02-23 23:47:02,196: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:47:02.197009205Z [2024-02-23 23:47:02,196: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:47:02.197213385Z [2024-02-23 23:47:02,197: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:47:02.197342121Z [2024-02-23 23:47:02,197: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:47:02.197661465Z [2024-02-23 23:47:02,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:47:02.197859719Z [2024-02-23 23:47:02,197: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:47:02.283107828Z [2024-02-23 23:47:02,282: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:47:03.713422968Z [2024-02-23 23:47:03,712: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ea9f0953-a085-41ce-8295-7a66acebf0e4] succeeded in 3.2631363359998886s: None
2024-02-23T23:47:04.171098818Z [2024-02-23 23:47:04,170: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b3b86c34-3dad-4715-95d2-933534e2259d] succeeded in 3.7061078439999164s: None
2024-02-23T23:48:00.508943209Z [2024-02-23 23:48:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68518373-ff9d-406c-bdaf-13301a44ad76] received
2024-02-23T23:48:00.512828880Z [2024-02-23 23:48:00,512: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81c8ba5a-273a-46c0-be69-46104aa92d33] received
2024-02-23T23:48:00.516859077Z [2024-02-23 23:48:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb27c96e-eb1a-4400-a5eb-19afd9694f15] received
2024-02-23T23:48:00.519460294Z [2024-02-23 23:48:00,519: INFO/ForkPoolWorker-15] [68518373-ff9d-406c-bdaf-13301a44ad76] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:48:00.527776830Z [2024-02-23 23:48:00,527: INFO/ForkPoolWorker-16] [81c8ba5a-273a-46c0-be69-46104aa92d33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:48:00.533960023Z [2024-02-23 23:48:00,533: INFO/ForkPoolWorker-1] [bb27c96e-eb1a-4400-a5eb-19afd9694f15] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:48:00.541203916Z [2024-02-23 23:48:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95ee03b4-df46-40f6-9e99-ca185bc4cc17] received
2024-02-23T23:48:00.553265651Z [2024-02-23 23:48:00,552: INFO/ForkPoolWorker-2] [95ee03b4-df46-40f6-9e99-ca185bc4cc17] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:48:00.873351794Z [2024-02-23 23:48:00,869: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:48:00.920996920Z [2024-02-23 23:48:00,917: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:48:01.093352798Z [2024-02-23 23:48:01,090: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:48:01.098606717Z [2024-02-23 23:48:01,097: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:48:01.102581383Z [2024-02-23 23:48:01,102: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:48:01.117666456Z [2024-02-23 23:48:01,112: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:48:01.147152840Z [2024-02-23 23:48:01,146: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:48:01.148530429Z [2024-02-23 23:48:01,148: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:48:01.154124731Z [2024-02-23 23:48:01,148: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:48:01.154191016Z [2024-02-23 23:48:01,154: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:48:01.154469983Z [2024-02-23 23:48:01,154: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:48:01.340079126Z [2024-02-23 23:48:01,339: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:48:01.471022631Z [2024-02-23 23:48:01,470: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:48:01.986664862Z [2024-02-23 23:48:01,986: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95ee03b4-df46-40f6-9e99-ca185bc4cc17] succeeded in 1.4403676399999767s: None
2024-02-23T23:48:02.101425963Z [2024-02-23 23:48:02,100: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68518373-ff9d-406c-bdaf-13301a44ad76] succeeded in 1.5899291279999943s: None
2024-02-23T23:48:02.271245869Z [2024-02-23 23:48:02,270: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:48:02.274675485Z [2024-02-23 23:48:02,274: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:48:02.310975934Z [2024-02-23 23:48:02,310: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:48:02.312803284Z [2024-02-23 23:48:02,312: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:48:02.312850992Z [2024-02-23 23:48:02,312: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:48:02.312930135Z [2024-02-23 23:48:02,312: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:48:02.313031163Z [2024-02-23 23:48:02,312: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:48:02.313394842Z [2024-02-23 23:48:02,313: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:48:02.313516008Z [2024-02-23 23:48:02,313: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:48:02.414438198Z [2024-02-23 23:48:02,414: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:48:02.417259553Z [2024-02-23 23:48:02,417: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:48:02.417676211Z [2024-02-23 23:48:02,417: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:48:02.444179549Z [2024-02-23 23:48:02,443: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:48:02.445474868Z [2024-02-23 23:48:02,445: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:48:02.445524122Z [2024-02-23 23:48:02,445: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:48:02.445733934Z [2024-02-23 23:48:02,445: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:48:02.445977842Z [2024-02-23 23:48:02,445: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:48:02.446341483Z [2024-02-23 23:48:02,446: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:48:02.446475303Z [2024-02-23 23:48:02,446: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:48:02.550528459Z [2024-02-23 23:48:02,550: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:48:04.214478104Z [2024-02-23 23:48:04,213: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb27c96e-eb1a-4400-a5eb-19afd9694f15] succeeded in 3.6905978199999936s: None
2024-02-23T23:48:05.036281471Z [2024-02-23 23:48:05,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[81c8ba5a-273a-46c0-be69-46104aa92d33] succeeded in 4.51715275100014s: None
2024-02-23T23:49:00.591254998Z [2024-02-23 23:49:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d6dffba-09ce-4fab-a48d-9a1b20a0cd15] received
2024-02-23T23:49:00.594727261Z [2024-02-23 23:49:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef8a87e4-221c-4dfe-bab1-f5c6372da548] received
2024-02-23T23:49:00.603692809Z [2024-02-23 23:49:00,603: INFO/ForkPoolWorker-16] [ef8a87e4-221c-4dfe-bab1-f5c6372da548] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:49:00.604291297Z [2024-02-23 23:49:00,604: INFO/ForkPoolWorker-15] [0d6dffba-09ce-4fab-a48d-9a1b20a0cd15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:49:00.605371319Z [2024-02-23 23:49:00,605: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb3f0445-803e-469d-baf7-80a7d2ba7948] received
2024-02-23T23:49:00.621648737Z [2024-02-23 23:49:00,621: INFO/ForkPoolWorker-1] [bb3f0445-803e-469d-baf7-80a7d2ba7948] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:49:00.920913311Z [2024-02-23 23:49:00,917: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:49:00.944489146Z [2024-02-23 23:49:00,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:49:00.983870289Z [2024-02-23 23:49:00,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:49:01.179565816Z [2024-02-23 23:49:01,179: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-23T23:49:01.183507981Z [2024-02-23 23:49:01,183: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:49:01.214024093Z [2024-02-23 23:49:01,211: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:49:01.215061155Z [2024-02-23 23:49:01,214: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:49:01.215288045Z [2024-02-23 23:49:01,215: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:49:01.215297421Z [2024-02-23 23:49:01,215: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-23T23:49:01.215956439Z [2024-02-23 23:49:01,215: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:49:01.353940996Z [2024-02-23 23:49:01,353: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:49:01.932931356Z [2024-02-23 23:49:01,932: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d6dffba-09ce-4fab-a48d-9a1b20a0cd15] succeeded in 1.3365893640000195s: None
2024-02-23T23:49:02.248462422Z [2024-02-23 23:49:02,248: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:49:02.251985178Z [2024-02-23 23:49:02,251: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:49:02.272316205Z [2024-02-23 23:49:02,271: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:49:02.275872104Z [2024-02-23 23:49:02,275: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:49:02.276203614Z [2024-02-23 23:49:02,275: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:49:02.277729990Z [2024-02-23 23:49:02,277: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:49:02.277741083Z [2024-02-23 23:49:02,277: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:49:02.278095911Z [2024-02-23 23:49:02,277: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:49:02.278219841Z [2024-02-23 23:49:02,278: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:49:02.278525466Z [2024-02-23 23:49:02,278: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:49:02.278540803Z [2024-02-23 23:49:02,278: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:49:02.294942261Z [2024-02-23 23:49:02,294: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:49:02.296199326Z [2024-02-23 23:49:02,295: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:49:02.296242244Z [2024-02-23 23:49:02,296: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:49:02.296324520Z [2024-02-23 23:49:02,296: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:49:02.296361599Z [2024-02-23 23:49:02,296: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:49:02.296926966Z [2024-02-23 23:49:02,296: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:49:02.296939938Z [2024-02-23 23:49:02,296: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:49:02.361673857Z [2024-02-23 23:49:02,361: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:49:02.416728133Z [2024-02-23 23:49:02,416: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:49:04.169016911Z [2024-02-23 23:49:04,168: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb3f0445-803e-469d-baf7-80a7d2ba7948] succeeded in 3.561791005999794s: None
2024-02-23T23:49:04.785593967Z [2024-02-23 23:49:04,784: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef8a87e4-221c-4dfe-bab1-f5c6372da548] succeeded in 4.187543657999868s: None
2024-02-23T23:50:00.308055256Z [2024-02-23 23:50:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f510c90d-1d5b-4cc4-ae8d-17a3935da72c] received
2024-02-23T23:50:00.311674909Z [2024-02-23 23:50:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2bafd05-da1c-4537-8fbc-9e6d0d735071] received
2024-02-23T23:50:00.313471050Z [2024-02-23 23:50:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[33612008-b3a2-4420-873a-1211851d6317] received
2024-02-23T23:50:00.316965649Z [2024-02-23 23:50:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1d93ccb-28e1-41d0-81f5-3fa87d98d112] received
2024-02-23T23:50:00.317237988Z [2024-02-23 23:50:00,317: INFO/ForkPoolWorker-15] [f510c90d-1d5b-4cc4-ae8d-17a3935da72c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:50:00.326537040Z [2024-02-23 23:50:00,326: INFO/ForkPoolWorker-1] [33612008-b3a2-4420-873a-1211851d6317] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:50:00.326788219Z [2024-02-23 23:50:00,324: INFO/ForkPoolWorker-16] [e2bafd05-da1c-4537-8fbc-9e6d0d735071] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:50:00.326972066Z [2024-02-23 23:50:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dbf2f67-7873-4042-98e5-063125f26df2] received
2024-02-23T23:50:00.343554199Z [2024-02-23 23:50:00,343: INFO/ForkPoolWorker-2] [d1d93ccb-28e1-41d0-81f5-3fa87d98d112] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:50:00.347452564Z [2024-02-23 23:50:00,347: INFO/ForkPoolWorker-3] [7dbf2f67-7873-4042-98e5-063125f26df2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:50:00.608806646Z [2024-02-23 23:50:00,605: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:50:00.681489495Z [2024-02-23 23:50:00,677: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:50:00.749027785Z [2024-02-23 23:50:00,745: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:50:00.802756892Z [2024-02-23 23:50:00,795: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:50:00.808158484Z [2024-02-23 23:50:00,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:50:00.927639252Z [2024-02-23 23:50:00,927: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:50:00.935790004Z [2024-02-23 23:50:00,935: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:01.008987678Z [2024-02-23 23:50:01,008: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:50:01.010505572Z [2024-02-23 23:50:01,010: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:50:01.010652320Z [2024-02-23 23:50:01,010: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:50:01.010757651Z [2024-02-23 23:50:01,010: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:50:01.011038419Z [2024-02-23 23:50:01,010: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:50:01.130269413Z [2024-02-23 23:50:01,130: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:01.486878500Z [2024-02-23 23:50:01,486: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:01.972122834Z [2024-02-23 23:50:01,971: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d1d93ccb-28e1-41d0-81f5-3fa87d98d112] succeeded in 1.6526380909999716s: None
2024-02-23T23:50:02.430928843Z [2024-02-23 23:50:02,430: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[33612008-b3a2-4420-873a-1211851d6317] succeeded in 2.114056152000103s: None
2024-02-23T23:50:02.460405157Z [2024-02-23 23:50:02,460: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:50:02.463975186Z [2024-02-23 23:50:02,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:02.493524573Z [2024-02-23 23:50:02,493: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:50:02.501175915Z [2024-02-23 23:50:02,500: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:02.502834401Z [2024-02-23 23:50:02,502: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:02.503137952Z [2024-02-23 23:50:02,502: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:02.506082862Z [2024-02-23 23:50:02,505: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:50:02.506490906Z [2024-02-23 23:50:02,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:50:02.506637352Z [2024-02-23 23:50:02,506: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:02.641960169Z [2024-02-23 23:50:02,638: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:02.925104929Z [2024-02-23 23:50:02,924: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:50:02.929954878Z [2024-02-23 23:50:02,929: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:02.976398084Z [2024-02-23 23:50:02,975: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:50:02.979773299Z [2024-02-23 23:50:02,979: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:02.980121165Z [2024-02-23 23:50:02,979: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:02.980497422Z [2024-02-23 23:50:02,980: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:02.980936675Z [2024-02-23 23:50:02,980: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:50:02.981596389Z [2024-02-23 23:50:02,981: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:50:02.981987391Z [2024-02-23 23:50:02,981: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:03.132540223Z [2024-02-23 23:50:03,132: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:03.179043570Z [2024-02-23 23:50:03,178: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:50:03.186791535Z [2024-02-23 23:50:03,186: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:03.235874739Z [2024-02-23 23:50:03,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:50:03.238358894Z [2024-02-23 23:50:03,238: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:03.238621039Z [2024-02-23 23:50:03,238: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:03.239241134Z [2024-02-23 23:50:03,238: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:03.239443468Z [2024-02-23 23:50:03,239: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:50:03.239944373Z [2024-02-23 23:50:03,239: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:50:03.240325280Z [2024-02-23 23:50:03,239: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:03.373390262Z [2024-02-23 23:50:03,372: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:03.630485134Z [2024-02-23 23:50:03,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f510c90d-1d5b-4cc4-ae8d-17a3935da72c] succeeded in 3.3205675670001256s: None
2024-02-23T23:50:03.711795457Z [2024-02-23 23:50:03,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92f5aec8-4b36-4425-933a-33bbe725c9ab] received
2024-02-23T23:50:03.728089187Z [2024-02-23 23:50:03,727: INFO/ForkPoolWorker-15] [92f5aec8-4b36-4425-933a-33bbe725c9ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:50:04.162875049Z [2024-02-23 23:50:04,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:50:05.204694072Z [2024-02-23 23:50:05,204: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[7dbf2f67-7873-4042-98e5-063125f26df2] succeeded in 4.871496053000101s: None
2024-02-23T23:50:05.230604662Z [2024-02-23 23:50:05,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2bafd05-da1c-4537-8fbc-9e6d0d735071] succeeded in 4.914918320000197s: None
2024-02-23T23:50:05.368523896Z [2024-02-23 23:50:05,367: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:50:05.372458459Z [2024-02-23 23:50:05,371: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:05.405614398Z [2024-02-23 23:50:05,405: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:50:05.407060215Z [2024-02-23 23:50:05,406: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:05.407176376Z [2024-02-23 23:50:05,407: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:05.407402671Z [2024-02-23 23:50:05,407: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:05.407508595Z [2024-02-23 23:50:05,407: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:50:05.407866139Z [2024-02-23 23:50:05,407: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:50:05.407986702Z [2024-02-23 23:50:05,407: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:05.499148619Z [2024-02-23 23:50:05,498: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:06.173703396Z [2024-02-23 23:50:06,173: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92f5aec8-4b36-4425-933a-33bbe725c9ab] succeeded in 2.4585073900000225s: None
2024-02-23T23:50:06.212180570Z [2024-02-23 23:50:06,211: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[818eab96-2de2-4156-b147-d953ea0ca71d] received
2024-02-23T23:50:06.222690316Z [2024-02-23 23:50:06,222: INFO/ForkPoolWorker-15] [818eab96-2de2-4156-b147-d953ea0ca71d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:50:06.588410702Z [2024-02-23 23:50:06,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:50:07.766855969Z [2024-02-23 23:50:07,766: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:50:07.770263061Z [2024-02-23 23:50:07,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:07.799382534Z [2024-02-23 23:50:07,799: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:50:07.801198094Z [2024-02-23 23:50:07,800: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:07.801217569Z [2024-02-23 23:50:07,801: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:07.801389236Z [2024-02-23 23:50:07,801: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:07.801420695Z [2024-02-23 23:50:07,801: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:50:07.801742400Z [2024-02-23 23:50:07,801: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:50:07.801966349Z [2024-02-23 23:50:07,801: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:07.928892574Z [2024-02-23 23:50:07,928: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:08.596106342Z [2024-02-23 23:50:08,595: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[818eab96-2de2-4156-b147-d953ea0ca71d] succeeded in 2.3812938329999724s: None
2024-02-23T23:50:09.176018957Z [2024-02-23 23:50:09,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c683191d-72c9-4d58-8ec2-2f3e67a6fd31] received
2024-02-23T23:50:09.183578796Z [2024-02-23 23:50:09,183: INFO/ForkPoolWorker-15] [c683191d-72c9-4d58-8ec2-2f3e67a6fd31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:50:09.491982337Z [2024-02-23 23:50:09,488: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:50:10.611921110Z [2024-02-23 23:50:10,611: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:50:10.615428061Z [2024-02-23 23:50:10,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:50:10.634710292Z [2024-02-23 23:50:10,634: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:50:10.636182212Z [2024-02-23 23:50:10,635: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:50:10.636199696Z [2024-02-23 23:50:10,636: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:50:10.636339207Z [2024-02-23 23:50:10,636: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:50:10.636350971Z [2024-02-23 23:50:10,636: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:50:10.636737196Z [2024-02-23 23:50:10,636: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:50:10.636749180Z [2024-02-23 23:50:10,636: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:50:10.728595801Z [2024-02-23 23:50:10,728: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:50:11.368377965Z [2024-02-23 23:50:11,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c683191d-72c9-4d58-8ec2-2f3e67a6fd31] succeeded in 2.1886069170000155s: None
2024-02-23T23:51:01.253854664Z [2024-02-23 23:51:01,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1638356-93ca-45db-b275-ea34ac5c9610] received
2024-02-23T23:51:01.253878097Z [2024-02-23 23:51:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94e2ba09-51a8-4510-90f7-148a3722ac82] received
2024-02-23T23:51:01.280123786Z [2024-02-23 23:51:01,279: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df30aea7-e1f7-4d26-a560-8a6d6599214a] received
2024-02-23T23:51:01.282018635Z [2024-02-23 23:51:01,281: INFO/ForkPoolWorker-15] [a1638356-93ca-45db-b275-ea34ac5c9610] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:51:01.312902907Z [2024-02-23 23:51:01,312: INFO/ForkPoolWorker-1] [df30aea7-e1f7-4d26-a560-8a6d6599214a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:51:01.443106917Z [2024-02-23 23:51:01,442: INFO/ForkPoolWorker-16] [94e2ba09-51a8-4510-90f7-148a3722ac82] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:51:02.011036597Z [2024-02-23 23:51:02,006: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:51:02.013878240Z [2024-02-23 23:51:02,010: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:51:02.026599533Z [2024-02-23 23:51:02,022: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:51:02.313902428Z [2024-02-23 23:51:02,313: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-23T23:51:02.326475431Z [2024-02-23 23:51:02,323: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:51:02.429043645Z [2024-02-23 23:51:02,427: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:51:02.429068028Z [2024-02-23 23:51:02,428: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:51:02.429072758Z [2024-02-23 23:51:02,428: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:51:02.429076777Z [2024-02-23 23:51:02,428: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-23T23:51:02.429405818Z [2024-02-23 23:51:02,428: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:51:02.611911518Z [2024-02-23 23:51:02,611: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:51:03.918016957Z [2024-02-23 23:51:03,916: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[df30aea7-e1f7-4d26-a560-8a6d6599214a] succeeded in 2.6261722660001396s: None
2024-02-23T23:51:04.690209831Z [2024-02-23 23:51:04,689: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:51:04.693626660Z [2024-02-23 23:51:04,693: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:51:04.731548983Z [2024-02-23 23:51:04,731: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:51:04.734841680Z [2024-02-23 23:51:04,734: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:51:04.735242011Z [2024-02-23 23:51:04,734: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:51:04.735586085Z [2024-02-23 23:51:04,735: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:51:04.736010438Z [2024-02-23 23:51:04,735: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:51:04.736539133Z [2024-02-23 23:51:04,736: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:51:04.737461715Z [2024-02-23 23:51:04,736: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:51:04.788843675Z [2024-02-23 23:51:04,788: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:51:04.792142047Z [2024-02-23 23:51:04,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:51:04.835286431Z [2024-02-23 23:51:04,835: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:51:04.836336700Z [2024-02-23 23:51:04,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:51:04.839992791Z [2024-02-23 23:51:04,839: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:51:04.840300476Z [2024-02-23 23:51:04,839: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:51:04.840592182Z [2024-02-23 23:51:04,840: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:51:04.840779151Z [2024-02-23 23:51:04,840: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:51:04.841247611Z [2024-02-23 23:51:04,841: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:51:04.841746022Z [2024-02-23 23:51:04,841: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:51:04.922137977Z [2024-02-23 23:51:04,921: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:51:07.125615642Z [2024-02-23 23:51:07,125: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1638356-93ca-45db-b275-ea34ac5c9610] succeeded in 5.878934888000003s: None
2024-02-23T23:51:08.036458369Z [2024-02-23 23:51:08,035: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94e2ba09-51a8-4510-90f7-148a3722ac82] succeeded in 6.769127949999984s: None
2024-02-23T23:52:00.594037387Z [2024-02-23 23:52:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb5e862a-ed66-4646-b7bd-d2373f1b9236] received
2024-02-23T23:52:00.598653096Z [2024-02-23 23:52:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2901f1f8-1bcc-445b-991a-47f655aa387f] received
2024-02-23T23:52:00.605015038Z [2024-02-23 23:52:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[482271f8-362d-484f-b864-6522f554cfe5] received
2024-02-23T23:52:00.609181796Z [2024-02-23 23:52:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9a9291d-cfad-4420-b28a-6111fa9eb1cc] received
2024-02-23T23:52:00.613389352Z [2024-02-23 23:52:00,612: INFO/ForkPoolWorker-15] [cb5e862a-ed66-4646-b7bd-d2373f1b9236] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:52:00.622367595Z [2024-02-23 23:52:00,622: INFO/ForkPoolWorker-16] [2901f1f8-1bcc-445b-991a-47f655aa387f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:52:00.622672536Z [2024-02-23 23:52:00,622: INFO/ForkPoolWorker-1] [482271f8-362d-484f-b864-6522f554cfe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:52:00.624726810Z [2024-02-23 23:52:00,624: INFO/ForkPoolWorker-2] [e9a9291d-cfad-4420-b28a-6111fa9eb1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:52:00.980710992Z [2024-02-23 23:52:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:52:01.204861806Z [2024-02-23 23:52:01,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:52:01.225932159Z [2024-02-23 23:52:01,196: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:52:01.502653278Z [2024-02-23 23:52:01,491: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:52:01.644876767Z [2024-02-23 23:52:01,644: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:52:01.830506442Z [2024-02-23 23:52:01,827: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-23T23:52:01.837160513Z [2024-02-23 23:52:01,836: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:52:01.921484151Z [2024-02-23 23:52:01,921: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:52:01.924254640Z [2024-02-23 23:52:01,924: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:52:01.924286288Z [2024-02-23 23:52:01,924: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:52:01.924357631Z [2024-02-23 23:52:01,924: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-23T23:52:01.924568123Z [2024-02-23 23:52:01,924: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:52:02.213562612Z [2024-02-23 23:52:02,213: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:52:02.861063247Z [2024-02-23 23:52:02,860: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb5e862a-ed66-4646-b7bd-d2373f1b9236] succeeded in 2.2579547949999323s: None
2024-02-23T23:52:03.026411121Z [2024-02-23 23:52:03,025: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:52:03.031286122Z [2024-02-23 23:52:03,030: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:52:03.074471443Z [2024-02-23 23:52:03,074: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:52:03.079449626Z [2024-02-23 23:52:03,079: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:52:03.079477424Z [2024-02-23 23:52:03,079: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:52:03.079670702Z [2024-02-23 23:52:03,079: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:52:03.079876582Z [2024-02-23 23:52:03,079: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:52:03.080165568Z [2024-02-23 23:52:03,080: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:52:03.080368522Z [2024-02-23 23:52:03,080: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:52:03.267514347Z [2024-02-23 23:52:03,267: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:52:03.476760583Z [2024-02-23 23:52:03,476: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e9a9291d-cfad-4420-b28a-6111fa9eb1cc] succeeded in 2.865456912999889s: None
2024-02-23T23:52:03.553950104Z [2024-02-23 23:52:03,553: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:52:03.564938799Z [2024-02-23 23:52:03,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:52:03.602589959Z [2024-02-23 23:52:03,602: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:52:03.606557753Z [2024-02-23 23:52:03,606: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:52:03.606895327Z [2024-02-23 23:52:03,606: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:52:03.607136606Z [2024-02-23 23:52:03,606: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:52:03.607258599Z [2024-02-23 23:52:03,607: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:52:03.607570507Z [2024-02-23 23:52:03,607: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:52:03.607702438Z [2024-02-23 23:52:03,607: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:52:03.721019581Z [2024-02-23 23:52:03,720: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:52:05.262309060Z [2024-02-23 23:52:05,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2901f1f8-1bcc-445b-991a-47f655aa387f] succeeded in 4.660939043999861s: None
2024-02-23T23:52:06.724226486Z [2024-02-23 23:52:06,723: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[482271f8-362d-484f-b864-6522f554cfe5] succeeded in 6.116812074999871s: None
2024-02-23T23:53:00.555979130Z [2024-02-23 23:53:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8622bd75-5aaa-4ecf-a918-89b6aa66209a] received
2024-02-23T23:53:00.566011663Z [2024-02-23 23:53:00,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4342154a-8af7-4a62-a51e-743bbd5037d0] received
2024-02-23T23:53:00.569183466Z [2024-02-23 23:53:00,568: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cf52209-cf1e-4157-9426-6592ff754ab0] received
2024-02-23T23:53:00.576285235Z [2024-02-23 23:53:00,575: INFO/ForkPoolWorker-15] [8622bd75-5aaa-4ecf-a918-89b6aa66209a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:53:00.578023920Z [2024-02-23 23:53:00,577: INFO/ForkPoolWorker-16] [4342154a-8af7-4a62-a51e-743bbd5037d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:53:00.583182134Z [2024-02-23 23:53:00,582: INFO/ForkPoolWorker-1] [4cf52209-cf1e-4157-9426-6592ff754ab0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:53:00.888599222Z [2024-02-23 23:53:00,884: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:53:00.916958162Z [2024-02-23 23:53:00,912: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:53:00.942183761Z [2024-02-23 23:53:00,937: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:53:01.120796494Z [2024-02-23 23:53:01,120: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-23T23:53:01.124807817Z [2024-02-23 23:53:01,124: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:53:01.146758989Z [2024-02-23 23:53:01,146: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:53:01.147947535Z [2024-02-23 23:53:01,147: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:53:01.148140373Z [2024-02-23 23:53:01,147: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:53:01.148305649Z [2024-02-23 23:53:01,148: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-23T23:53:01.148572533Z [2024-02-23 23:53:01,148: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:53:01.333969749Z [2024-02-23 23:53:01,333: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:53:01.993861290Z [2024-02-23 23:53:01,993: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4342154a-8af7-4a62-a51e-743bbd5037d0] succeeded in 1.425287186000105s: None
2024-02-23T23:53:02.245609702Z [2024-02-23 23:53:02,245: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:53:02.249121129Z [2024-02-23 23:53:02,248: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:53:02.267576943Z [2024-02-23 23:53:02,267: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:53:02.268818969Z [2024-02-23 23:53:02,268: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:53:02.268862242Z [2024-02-23 23:53:02,268: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:53:02.268979400Z [2024-02-23 23:53:02,268: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:53:02.269014537Z [2024-02-23 23:53:02,268: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:53:02.269233391Z [2024-02-23 23:53:02,269: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:53:02.269264683Z [2024-02-23 23:53:02,269: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:53:02.320284403Z [2024-02-23 23:53:02,319: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:53:02.324806946Z [2024-02-23 23:53:02,324: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:53:02.366768626Z [2024-02-23 23:53:02,366: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:53:02.370586072Z [2024-02-23 23:53:02,370: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:53:02.370873322Z [2024-02-23 23:53:02,370: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:53:02.370999149Z [2024-02-23 23:53:02,370: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:53:02.371171099Z [2024-02-23 23:53:02,370: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:53:02.371724361Z [2024-02-23 23:53:02,371: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:53:02.371898016Z [2024-02-23 23:53:02,371: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:53:02.389952052Z [2024-02-23 23:53:02,383: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:53:02.511741523Z [2024-02-23 23:53:02,511: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:53:04.023858107Z [2024-02-23 23:53:04,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8622bd75-5aaa-4ecf-a918-89b6aa66209a] succeeded in 3.46509690400012s: None
2024-02-23T23:53:04.879559570Z [2024-02-23 23:53:04,878: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4cf52209-cf1e-4157-9426-6592ff754ab0] succeeded in 4.3075203410000995s: None
2024-02-23T23:54:00.985455965Z [2024-02-23 23:54:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12f33f35-fc48-4067-845f-a66f00ee0298] received
2024-02-23T23:54:00.987372520Z [2024-02-23 23:54:00,987: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70b0c592-8c3f-4f4b-8bff-007dfa1cec59] received
2024-02-23T23:54:00.993714546Z [2024-02-23 23:54:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af532a1e-4613-4e8a-a9d5-cd2a768a99cd] received
2024-02-23T23:54:00.996856883Z [2024-02-23 23:54:00,996: INFO/ForkPoolWorker-16] [70b0c592-8c3f-4f4b-8bff-007dfa1cec59] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:54:01.000246899Z [2024-02-23 23:54:00,999: INFO/ForkPoolWorker-1] [af532a1e-4613-4e8a-a9d5-cd2a768a99cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:54:01.002576337Z [2024-02-23 23:54:01,002: INFO/ForkPoolWorker-15] [12f33f35-fc48-4067-845f-a66f00ee0298] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:54:01.008129842Z [2024-02-23 23:54:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f9947c3-bac3-49d6-a7dc-2826d99f05bd] received
2024-02-23T23:54:01.021652053Z [2024-02-23 23:54:01,021: INFO/ForkPoolWorker-2] [6f9947c3-bac3-49d6-a7dc-2826d99f05bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:54:01.355883588Z [2024-02-23 23:54:01,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:54:01.471000754Z [2024-02-23 23:54:01,465: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:54:01.513976857Z [2024-02-23 23:54:01,513: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-23T23:54:01.517718452Z [2024-02-23 23:54:01,517: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:54:01.528733639Z [2024-02-23 23:54:01,522: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:54:01.551294085Z [2024-02-23 23:54:01,551: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:54:01.553040144Z [2024-02-23 23:54:01,552: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:54:01.553122377Z [2024-02-23 23:54:01,552: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:54:01.553206760Z [2024-02-23 23:54:01,553: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-23T23:54:01.553452591Z [2024-02-23 23:54:01,553: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:54:01.612819928Z [2024-02-23 23:54:01,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:54:01.645805398Z [2024-02-23 23:54:01,645: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:54:01.799069594Z [2024-02-23 23:54:01,796: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:54:02.267105836Z [2024-02-23 23:54:02,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70b0c592-8c3f-4f4b-8bff-007dfa1cec59] succeeded in 1.2778726909998568s: None
2024-02-23T23:54:02.477647740Z [2024-02-23 23:54:02,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[12f33f35-fc48-4067-845f-a66f00ee0298] succeeded in 1.488514541000086s: None
2024-02-23T23:54:02.884373462Z [2024-02-23 23:54:02,883: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:54:02.889050106Z [2024-02-23 23:54:02,888: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:54:02.911617163Z [2024-02-23 23:54:02,911: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:54:02.914313161Z [2024-02-23 23:54:02,914: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:54:02.914467128Z [2024-02-23 23:54:02,914: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:54:02.914719313Z [2024-02-23 23:54:02,914: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:54:02.914839878Z [2024-02-23 23:54:02,914: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:54:02.915191423Z [2024-02-23 23:54:02,915: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:54:02.915306328Z [2024-02-23 23:54:02,915: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:54:03.017584942Z [2024-02-23 23:54:03,017: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:54:03.132214194Z [2024-02-23 23:54:03,131: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:54:03.135563099Z [2024-02-23 23:54:03,135: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:54:03.162732607Z [2024-02-23 23:54:03,162: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:54:03.164483313Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:54:03.164492208Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:54:03.164609067Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:54:03.164644730Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:54:03.164878993Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:54:03.164885978Z [2024-02-23 23:54:03,164: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:54:03.271706956Z [2024-02-23 23:54:03,271: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:54:05.891896972Z [2024-02-23 23:54:05,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af532a1e-4613-4e8a-a9d5-cd2a768a99cd] succeeded in 4.89681412799996s: None
2024-02-23T23:54:06.394470556Z [2024-02-23 23:54:06,394: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6f9947c3-bac3-49d6-a7dc-2826d99f05bd] succeeded in 5.384510008999996s: None
2024-02-23T23:55:00.332684383Z [2024-02-23 23:55:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e54f3c86-56e6-434f-83c9-3f24c3747120] received
2024-02-23T23:55:00.335380450Z [2024-02-23 23:55:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[484b12c1-7db8-4aa0-86de-cbf8971cbc4c] received
2024-02-23T23:55:00.347003109Z [2024-02-23 23:55:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97fa297d-ebe1-4cc2-8027-d07b30765403] received
2024-02-23T23:55:00.350642247Z [2024-02-23 23:55:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdc72c51-9ef8-4fab-b645-fe0ddbd68be0] received
2024-02-23T23:55:00.361393339Z [2024-02-23 23:55:00,361: INFO/ForkPoolWorker-16] [484b12c1-7db8-4aa0-86de-cbf8971cbc4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:55:00.361418619Z [2024-02-23 23:55:00,361: INFO/ForkPoolWorker-1] [97fa297d-ebe1-4cc2-8027-d07b30765403] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:55:00.362183545Z [2024-02-23 23:55:00,361: INFO/ForkPoolWorker-15] [e54f3c86-56e6-434f-83c9-3f24c3747120] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:55:00.366826360Z [2024-02-23 23:55:00,366: INFO/ForkPoolWorker-2] [bdc72c51-9ef8-4fab-b645-fe0ddbd68be0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:55:00.694075668Z [2024-02-23 23:55:00,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:55:00.701265655Z [2024-02-23 23:55:00,698: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:55:00.830415389Z [2024-02-23 23:55:00,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:55:00.848274443Z [2024-02-23 23:55:00,845: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:55:00.894869172Z [2024-02-23 23:55:00,894: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-23T23:55:00.902688053Z [2024-02-23 23:55:00,902: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:00.933313698Z [2024-02-23 23:55:00,931: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:55:00.934611284Z [2024-02-23 23:55:00,934: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:55:00.934813388Z [2024-02-23 23:55:00,934: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:55:00.934941789Z [2024-02-23 23:55:00,934: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-23T23:55:00.935218669Z [2024-02-23 23:55:00,935: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:55:01.036084567Z [2024-02-23 23:55:01,035: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:01.677665785Z [2024-02-23 23:55:01,677: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[97fa297d-ebe1-4cc2-8027-d07b30765403] succeeded in 1.3285590240000147s: None
2024-02-23T23:55:02.110089842Z [2024-02-23 23:55:02,109: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:55:02.113861189Z [2024-02-23 23:55:02,113: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:02.136789582Z [2024-02-23 23:55:02,136: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:55:02.141396027Z [2024-02-23 23:55:02,141: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:02.141582783Z [2024-02-23 23:55:02,141: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:02.141752120Z [2024-02-23 23:55:02,141: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:02.141905351Z [2024-02-23 23:55:02,141: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:55:02.142219968Z [2024-02-23 23:55:02,142: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:55:02.142297765Z [2024-02-23 23:55:02,142: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:02.204977648Z [2024-02-23 23:55:02,204: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:55:02.208293878Z [2024-02-23 23:55:02,207: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:02.230129173Z [2024-02-23 23:55:02,229: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:55:02.232432392Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:02.232446962Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:02.232556927Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:02.232566718Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:55:02.232948187Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:55:02.233026699Z [2024-02-23 23:55:02,232: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:02.243317321Z [2024-02-23 23:55:02,243: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:02.263715052Z [2024-02-23 23:55:02,263: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:55:02.267309419Z [2024-02-23 23:55:02,266: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:02.291952343Z [2024-02-23 23:55:02,291: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:55:02.293400012Z [2024-02-23 23:55:02,293: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:02.293587842Z [2024-02-23 23:55:02,293: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:02.293886875Z [2024-02-23 23:55:02,293: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:02.294096405Z [2024-02-23 23:55:02,293: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:55:02.294577965Z [2024-02-23 23:55:02,294: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:55:02.294763478Z [2024-02-23 23:55:02,294: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:02.320358845Z [2024-02-23 23:55:02,320: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:02.385970070Z [2024-02-23 23:55:02,384: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:03.082356560Z [2024-02-23 23:55:03,081: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e54f3c86-56e6-434f-83c9-3f24c3747120] succeeded in 2.7457288139999037s: None
2024-02-23T23:55:03.777966882Z [2024-02-23 23:55:03,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09f80ab3-ab68-43bc-87fb-206e254776a7] received
2024-02-23T23:55:03.798658412Z [2024-02-23 23:55:03,798: INFO/ForkPoolWorker-15] [09f80ab3-ab68-43bc-87fb-206e254776a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:55:04.025333320Z [2024-02-23 23:55:04,024: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[484b12c1-7db8-4aa0-86de-cbf8971cbc4c] succeeded in 3.686823898000057s: None
2024-02-23T23:55:04.089614868Z [2024-02-23 23:55:04,086: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:55:04.248111804Z [2024-02-23 23:55:04,247: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bdc72c51-9ef8-4fab-b645-fe0ddbd68be0] succeeded in 3.894722553000065s: None
2024-02-23T23:55:05.286030831Z [2024-02-23 23:55:05,285: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:55:05.289427655Z [2024-02-23 23:55:05,288: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:05.310242284Z [2024-02-23 23:55:05,309: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:55:05.311436901Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:05.311540747Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:05.311707562Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:05.311721827Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:55:05.311993938Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:55:05.312009179Z [2024-02-23 23:55:05,311: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:05.405893542Z [2024-02-23 23:55:05,405: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:06.045507248Z [2024-02-23 23:55:06,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[09f80ab3-ab68-43bc-87fb-206e254776a7] succeeded in 2.261216251000178s: None
2024-02-23T23:55:06.194579550Z [2024-02-23 23:55:06,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f24c10e-d1c1-4077-8aa5-dc8357f6dadd] received
2024-02-23T23:55:06.201743846Z [2024-02-23 23:55:06,201: INFO/ForkPoolWorker-15] [3f24c10e-d1c1-4077-8aa5-dc8357f6dadd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:55:06.500549145Z [2024-02-23 23:55:06,497: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:55:07.667631211Z [2024-02-23 23:55:07,667: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:55:07.671452973Z [2024-02-23 23:55:07,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:07.692844106Z [2024-02-23 23:55:07,692: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:55:07.694115831Z [2024-02-23 23:55:07,693: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:07.694152436Z [2024-02-23 23:55:07,694: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:07.694291878Z [2024-02-23 23:55:07,694: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:07.694302464Z [2024-02-23 23:55:07,694: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:55:07.694575708Z [2024-02-23 23:55:07,694: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:55:07.694584388Z [2024-02-23 23:55:07,694: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:07.776372827Z [2024-02-23 23:55:07,776: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:08.289470576Z [2024-02-23 23:55:08,289: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f24c10e-d1c1-4077-8aa5-dc8357f6dadd] succeeded in 2.0934117029999015s: None
2024-02-23T23:55:08.754661971Z [2024-02-23 23:55:08,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61d21e70-faaf-477c-9000-d50b623f911e] received
2024-02-23T23:55:08.763224415Z [2024-02-23 23:55:08,762: INFO/ForkPoolWorker-15] [61d21e70-faaf-477c-9000-d50b623f911e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:55:09.176891748Z [2024-02-23 23:55:09,173: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:55:10.277916337Z [2024-02-23 23:55:10,277: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:55:10.281309632Z [2024-02-23 23:55:10,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:55:10.303934251Z [2024-02-23 23:55:10,303: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:55:10.305879990Z [2024-02-23 23:55:10,305: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:55:10.305905318Z [2024-02-23 23:55:10,305: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:55:10.306092539Z [2024-02-23 23:55:10,305: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:55:10.306243094Z [2024-02-23 23:55:10,306: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:55:10.306596619Z [2024-02-23 23:55:10,306: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:55:10.306631791Z [2024-02-23 23:55:10,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:55:10.385271768Z [2024-02-23 23:55:10,384: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:55:10.963661278Z [2024-02-23 23:55:10,963: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[61d21e70-faaf-477c-9000-d50b623f911e] succeeded in 2.2065076540000064s: None
2024-02-23T23:56:00.959006871Z [2024-02-23 23:56:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37351696-a33b-4b36-8d43-b0c97818571f] received
2024-02-23T23:56:00.964999092Z [2024-02-23 23:56:00,964: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bde347ac-e9e7-4368-9ce4-4ddc8528e9ab] received
2024-02-23T23:56:00.971004112Z [2024-02-23 23:56:00,970: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[129e25ba-4a38-492d-9fc7-1e2ece975fcd] received
2024-02-23T23:56:00.973201241Z [2024-02-23 23:56:00,972: INFO/ForkPoolWorker-16] [bde347ac-e9e7-4368-9ce4-4ddc8528e9ab] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:56:00.978413272Z [2024-02-23 23:56:00,978: INFO/ForkPoolWorker-15] [37351696-a33b-4b36-8d43-b0c97818571f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:56:00.978986815Z [2024-02-23 23:56:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca85173e-e189-405b-84d7-fb3fb0e36c34] received
2024-02-23T23:56:00.988092752Z [2024-02-23 23:56:00,987: INFO/ForkPoolWorker-2] [ca85173e-e189-405b-84d7-fb3fb0e36c34] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:56:00.993356666Z [2024-02-23 23:56:00,992: INFO/ForkPoolWorker-1] [129e25ba-4a38-492d-9fc7-1e2ece975fcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:56:01.404825548Z [2024-02-23 23:56:01,401: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:56:01.442008571Z [2024-02-23 23:56:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:56:01.451900166Z [2024-02-23 23:56:01,446: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:56:01.546634059Z [2024-02-23 23:56:01,543: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:56:01.740315353Z [2024-02-23 23:56:01,739: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-23T23:56:01.748933173Z [2024-02-23 23:56:01,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:56:01.783533089Z [2024-02-23 23:56:01,783: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:56:01.786037177Z [2024-02-23 23:56:01,785: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:56:01.786238629Z [2024-02-23 23:56:01,785: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:56:01.786391279Z [2024-02-23 23:56:01,786: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-23T23:56:01.786861475Z [2024-02-23 23:56:01,786: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:56:01.829597390Z [2024-02-23 23:56:01,829: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:56:01.918680532Z [2024-02-23 23:56:01,918: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:56:02.527678098Z [2024-02-23 23:56:02,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37351696-a33b-4b36-8d43-b0c97818571f] succeeded in 1.56083708999995s: None
2024-02-23T23:56:02.574992426Z [2024-02-23 23:56:02,574: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bde347ac-e9e7-4368-9ce4-4ddc8528e9ab] succeeded in 1.6077491260002716s: None
2024-02-23T23:56:02.878875498Z [2024-02-23 23:56:02,878: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:56:02.882032063Z [2024-02-23 23:56:02,881: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:56:02.903858365Z [2024-02-23 23:56:02,903: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:56:02.905254892Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:56:02.905266816Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:56:02.905397126Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:56:02.905436356Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:56:02.905738884Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:56:02.905747660Z [2024-02-23 23:56:02,905: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:56:03.019897894Z [2024-02-23 23:56:03,019: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:56:03.097453289Z [2024-02-23 23:56:03,097: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-23T23:56:03.101243552Z [2024-02-23 23:56:03,100: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:56:03.123351253Z [2024-02-23 23:56:03,123: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:56:03.124863599Z [2024-02-23 23:56:03,124: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:56:03.125030765Z [2024-02-23 23:56:03,124: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:56:03.125251615Z [2024-02-23 23:56:03,125: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:56:03.125386353Z [2024-02-23 23:56:03,125: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-23T23:56:03.125878752Z [2024-02-23 23:56:03,125: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:56:03.126061838Z [2024-02-23 23:56:03,125: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:56:03.220219371Z [2024-02-23 23:56:03,219: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:56:05.232740235Z [2024-02-23 23:56:05,232: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ca85173e-e189-405b-84d7-fb3fb0e36c34] succeeded in 4.251581569999871s: None
2024-02-23T23:56:05.423991879Z [2024-02-23 23:56:05,423: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[129e25ba-4a38-492d-9fc7-1e2ece975fcd] succeeded in 4.44790923499977s: None
2024-02-23T23:57:00.614886226Z [2024-02-23 23:57:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9105ed24-50b7-4998-89ac-9489d53b2bc0] received
2024-02-23T23:57:00.620249633Z [2024-02-23 23:57:00,619: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7731caa-8c1b-4275-b032-f31a8827ae44] received
2024-02-23T23:57:00.623269425Z [2024-02-23 23:57:00,623: INFO/ForkPoolWorker-15] [9105ed24-50b7-4998-89ac-9489d53b2bc0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:57:00.623934620Z [2024-02-23 23:57:00,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7238283e-77e5-420c-8046-1bb6bdd8a93d] received
2024-02-23T23:57:00.632162964Z [2024-02-23 23:57:00,631: INFO/ForkPoolWorker-16] [e7731caa-8c1b-4275-b032-f31a8827ae44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:57:00.640992380Z [2024-02-23 23:57:00,638: INFO/ForkPoolWorker-1] [7238283e-77e5-420c-8046-1bb6bdd8a93d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:57:00.959925599Z [2024-02-23 23:57:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:57:00.969213838Z [2024-02-23 23:57:00,966: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:57:00.971407700Z [2024-02-23 23:57:00,968: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:57:01.175082248Z [2024-02-23 23:57:01,174: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-23T23:57:01.179984430Z [2024-02-23 23:57:01,179: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:57:01.266102738Z [2024-02-23 23:57:01,263: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:57:01.266130002Z [2024-02-23 23:57:01,265: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:57:01.266133759Z [2024-02-23 23:57:01,265: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:57:01.266137661Z [2024-02-23 23:57:01,265: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-23T23:57:01.266141387Z [2024-02-23 23:57:01,265: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:57:01.398948506Z [2024-02-23 23:57:01,398: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:57:02.088443857Z [2024-02-23 23:57:02,087: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7238283e-77e5-420c-8046-1bb6bdd8a93d] succeeded in 1.4618246400000316s: None
2024-02-23T23:57:02.181131193Z [2024-02-23 23:57:02,180: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:57:02.185650670Z [2024-02-23 23:57:02,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:57:02.207163845Z [2024-02-23 23:57:02,206: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:57:02.208867431Z [2024-02-23 23:57:02,208: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:57:02.208885390Z [2024-02-23 23:57:02,208: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:57:02.209002303Z [2024-02-23 23:57:02,208: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:57:02.209018701Z [2024-02-23 23:57:02,208: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:57:02.209247542Z [2024-02-23 23:57:02,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:57:02.209268858Z [2024-02-23 23:57:02,209: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:57:02.288897655Z [2024-02-23 23:57:02,288: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:57:02.292393805Z [2024-02-23 23:57:02,291: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:57:02.301984660Z [2024-02-23 23:57:02,301: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:57:02.315347041Z [2024-02-23 23:57:02,315: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:57:02.317311137Z [2024-02-23 23:57:02,317: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:57:02.317544740Z [2024-02-23 23:57:02,317: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:57:02.317766825Z [2024-02-23 23:57:02,317: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:57:02.318040899Z [2024-02-23 23:57:02,317: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:57:02.318523854Z [2024-02-23 23:57:02,318: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:57:02.318729145Z [2024-02-23 23:57:02,318: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:57:02.443008596Z [2024-02-23 23:57:02,442: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:57:03.962640169Z [2024-02-23 23:57:03,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9105ed24-50b7-4998-89ac-9489d53b2bc0] succeeded in 3.3453565380000327s: None
2024-02-23T23:57:04.470519256Z [2024-02-23 23:57:04,469: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e7731caa-8c1b-4275-b032-f31a8827ae44] succeeded in 3.8474310259998674s: None
2024-02-23T23:58:01.101541905Z [2024-02-23 23:58:01,101: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1921db5a-17bc-47fe-b641-e2994004a707] received
2024-02-23T23:58:01.110872579Z [2024-02-23 23:58:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5798b540-23de-4023-a659-9313622c3fac] received
2024-02-23T23:58:01.121534307Z [2024-02-23 23:58:01,120: INFO/ForkPoolWorker-15] [1921db5a-17bc-47fe-b641-e2994004a707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:58:01.122443969Z [2024-02-23 23:58:01,122: INFO/ForkPoolWorker-16] [5798b540-23de-4023-a659-9313622c3fac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:58:01.129744458Z [2024-02-23 23:58:01,129: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[43d97297-13a5-469a-8383-62190f674018] received
2024-02-23T23:58:01.133177077Z [2024-02-23 23:58:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46155456-ff5d-402a-acf8-06ab16b3e9a9] received
2024-02-23T23:58:01.143773849Z [2024-02-23 23:58:01,143: INFO/ForkPoolWorker-2] [46155456-ff5d-402a-acf8-06ab16b3e9a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:58:01.156544431Z [2024-02-23 23:58:01,156: INFO/ForkPoolWorker-1] [43d97297-13a5-469a-8383-62190f674018] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-23T23:58:01.482197811Z [2024-02-23 23:58:01,476: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:58:01.540487370Z [2024-02-23 23:58:01,536: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:58:01.583661702Z [2024-02-23 23:58:01,579: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-23T23:58:01.651890076Z [2024-02-23 23:58:01,645: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:58:01.662085298Z [2024-02-23 23:58:01,661: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-23T23:58:01.666133984Z [2024-02-23 23:58:01,665: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:58:01.715866628Z [2024-02-23 23:58:01,715: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:58:01.718635123Z [2024-02-23 23:58:01,718: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:58:01.720488577Z [2024-02-23 23:58:01,720: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:58:01.721197666Z [2024-02-23 23:58:01,720: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-23T23:58:01.721607343Z [2024-02-23 23:58:01,721: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:58:01.835596249Z [2024-02-23 23:58:01,835: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:01.886332672Z [2024-02-23 23:58:01,886: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:02.560126785Z [2024-02-23 23:58:02,559: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5798b540-23de-4023-a659-9313622c3fac] succeeded in 1.4450040500000796s: None
2024-02-23T23:58:02.613821993Z [2024-02-23 23:58:02,613: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[43d97297-13a5-469a-8383-62190f674018] succeeded in 1.4821987169998465s: None
2024-02-23T23:58:02.966250661Z [2024-02-23 23:58:02,965: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:58:02.969871176Z [2024-02-23 23:58:02,969: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:58:02.990597937Z [2024-02-23 23:58:02,990: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:58:02.992049323Z [2024-02-23 23:58:02,991: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:58:02.992064517Z [2024-02-23 23:58:02,991: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:58:02.992179796Z [2024-02-23 23:58:02,991: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:58:02.992282629Z [2024-02-23 23:58:02,992: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:58:02.992875718Z [2024-02-23 23:58:02,992: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:58:02.992887714Z [2024-02-23 23:58:02,992: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:58:03.099544362Z [2024-02-23 23:58:03,099: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:03.107662623Z [2024-02-23 23:58:03,107: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:58:03.111185777Z [2024-02-23 23:58:03,110: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:58:03.135549434Z [2024-02-23 23:58:03,135: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:58:03.137095346Z [2024-02-23 23:58:03,136: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:58:03.137108547Z [2024-02-23 23:58:03,137: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:58:03.137557578Z [2024-02-23 23:58:03,137: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-23T23:58:03.137631853Z [2024-02-23 23:58:03,137: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:58:03.138116940Z [2024-02-23 23:58:03,137: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:58:03.138257837Z [2024-02-23 23:58:03,138: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:58:03.228452162Z [2024-02-23 23:58:03,228: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:04.662429735Z [2024-02-23 23:58:04,659: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[46155456-ff5d-402a-acf8-06ab16b3e9a9] succeeded in 3.524144688999968s: None
2024-02-23T23:58:05.173071258Z [2024-02-23 23:58:05,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1921db5a-17bc-47fe-b641-e2994004a707] succeeded in 4.069162579000022s: None
2024-02-23T23:58:54.872416292Z [2024-02-23 23:58:54,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f8a4889-385a-491e-a436-424343648d5a] received
2024-02-23T23:58:54.883801828Z [2024-02-23 23:58:54,883: INFO/ForkPoolWorker-15] [6f8a4889-385a-491e-a436-424343648d5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:58:55.175935492Z [2024-02-23 23:58:55,172: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:58:56.277897032Z [2024-02-23 23:58:56,277: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:58:56.281311192Z [2024-02-23 23:58:56,280: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:58:56.305582957Z [2024-02-23 23:58:56,305: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:58:56.307298973Z [2024-02-23 23:58:56,306: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:58:56.307323663Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:58:56.307330949Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:58:56.307478039Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:58:56.307491673Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:58:56.307848125Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:58:56.307936457Z [2024-02-23 23:58:56,307: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:58:56.317723082Z [2024-02-23 23:58:56,317: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:58:56.414483681Z [2024-02-23 23:58:56,414: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:57.045764815Z [2024-02-23 23:58:57,045: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f8a4889-385a-491e-a436-424343648d5a] succeeded in 2.1704656669999167s: None
2024-02-23T23:58:57.234081352Z [2024-02-23 23:58:57,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13735d9e-f98d-497c-80a4-a3e9c481e64a] received
2024-02-23T23:58:57.242818123Z [2024-02-23 23:58:57,242: INFO/ForkPoolWorker-15] [13735d9e-f98d-497c-80a4-a3e9c481e64a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:58:57.561539030Z [2024-02-23 23:58:57,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:58:58.581639040Z [2024-02-23 23:58:58,581: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:58:58.584827119Z [2024-02-23 23:58:58,584: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:58:58.605964632Z [2024-02-23 23:58:58,605: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:58:58.607216189Z [2024-02-23 23:58:58,606: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:58:58.607286604Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:58:58.607383210Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:58:58.607578376Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:58:58.607635146Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:58:58.607899089Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:58:58.608046110Z [2024-02-23 23:58:58,607: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:58:58.614555733Z [2024-02-23 23:58:58,614: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:58:58.715682712Z [2024-02-23 23:58:58,715: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:58:59.404054507Z [2024-02-23 23:58:59,403: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[13735d9e-f98d-497c-80a4-a3e9c481e64a] succeeded in 2.1661927899999682s: None
2024-02-23T23:58:59.863592101Z [2024-02-23 23:58:59,863: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bea96db-a145-4bbc-95cf-f78329134b4b] received
2024-02-23T23:58:59.876665267Z [2024-02-23 23:58:59,876: INFO/ForkPoolWorker-15] [8bea96db-a145-4bbc-95cf-f78329134b4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-23T23:59:00.157318975Z [2024-02-23 23:59:00,154: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:59:01.348021514Z [2024-02-23 23:59:01,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[48e8f29f-dc89-4791-bbbf-dde683d9f8c9] received
2024-02-23T23:59:01.354913034Z [2024-02-23 23:59:01,354: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:59:01.355006945Z [2024-02-23 23:59:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eb60b137-c6be-4dfe-b7ef-ec6c70cd30c8] received
2024-02-23T23:59:01.358982139Z [2024-02-23 23:59:01,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:01.361272132Z [2024-02-23 23:59:01,361: INFO/ForkPoolWorker-16] [48e8f29f-dc89-4791-bbbf-dde683d9f8c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:59:01.370636916Z [2024-02-23 23:59:01,370: INFO/ForkPoolWorker-1] [eb60b137-c6be-4dfe-b7ef-ec6c70cd30c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-23T23:59:01.376979327Z [2024-02-23 23:59:01,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17c3a1d7-82d1-4da1-b56d-fba8ba4d9191] received
2024-02-23T23:59:01.387513433Z [2024-02-23 23:59:01,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a69d4ab-bff1-48f9-a2fe-87fb8609e2f9] received
2024-02-23T23:59:01.388827600Z [2024-02-23 23:59:01,388: INFO/ForkPoolWorker-2] [17c3a1d7-82d1-4da1-b56d-fba8ba4d9191] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:59:01.402748876Z [2024-02-23 23:59:01,402: INFO/ForkPoolWorker-3] [3a69d4ab-bff1-48f9-a2fe-87fb8609e2f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:59:01.438438355Z [2024-02-23 23:59:01,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:59:01.442782748Z [2024-02-23 23:59:01,442: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:01.446106180Z [2024-02-23 23:59:01,442: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:01.446381502Z [2024-02-23 23:59:01,446: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:01.450140483Z [2024-02-23 23:59:01,446: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:01.450337313Z [2024-02-23 23:59:01,450: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:59:01.450695469Z [2024-02-23 23:59:01,450: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:59:01.450845951Z [2024-02-23 23:59:01,450: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:01.502235745Z [2024-02-23 23:59:01,495: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:01.672335596Z [2024-02-23 23:59:01,672: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics scheduled__2024-02-23T23:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:01.780220705Z [2024-02-23 23:59:01,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:59:01.829861010Z [2024-02-23 23:59:01,826: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-23T23:59:02.134952110Z [2024-02-23 23:59:02,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ceac3e08-8a86-47bf-99ad-99bbb379fc9a] received
2024-02-23T23:59:02.145563180Z [2024-02-23 23:59:02,120: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:59:02.150843061Z [2024-02-23 23:59:02,150: INFO/ForkPoolWorker-4] [ceac3e08-8a86-47bf-99ad-99bbb379fc9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-23T23:59:02.183291252Z [2024-02-23 23:59:02,176: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:59:02.264404290Z [2024-02-23 23:59:02,263: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-23T23:59:02.274010043Z [2024-02-23 23:59:02,273: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:02.363437694Z [2024-02-23 23:59:02,363: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-23T23:59:02.371866621Z [2024-02-23 23:59:02,371: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-23T23:59:02.371990173Z [2024-02-23 23:59:02,371: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-23T23:59:02.372123880Z [2024-02-23 23:59:02,372: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-23T23:59:02.378139796Z [2024-02-23 23:59:02,372: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-23T23:59:02.580588493Z [2024-02-23 23:59:02,579: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:02.606606422Z [2024-02-23 23:59:02,598: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-23T23:59:02.767661863Z [2024-02-23 23:59:02,767: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8bea96db-a145-4bbc-95cf-f78329134b4b] succeeded in 2.9024177770002098s: None
2024-02-23T23:59:03.005309453Z [2024-02-23 23:59:03,005: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f60cb44-3524-4e7f-8ea5-6a0d3fce88be] received
2024-02-23T23:59:03.023750024Z [2024-02-23 23:59:03,023: INFO/ForkPoolWorker-15] [7f60cb44-3524-4e7f-8ea5-6a0d3fce88be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-23T23:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-23T23:59:03.395015827Z [2024-02-23 23:59:03,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c3a315d-ef84-49c8-89fa-4e39fd9aee16] received
2024-02-23T23:59:03.414957507Z [2024-02-23 23:59:03,414: INFO/ForkPoolWorker-5] [9c3a315d-ef84-49c8-89fa-4e39fd9aee16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-23T23:59:03.615617637Z [2024-02-23 23:59:03,612: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-23T23:59:03.668339557Z [2024-02-23 23:59:03,667: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[eb60b137-c6be-4dfe-b7ef-ec6c70cd30c8] succeeded in 2.3111822829996527s: None
2024-02-23T23:59:04.127831656Z [2024-02-23 23:59:04,127: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-23T23:59:04.139897813Z [2024-02-23 23:59:04,139: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:04.197060204Z [2024-02-23 23:59:04,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-23T23:59:04.200383532Z [2024-02-23 23:59:04,200: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:04.200778750Z [2024-02-23 23:59:04,200: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:04.201380374Z [2024-02-23 23:59:04,201: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:04.201525277Z [2024-02-23 23:59:04,201: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:04.201722395Z [2024-02-23 23:59:04,201: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-23T23:59:04.202162691Z [2024-02-23 23:59:04,201: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:59:04.202228281Z [2024-02-23 23:59:04,202: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:04.207010914Z [2024-02-23 23:59:04,206: INFO/ForkPoolWorker-16] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:04.218356718Z [2024-02-23 23:59:04,214: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-23T23:59:04.335803537Z [2024-02-23 23:59:04,335: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-23T23:59:04.339468840Z [2024-02-23 23:59:04,339: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:04.356279153Z [2024-02-23 23:59:04,356: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:04.373113665Z [2024-02-23 23:59:04,372: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-23T23:59:04.377371215Z [2024-02-23 23:59:04,376: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:04.378058075Z [2024-02-23 23:59:04,377: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:04.378465490Z [2024-02-23 23:59:04,378: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:04.379013512Z [2024-02-23 23:59:04,378: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:04.379387270Z [2024-02-23 23:59:04,379: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-23T23:59:04.380192539Z [2024-02-23 23:59:04,379: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:59:04.381716492Z [2024-02-23 23:59:04,381: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:04.389383581Z [2024-02-23 23:59:04,389: INFO/ForkPoolWorker-3] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:04.472200619Z [2024-02-23 23:59:04,471: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:04.906735940Z [2024-02-23 23:59:04,906: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-23T23:59:04.910175569Z [2024-02-23 23:59:04,909: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:04.958874252Z [2024-02-23 23:59:04,958: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-23T23:59:04.964879257Z [2024-02-23 23:59:04,964: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:04.964904916Z [2024-02-23 23:59:04,964: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:04.964976494Z [2024-02-23 23:59:04,964: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:04.965038431Z [2024-02-23 23:59:04,964: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:04.965137630Z [2024-02-23 23:59:04,965: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-23T23:59:04.965671715Z [2024-02-23 23:59:04,965: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:59:04.965697376Z [2024-02-23 23:59:04,965: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:04.972180065Z [2024-02-23 23:59:04,971: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:05.066789179Z [2024-02-23 23:59:05,066: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:05.437243479Z [2024-02-23 23:59:05,436: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-23T23:59:05.440661863Z [2024-02-23 23:59:05,440: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:05.463012339Z [2024-02-23 23:59:05,462: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-23T23:59:05.466851071Z [2024-02-23 23:59:05,466: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:05.466908213Z [2024-02-23 23:59:05,466: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:05.466913727Z [2024-02-23 23:59:05,466: INFO/ForkPoolWorker-4] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:05.467289537Z [2024-02-23 23:59:05,466: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:05.467379923Z [2024-02-23 23:59:05,467: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-23T23:59:05.467854195Z [2024-02-23 23:59:05,467: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status
2024-02-23T23:59:05.468446828Z [2024-02-23 23:59:05,467: INFO/ForkPoolWorker-4] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:05.473360761Z [2024-02-23 23:59:05,473: INFO/ForkPoolWorker-4] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:05.575259699Z [2024-02-23 23:59:05,574: INFO/ForkPoolWorker-4] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:05.703158798Z [2024-02-23 23:59:05,702: INFO/ForkPoolWorker-5] Getting VIM list
2024-02-23T23:59:05.709039490Z [2024-02-23 23:59:05,708: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:05.737079480Z [2024-02-23 23:59:05,736: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-23T23:59:05.738461956Z [2024-02-23 23:59:05,738: INFO/ForkPoolWorker-5] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:05.738493967Z [2024-02-23 23:59:05,738: INFO/ForkPoolWorker-5] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:05.738607869Z [2024-02-23 23:59:05,738: INFO/ForkPoolWorker-5] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:05.738772995Z [2024-02-23 23:59:05,738: INFO/ForkPoolWorker-5] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:05.738848350Z [2024-02-23 23:59:05,738: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-02-23T23:59:05.739491987Z [2024-02-23 23:59:05,739: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status
2024-02-23T23:59:05.739533741Z [2024-02-23 23:59:05,739: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:05.745619242Z [2024-02-23 23:59:05,745: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:05.829434188Z [2024-02-23 23:59:05,829: INFO/ForkPoolWorker-5] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:05.925681766Z [2024-02-23 23:59:05,925: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-23T23:59:05.929047233Z [2024-02-23 23:59:05,928: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-23T23:59:05.949058823Z [2024-02-23 23:59:05,948: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-23T23:59:05.950419477Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-23T23:59:05.950470285Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-23T23:59:05.950565577Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-23T23:59:05.950727567Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-23T23:59:05.950774231Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-23T23:59:05.951008448Z [2024-02-23 23:59:05,950: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-23T23:59:05.951134097Z [2024-02-23 23:59:05,951: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-23T23:59:05.957089886Z [2024-02-23 23:59:05,956: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-23T23:59:06.039495747Z [2024-02-23 23:59:06,039: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus scheduled__2024-02-23T23:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-23T23:59:06.593436256Z [2024-02-23 23:59:06,593: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f60cb44-3524-4e7f-8ea5-6a0d3fce88be] succeeded in 3.5852308620001168s: None
2024-02-23T23:59:08.115283041Z [2024-02-23 23:59:08,114: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[48e8f29f-dc89-4791-bbbf-dde683d9f8c9] succeeded in 6.761433546999797s: None
2024-02-23T23:59:08.431742634Z [2024-02-23 23:59:08,431: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3a69d4ab-bff1-48f9-a2fe-87fb8609e2f9] succeeded in 7.040657245000148s: None
2024-02-23T23:59:08.431916154Z [2024-02-23 23:59:08,430: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[ceac3e08-8a86-47bf-99ad-99bbb379fc9a] succeeded in 6.2932416849998845s: None
2024-02-23T23:59:08.905183115Z [2024-02-23 23:59:08,904: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[17c3a1d7-82d1-4da1-b56d-fba8ba4d9191] succeeded in 7.526879418000135s: None
2024-02-23T23:59:09.088379209Z [2024-02-23 23:59:09,087: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[9c3a315d-ef84-49c8-89fa-4e39fd9aee16] succeeded in 5.688320739999654s: None
2024-02-24T00:00:00.522372017Z [2024-02-24 00:00:00,522: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7733de7-8e79-4bd6-a1cb-5dfff102b41f] received
2024-02-24T00:00:00.528971166Z [2024-02-24 00:00:00,528: INFO/ForkPoolWorker-15] [b7733de7-8e79-4bd6-a1cb-5dfff102b41f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:00.529638471Z [2024-02-24 00:00:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6053fae-4724-4000-b939-ed2b9117c831] received
2024-02-24T00:00:00.536705258Z [2024-02-24 00:00:00,536: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1fb18f6-a8c7-47d9-b440-6c4bcbb29174] received
2024-02-24T00:00:00.540049704Z [2024-02-24 00:00:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9883bbf7-9688-4c35-a664-76c870cf3dcc] received
2024-02-24T00:00:00.543019888Z [2024-02-24 00:00:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e0e578f-87c7-4750-9a4b-14ebb587440b] received
2024-02-24T00:00:00.546426391Z [2024-02-24 00:00:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abcb65cf-66d0-4989-9042-1ae5c2e709f5] received
2024-02-24T00:00:00.547143330Z [2024-02-24 00:00:00,546: INFO/ForkPoolWorker-16] [e6053fae-4724-4000-b939-ed2b9117c831] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:00.550680448Z [2024-02-24 00:00:00,550: INFO/ForkPoolWorker-2] [9883bbf7-9688-4c35-a664-76c870cf3dcc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:00:00.551221760Z [2024-02-24 00:00:00,551: INFO/ForkPoolWorker-1] [c1fb18f6-a8c7-47d9-b440-6c4bcbb29174] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-23T23:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:00:00.552957040Z [2024-02-24 00:00:00,552: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40541cf3-5e38-43a6-91cc-35e170ae9e2c] received
2024-02-24T00:00:00.554571890Z [2024-02-24 00:00:00,554: INFO/ForkPoolWorker-3] [4e0e578f-87c7-4750-9a4b-14ebb587440b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:00:00.555038418Z [2024-02-24 00:00:00,554: INFO/ForkPoolWorker-4] [abcb65cf-66d0-4989-9042-1ae5c2e709f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:00:00.559574589Z [2024-02-24 00:00:00,559: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72243423-49a8-4f60-8ddb-a79d045b0bcd] received
2024-02-24T00:00:00.575651161Z [2024-02-24 00:00:00,575: INFO/ForkPoolWorker-5] [40541cf3-5e38-43a6-91cc-35e170ae9e2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:00:00.583724236Z [2024-02-24 00:00:00,583: INFO/ForkPoolWorker-6] [72243423-49a8-4f60-8ddb-a79d045b0bcd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-23T23:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:00:00.952929977Z [2024-02-24 00:00:00,949: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:00:01.107027899Z [2024-02-24 00:00:01,102: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:01.137304455Z [2024-02-24 00:00:01,132: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:00:01.150932287Z [2024-02-24 00:00:01,130: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:00:01.559952847Z [2024-02-24 00:00:01,555: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:00:01.605299210Z [2024-02-24 00:00:01,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:00:02.010076206Z [2024-02-24 00:00:01,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:02.163937129Z [2024-02-24 00:00:02,143: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:00:02.309988295Z [2024-02-24 00:00:02,309: INFO/ForkPoolWorker-4] Getting SDNC list
2024-02-24T00:00:02.314366222Z [2024-02-24 00:00:02,313: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:02.356906182Z [2024-02-24 00:00:02,356: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:00:02.362754403Z [2024-02-24 00:00:02,362: INFO/ForkPoolWorker-4] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:00:02.363624647Z [2024-02-24 00:00:02,362: INFO/ForkPoolWorker-4] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:00:02.363649511Z [2024-02-24 00:00:02,362: INFO/ForkPoolWorker-4] Getting SDNC list OK
2024-02-24T00:00:02.363654739Z [2024-02-24 00:00:02,363: INFO/ForkPoolWorker-4] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:00:02.517660410Z [2024-02-24 00:00:02,517: INFO/ForkPoolWorker-4] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-23T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:03.273176730Z [2024-02-24 00:00:03,272: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-23T23:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:03.422457151Z [2024-02-24 00:00:03,422: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[abcb65cf-66d0-4989-9042-1ae5c2e709f5] succeeded in 2.8736943389999396s: None
2024-02-24T00:00:04.385107869Z [2024-02-24 00:00:04,384: INFO/ForkPoolWorker-6] Getting VIM list
2024-02-24T00:00:04.391610472Z [2024-02-24 00:00:04,391: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:04.475059059Z [2024-02-24 00:00:04,474: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-02-24T00:00:04.479077401Z [2024-02-24 00:00:04,478: INFO/ForkPoolWorker-6] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:04.479106223Z [2024-02-24 00:00:04,478: INFO/ForkPoolWorker-6] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:04.479205412Z [2024-02-24 00:00:04,479: INFO/ForkPoolWorker-6] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:04.479379400Z [2024-02-24 00:00:04,479: INFO/ForkPoolWorker-6] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:04.479422019Z [2024-02-24 00:00:04,479: INFO/ForkPoolWorker-6] Getting VIM list OK
2024-02-24T00:00:04.479808935Z [2024-02-24 00:00:04,479: INFO/ForkPoolWorker-6] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:00:04.479868291Z [2024-02-24 00:00:04,479: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:04.481282733Z [2024-02-24 00:00:04,480: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:00:04.484933166Z [2024-02-24 00:00:04,484: INFO/ForkPoolWorker-6] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:04.485395026Z [2024-02-24 00:00:04,484: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:04.518898070Z [2024-02-24 00:00:04,518: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c1fb18f6-a8c7-47d9-b440-6c4bcbb29174] succeeded in 3.980454159999681s: None
2024-02-24T00:00:04.524169434Z [2024-02-24 00:00:04,523: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:00:04.525482212Z [2024-02-24 00:00:04,525: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:00:04.526860314Z [2024-02-24 00:00:04,526: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:04.527160527Z [2024-02-24 00:00:04,526: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:04.527412018Z [2024-02-24 00:00:04,527: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:04.527756633Z [2024-02-24 00:00:04,527: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:04.527994598Z [2024-02-24 00:00:04,527: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:00:04.528487318Z [2024-02-24 00:00:04,528: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:04.528721018Z [2024-02-24 00:00:04,528: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:04.530932139Z [2024-02-24 00:00:04,530: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:04.537218263Z [2024-02-24 00:00:04,536: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:04.581088211Z [2024-02-24 00:00:04,580: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:00:04.587378550Z [2024-02-24 00:00:04,587: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:04.587440428Z [2024-02-24 00:00:04,587: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:04.587564969Z [2024-02-24 00:00:04,587: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:04.587720134Z [2024-02-24 00:00:04,587: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:04.588198451Z [2024-02-24 00:00:04,588: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:00:04.588982892Z [2024-02-24 00:00:04,588: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:00:04.589622262Z [2024-02-24 00:00:04,589: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:04.595028982Z [2024-02-24 00:00:04,594: INFO/ForkPoolWorker-2] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:04.630734741Z [2024-02-24 00:00:04,630: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:04.678250725Z [2024-02-24 00:00:04,677: INFO/ForkPoolWorker-6] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:04.746862267Z [2024-02-24 00:00:04,746: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:05.089249171Z [2024-02-24 00:00:05,088: INFO/ForkPoolWorker-5] Getting VIM list
2024-02-24T00:00:05.098763511Z [2024-02-24 00:00:05,098: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:05.125037256Z [2024-02-24 00:00:05,122: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:00:05.129219451Z [2024-02-24 00:00:05,128: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:05.150806796Z [2024-02-24 00:00:05,150: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:00:05.152339593Z [2024-02-24 00:00:05,152: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:05.152559087Z [2024-02-24 00:00:05,152: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:05.152710135Z [2024-02-24 00:00:05,152: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:05.152904650Z [2024-02-24 00:00:05,152: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:05.153024270Z [2024-02-24 00:00:05,152: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:00:05.153372635Z [2024-02-24 00:00:05,153: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:05.154187492Z [2024-02-24 00:00:05,153: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:05.162187157Z [2024-02-24 00:00:05,161: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:05.181529987Z [2024-02-24 00:00:05,181: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-24T00:00:05.186953653Z [2024-02-24 00:00:05,186: INFO/ForkPoolWorker-5] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:05.186977331Z [2024-02-24 00:00:05,186: INFO/ForkPoolWorker-5] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:05.190320530Z [2024-02-24 00:00:05,186: INFO/ForkPoolWorker-5] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:05.190665703Z [2024-02-24 00:00:05,190: INFO/ForkPoolWorker-5] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:05.191449745Z [2024-02-24 00:00:05,190: INFO/ForkPoolWorker-5] Getting VIM list OK
2024-02-24T00:00:05.191838512Z [2024-02-24 00:00:05,191: INFO/ForkPoolWorker-5] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:00:05.192010460Z [2024-02-24 00:00:05,191: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:05.205654406Z [2024-02-24 00:00:05,205: INFO/ForkPoolWorker-5] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:05.355364370Z [2024-02-24 00:00:05,355: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:05.470594643Z [2024-02-24 00:00:05,470: INFO/ForkPoolWorker-5] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-23T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:05.687696833Z [2024-02-24 00:00:05,687: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96a7acff-9746-4dd0-b4a3-6aabf7d21f36] received
2024-02-24T00:00:05.696140873Z [2024-02-24 00:00:05,695: INFO/ForkPoolWorker-1] [96a7acff-9746-4dd0-b4a3-6aabf7d21f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:05.759360181Z [2024-02-24 00:00:05,758: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:00:05.763438272Z [2024-02-24 00:00:05,762: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:05.896701750Z [2024-02-24 00:00:05,896: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:00:05.902976248Z [2024-02-24 00:00:05,902: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6053fae-4724-4000-b939-ed2b9117c831] succeeded in 5.371736926999802s: None
2024-02-24T00:00:05.906760080Z [2024-02-24 00:00:05,906: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:05.906932906Z [2024-02-24 00:00:05,906: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:05.907119287Z [2024-02-24 00:00:05,906: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:05.910061960Z [2024-02-24 00:00:05,907: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:05.910339378Z [2024-02-24 00:00:05,909: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:00:05.910775817Z [2024-02-24 00:00:05,910: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:00:05.911101710Z [2024-02-24 00:00:05,910: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:05.920078857Z [2024-02-24 00:00:05,919: INFO/ForkPoolWorker-3] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:06.078145004Z [2024-02-24 00:00:06,077: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-23T23:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:06.312181158Z [2024-02-24 00:00:06,311: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7733de7-8e79-4bd6-a1cb-5dfff102b41f] succeeded in 5.78816632600001s: None
2024-02-24T00:00:06.326158581Z [2024-02-24 00:00:06,322: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:06.788103185Z [2024-02-24 00:00:06,787: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9883bbf7-9688-4c35-a664-76c870cf3dcc] succeeded in 6.245060744000057s: None
2024-02-24T00:00:07.091612224Z [2024-02-24 00:00:07,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[82436e2a-6fcc-4c02-a0f9-8b06df07ffa2] received
2024-02-24T00:00:07.102073186Z [2024-02-24 00:00:07,101: INFO/ForkPoolWorker-15] [82436e2a-6fcc-4c02-a0f9-8b06df07ffa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:07.361506059Z [2024-02-24 00:00:07,360: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[72243423-49a8-4f60-8ddb-a79d045b0bcd] succeeded in 6.797777463999864s: None
2024-02-24T00:00:07.393319484Z [2024-02-24 00:00:07,390: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:07.602228590Z [2024-02-24 00:00:07,601: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:00:07.605464775Z [2024-02-24 00:00:07,605: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:07.638474547Z [2024-02-24 00:00:07,638: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:00:07.640276470Z [2024-02-24 00:00:07,639: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:07.640401068Z [2024-02-24 00:00:07,640: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:07.640486941Z [2024-02-24 00:00:07,640: INFO/ForkPoolWorker-1] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:07.640685978Z [2024-02-24 00:00:07,640: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:07.640757835Z [2024-02-24 00:00:07,640: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:00:07.641050505Z [2024-02-24 00:00:07,640: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:07.641131804Z [2024-02-24 00:00:07,641: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:07.647231662Z [2024-02-24 00:00:07,646: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:07.743824651Z [2024-02-24 00:00:07,743: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[4e0e578f-87c7-4750-9a4b-14ebb587440b] succeeded in 7.198598721000053s: None
2024-02-24T00:00:07.754266461Z [2024-02-24 00:00:07,753: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:08.029276465Z [2024-02-24 00:00:08,026: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[40541cf3-5e38-43a6-91cc-35e170ae9e2c] succeeded in 7.466003913999884s: None
2024-02-24T00:00:08.408749701Z [2024-02-24 00:00:08,408: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96a7acff-9746-4dd0-b4a3-6aabf7d21f36] succeeded in 2.7197183929997664s: None
2024-02-24T00:00:08.574348776Z [2024-02-24 00:00:08,573: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:00:08.577840059Z [2024-02-24 00:00:08,577: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:08.596766842Z [2024-02-24 00:00:08,596: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:00:08.598655042Z [2024-02-24 00:00:08,598: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:08.598708982Z [2024-02-24 00:00:08,598: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:08.598839171Z [2024-02-24 00:00:08,598: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:08.599210354Z [2024-02-24 00:00:08,598: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:08.599366360Z [2024-02-24 00:00:08,599: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:00:08.599786501Z [2024-02-24 00:00:08,599: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:08.599879036Z [2024-02-24 00:00:08,599: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:08.606208566Z [2024-02-24 00:00:08,605: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:08.712508751Z [2024-02-24 00:00:08,712: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:09.239062722Z [2024-02-24 00:00:09,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0de98c9a-a25c-4764-a496-12649aea6704] received
2024-02-24T00:00:09.246614605Z [2024-02-24 00:00:09,246: INFO/ForkPoolWorker-16] [0de98c9a-a25c-4764-a496-12649aea6704] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:00:09.329283885Z [2024-02-24 00:00:09,328: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[82436e2a-6fcc-4c02-a0f9-8b06df07ffa2] succeeded in 2.236255635999896s: None
2024-02-24T00:00:09.400701306Z [2024-02-24 00:00:09,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f582800-bd12-4663-b763-3b979bf3df23] received
2024-02-24T00:00:09.407058288Z [2024-02-24 00:00:09,406: INFO/ForkPoolWorker-15] [7f582800-bd12-4663-b763-3b979bf3df23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:00:09.545647580Z [2024-02-24 00:00:09,542: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:09.699828111Z [2024-02-24 00:00:09,696: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:10.748686152Z [2024-02-24 00:00:10,748: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:00:10.752187158Z [2024-02-24 00:00:10,751: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:10.770521137Z [2024-02-24 00:00:10,770: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:00:10.771873131Z [2024-02-24 00:00:10,771: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:10.771890758Z [2024-02-24 00:00:10,771: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:10.771946970Z [2024-02-24 00:00:10,771: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:10.772140859Z [2024-02-24 00:00:10,771: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:10.772187057Z [2024-02-24 00:00:10,772: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:00:10.772446181Z [2024-02-24 00:00:10,772: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:10.772525106Z [2024-02-24 00:00:10,772: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:10.779440174Z [2024-02-24 00:00:10,779: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:10.823126405Z [2024-02-24 00:00:10,822: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:00:10.826645293Z [2024-02-24 00:00:10,826: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:10.845012854Z [2024-02-24 00:00:10,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:00:10.846410860Z [2024-02-24 00:00:10,846: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:10.846424017Z [2024-02-24 00:00:10,846: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:10.846599170Z [2024-02-24 00:00:10,846: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:10.846822235Z [2024-02-24 00:00:10,846: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:10.846975170Z [2024-02-24 00:00:10,846: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:00:10.847241004Z [2024-02-24 00:00:10,847: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:10.847254631Z [2024-02-24 00:00:10,847: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:10.853260586Z [2024-02-24 00:00:10,852: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:10.868069403Z [2024-02-24 00:00:10,867: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-23T23:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:10.935312183Z [2024-02-24 00:00:10,935: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics scheduled__2024-02-23T23:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:11.485980549Z [2024-02-24 00:00:11,485: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0de98c9a-a25c-4764-a496-12649aea6704] succeeded in 2.243440529000054s: None
2024-02-24T00:00:11.552963059Z [2024-02-24 00:00:11,552: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7f582800-bd12-4663-b763-3b979bf3df23] succeeded in 2.150708884999858s: None
2024-02-24T00:00:11.796933834Z [2024-02-24 00:00:11,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fadbaf0a-c9c9-4265-8dc1-a6cba98dd2ae] received
2024-02-24T00:00:11.799834828Z [2024-02-24 00:00:11,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[264bb490-d156-445c-bb28-06386c8ce86d] received
2024-02-24T00:00:11.805897782Z [2024-02-24 00:00:11,805: INFO/ForkPoolWorker-15] [fadbaf0a-c9c9-4265-8dc1-a6cba98dd2ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:11.806298220Z [2024-02-24 00:00:11,806: INFO/ForkPoolWorker-16] [264bb490-d156-445c-bb28-06386c8ce86d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-23T23:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:00:12.123158635Z [2024-02-24 00:00:12,119: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:12.129577841Z [2024-02-24 00:00:12,126: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:00:13.330548982Z [2024-02-24 00:00:13,330: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:00:13.334024600Z [2024-02-24 00:00:13,333: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:13.353337333Z [2024-02-24 00:00:13,353: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:00:13.354910909Z [2024-02-24 00:00:13,354: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:13.354963222Z [2024-02-24 00:00:13,354: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:13.355027540Z [2024-02-24 00:00:13,354: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:13.355182068Z [2024-02-24 00:00:13,355: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:13.355234640Z [2024-02-24 00:00:13,355: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:00:13.355493261Z [2024-02-24 00:00:13,355: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:13.355538005Z [2024-02-24 00:00:13,355: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:13.363252033Z [2024-02-24 00:00:13,362: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:13.420797229Z [2024-02-24 00:00:13,420: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:00:13.424380548Z [2024-02-24 00:00:13,423: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:00:13.430667620Z [2024-02-24 00:00:13,430: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:13.452537926Z [2024-02-24 00:00:13,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:00:13.454025581Z [2024-02-24 00:00:13,453: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:00:13.454115896Z [2024-02-24 00:00:13,453: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:00:13.454224950Z [2024-02-24 00:00:13,454: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:00:13.454415586Z [2024-02-24 00:00:13,454: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:00:13.454472316Z [2024-02-24 00:00:13,454: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:00:13.454877912Z [2024-02-24 00:00:13,454: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:00:13.454994702Z [2024-02-24 00:00:13,454: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:00:13.467015111Z [2024-02-24 00:00:13,466: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:00:13.569641211Z [2024-02-24 00:00:13,569: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-23T23:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:00:14.047435653Z [2024-02-24 00:00:14,047: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[264bb490-d156-445c-bb28-06386c8ce86d] succeeded in 2.2458121360000405s: None
2024-02-24T00:00:14.158278100Z [2024-02-24 00:00:14,157: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fadbaf0a-c9c9-4265-8dc1-a6cba98dd2ae] succeeded in 2.3592683939996277s: None
2024-02-24T00:01:00.335232839Z [2024-02-24 00:01:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6099a35a-fec2-4257-8478-d5c751ad675b] received
2024-02-24T00:01:00.340739531Z [2024-02-24 00:01:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[997f108f-03ab-42da-8417-9ce28c8d4af0] received
2024-02-24T00:01:00.342773635Z [2024-02-24 00:01:00,342: INFO/ForkPoolWorker-15] [6099a35a-fec2-4257-8478-d5c751ad675b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:01:00.348570084Z [2024-02-24 00:01:00,348: INFO/ForkPoolWorker-16] [997f108f-03ab-42da-8417-9ce28c8d4af0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:01:00.350347807Z [2024-02-24 00:01:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7d178913-d0f7-4d80-8b8a-c11560b1b0a1] received
2024-02-24T00:01:00.354684840Z [2024-02-24 00:01:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c487f49-2c0a-4c45-b1e9-113a3cb92c32] received
2024-02-24T00:01:00.356297593Z [2024-02-24 00:01:00,356: INFO/ForkPoolWorker-1] [7d178913-d0f7-4d80-8b8a-c11560b1b0a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:01:00.360946414Z [2024-02-24 00:01:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30d3de31-cef7-4d4b-a19d-d041128c7083] received
2024-02-24T00:01:00.361509432Z [2024-02-24 00:01:00,361: INFO/ForkPoolWorker-2] [7c487f49-2c0a-4c45-b1e9-113a3cb92c32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:01:00.376527733Z [2024-02-24 00:01:00,376: INFO/ForkPoolWorker-3] [30d3de31-cef7-4d4b-a19d-d041128c7083] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:01:00.664437913Z [2024-02-24 00:01:00,660: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:01:00.674538553Z [2024-02-24 00:01:00,671: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:01:00.715457351Z [2024-02-24 00:01:00,710: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:01:00.877875717Z [2024-02-24 00:01:00,877: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:01:00.888106641Z [2024-02-24 00:01:00,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:01:00.913237009Z [2024-02-24 00:01:00,906: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:01:00.916989607Z [2024-02-24 00:01:00,913: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:01:00.943475644Z [2024-02-24 00:01:00,943: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:01:00.946858524Z [2024-02-24 00:01:00,946: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:01:00.947194811Z [2024-02-24 00:01:00,946: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:01:00.947348440Z [2024-02-24 00:01:00,947: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:01:00.947616593Z [2024-02-24 00:01:00,947: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:01:01.070602301Z [2024-02-24 00:01:01,070: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:01:01.955040589Z [2024-02-24 00:01:01,954: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[997f108f-03ab-42da-8417-9ce28c8d4af0] succeeded in 1.6122522529999515s: None
2024-02-24T00:01:02.350535667Z [2024-02-24 00:01:02,349: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:01:02.356859732Z [2024-02-24 00:01:02,355: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:01:02.422794568Z [2024-02-24 00:01:02,422: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:01:02.424462635Z [2024-02-24 00:01:02,424: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:01:02.424579461Z [2024-02-24 00:01:02,424: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:01:02.424672828Z [2024-02-24 00:01:02,424: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:01:02.424837750Z [2024-02-24 00:01:02,424: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:01:02.424921921Z [2024-02-24 00:01:02,424: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:01:02.425231244Z [2024-02-24 00:01:02,425: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:01:02.425332459Z [2024-02-24 00:01:02,425: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:01:02.430104813Z [2024-02-24 00:01:02,429: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:01:02.452869874Z [2024-02-24 00:01:02,452: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:01:02.456599180Z [2024-02-24 00:01:02,456: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:01:02.488591722Z [2024-02-24 00:01:02,488: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:01:02.490162588Z [2024-02-24 00:01:02,489: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:01:02.490313051Z [2024-02-24 00:01:02,490: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:01:02.490463014Z [2024-02-24 00:01:02,490: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:01:02.490710269Z [2024-02-24 00:01:02,490: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:01:02.490783461Z [2024-02-24 00:01:02,490: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:01:02.491246051Z [2024-02-24 00:01:02,491: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:01:02.491379899Z [2024-02-24 00:01:02,491: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:01:02.497660454Z [2024-02-24 00:01:02,497: INFO/ForkPoolWorker-15] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:01:02.512141057Z [2024-02-24 00:01:02,511: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:01:02.573654986Z [2024-02-24 00:01:02,573: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:01:02.577609083Z [2024-02-24 00:01:02,577: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:01:02.579311962Z [2024-02-24 00:01:02,579: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:01:02.598051019Z [2024-02-24 00:01:02,597: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:01:02.603117340Z [2024-02-24 00:01:02,602: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:01:02.603144496Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:01:02.603272877Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:01:02.603532292Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:01:02.603626113Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:01:02.604014437Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:01:02.604105789Z [2024-02-24 00:01:02,603: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:01:02.610953316Z [2024-02-24 00:01:02,610: INFO/ForkPoolWorker-1] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:01:02.660444818Z [2024-02-24 00:01:02,660: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:01:02.672813470Z [2024-02-24 00:01:02,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:01:02.785921357Z [2024-02-24 00:01:02,785: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:01:02.810578790Z [2024-02-24 00:01:02,810: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:01:02.816729098Z [2024-02-24 00:01:02,816: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:01:02.816782288Z [2024-02-24 00:01:02,816: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:01:02.816891009Z [2024-02-24 00:01:02,816: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:01:02.817099554Z [2024-02-24 00:01:02,816: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:01:02.817174517Z [2024-02-24 00:01:02,817: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:01:02.817809023Z [2024-02-24 00:01:02,817: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:01:02.818012274Z [2024-02-24 00:01:02,817: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:01:02.832239830Z [2024-02-24 00:01:02,831: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:01:02.940949481Z [2024-02-24 00:01:02,940: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:01:04.560596468Z [2024-02-24 00:01:04,559: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6099a35a-fec2-4257-8478-d5c751ad675b] succeeded in 4.223724601000413s: None
2024-02-24T00:01:04.893841856Z [2024-02-24 00:01:04,893: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[30d3de31-cef7-4d4b-a19d-d041128c7083] succeeded in 4.525479771000391s: None
2024-02-24T00:01:05.191903091Z [2024-02-24 00:01:05,191: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7d178913-d0f7-4d80-8b8a-c11560b1b0a1] succeeded in 4.839898995000112s: None
2024-02-24T00:01:05.320811347Z [2024-02-24 00:01:05,320: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7c487f49-2c0a-4c45-b1e9-113a3cb92c32] succeeded in 4.96446516900005s: None
2024-02-24T00:02:00.781153322Z [2024-02-24 00:02:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff85012f-5e2b-4e87-af59-cc7df2ba13d6] received
2024-02-24T00:02:00.783951793Z [2024-02-24 00:02:00,783: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[932b7dc6-df41-43b2-88bf-9e9556a448d1] received
2024-02-24T00:02:00.794143744Z [2024-02-24 00:02:00,793: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[914b74e0-6ed6-4d6d-a720-1a3a2bec0274] received
2024-02-24T00:02:00.795341210Z [2024-02-24 00:02:00,795: INFO/ForkPoolWorker-15] [ff85012f-5e2b-4e87-af59-cc7df2ba13d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:02:00.795910670Z [2024-02-24 00:02:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8cf8785-254f-4064-add3-e25dfde4fd91] received
2024-02-24T00:02:00.802827623Z [2024-02-24 00:02:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3afd01b-28e3-450c-8ea1-3ffb59b60334] received
2024-02-24T00:02:00.803697817Z [2024-02-24 00:02:00,803: INFO/ForkPoolWorker-16] [932b7dc6-df41-43b2-88bf-9e9556a448d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:02:00.804649946Z [2024-02-24 00:02:00,804: INFO/ForkPoolWorker-2] [a8cf8785-254f-4064-add3-e25dfde4fd91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:02:00.805552537Z [2024-02-24 00:02:00,805: INFO/ForkPoolWorker-1] [914b74e0-6ed6-4d6d-a720-1a3a2bec0274] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:02:00.813915769Z [2024-02-24 00:02:00,813: INFO/ForkPoolWorker-3] [e3afd01b-28e3-450c-8ea1-3ffb59b60334] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:02:00.822035723Z [2024-02-24 00:02:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15f81ab2-98c3-43fe-8073-b344d914cdf8] received
2024-02-24T00:02:00.843248165Z [2024-02-24 00:02:00,842: INFO/ForkPoolWorker-4] [15f81ab2-98c3-43fe-8073-b344d914cdf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:02:01.171706238Z [2024-02-24 00:02:01,166: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:02:01.200781751Z [2024-02-24 00:02:01,197: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:02:01.357550965Z [2024-02-24 00:02:01,355: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T00:02:01.365242773Z [2024-02-24 00:02:01,364: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:02:01.411968007Z [2024-02-24 00:02:01,411: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:02:01.414832200Z [2024-02-24 00:02:01,414: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:02:01.414894826Z [2024-02-24 00:02:01,414: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:02:01.414988086Z [2024-02-24 00:02:01,414: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T00:02:01.415604312Z [2024-02-24 00:02:01,415: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:02:01.433666921Z [2024-02-24 00:02:01,428: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:02:01.485068579Z [2024-02-24 00:02:01,473: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:02:01.523413936Z [2024-02-24 00:02:01,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:02:01.526170755Z [2024-02-24 00:02:01,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:02:01.648839886Z [2024-02-24 00:02:01,648: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:01.878333380Z [2024-02-24 00:02:01,878: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:02.677868525Z [2024-02-24 00:02:02,666: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e3afd01b-28e3-450c-8ea1-3ffb59b60334] succeeded in 1.8610376769997856s: None
2024-02-24T00:02:03.131245572Z [2024-02-24 00:02:03,130: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[914b74e0-6ed6-4d6d-a720-1a3a2bec0274] succeeded in 2.3346123320002334s: None
2024-02-24T00:02:03.622829684Z [2024-02-24 00:02:03,622: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:02:03.636199545Z [2024-02-24 00:02:03,627: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:02:03.676415801Z [2024-02-24 00:02:03,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:02:03.678621501Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:02:03.678648442Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:02:03.678663711Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:02:03.678803191Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:02:03.678840136Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:02:03.679077551Z [2024-02-24 00:02:03,678: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:02:03.679110436Z [2024-02-24 00:02:03,679: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:02:03.686045370Z [2024-02-24 00:02:03,683: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:02:03.772281791Z [2024-02-24 00:02:03,771: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:02:03.777153537Z [2024-02-24 00:02:03,776: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:02:03.838671032Z [2024-02-24 00:02:03,838: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:03.843204432Z [2024-02-24 00:02:03,842: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:02:03.845011645Z [2024-02-24 00:02:03,844: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:02:03.845036246Z [2024-02-24 00:02:03,844: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:02:03.845040156Z [2024-02-24 00:02:03,844: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:02:03.845174992Z [2024-02-24 00:02:03,845: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:02:03.845233543Z [2024-02-24 00:02:03,845: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:02:03.847052540Z [2024-02-24 00:02:03,845: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:02:03.847069414Z [2024-02-24 00:02:03,845: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:02:03.850933676Z [2024-02-24 00:02:03,850: INFO/ForkPoolWorker-16] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:02:03.893897745Z [2024-02-24 00:02:03,892: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T00:02:03.897236772Z [2024-02-24 00:02:03,896: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:02:03.929377516Z [2024-02-24 00:02:03,929: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:02:03.933054946Z [2024-02-24 00:02:03,932: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:02:03.933237436Z [2024-02-24 00:02:03,933: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:02:03.933376214Z [2024-02-24 00:02:03,933: INFO/ForkPoolWorker-4] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:02:03.933662302Z [2024-02-24 00:02:03,933: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:02:03.933906228Z [2024-02-24 00:02:03,933: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T00:02:03.934349417Z [2024-02-24 00:02:03,934: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:02:03.934523370Z [2024-02-24 00:02:03,934: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:02:03.942319237Z [2024-02-24 00:02:03,942: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:02:03.984079593Z [2024-02-24 00:02:03,983: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:04.038131159Z [2024-02-24 00:02:04,037: INFO/ForkPoolWorker-4] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:04.322012288Z [2024-02-24 00:02:04,321: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:02:04.325207660Z [2024-02-24 00:02:04,324: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:02:04.359160828Z [2024-02-24 00:02:04,358: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:02:04.360695429Z [2024-02-24 00:02:04,360: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:02:04.361091781Z [2024-02-24 00:02:04,360: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:02:04.361204683Z [2024-02-24 00:02:04,361: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:02:04.361372195Z [2024-02-24 00:02:04,361: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:02:04.361432993Z [2024-02-24 00:02:04,361: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:02:04.361692582Z [2024-02-24 00:02:04,361: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:02:04.361828015Z [2024-02-24 00:02:04,361: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:02:04.366329378Z [2024-02-24 00:02:04,366: INFO/ForkPoolWorker-2] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:02:04.479743972Z [2024-02-24 00:02:04,479: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:02:06.894368907Z [2024-02-24 00:02:06,893: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[932b7dc6-df41-43b2-88bf-9e9556a448d1] succeeded in 6.107248450000043s: None
2024-02-24T00:02:06.936899893Z [2024-02-24 00:02:06,936: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a8cf8785-254f-4064-add3-e25dfde4fd91] succeeded in 6.139305062999938s: None
2024-02-24T00:02:07.315219821Z [2024-02-24 00:02:07,314: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff85012f-5e2b-4e87-af59-cc7df2ba13d6] succeeded in 6.528891603999909s: None
2024-02-24T00:02:07.603024556Z [2024-02-24 00:02:07,602: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[15f81ab2-98c3-43fe-8073-b344d914cdf8] succeeded in 6.775936300000012s: None
2024-02-24T00:03:01.085862952Z [2024-02-24 00:03:01,085: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[398248f7-aad3-4c3b-8b60-b32c65188134] received
2024-02-24T00:03:01.089342100Z [2024-02-24 00:03:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dad06347-0a1a-4d15-90c6-37ead3c89f4e] received
2024-02-24T00:03:01.092722667Z [2024-02-24 00:03:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1697fe7e-6334-414d-8e4c-1f2ff0385f98] received
2024-02-24T00:03:01.096098443Z [2024-02-24 00:03:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac5f3003-797c-4556-8daf-8054e0b0dc78] received
2024-02-24T00:03:01.100815056Z [2024-02-24 00:03:01,100: INFO/ForkPoolWorker-1] [1697fe7e-6334-414d-8e4c-1f2ff0385f98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:03:01.104034489Z [2024-02-24 00:03:01,103: INFO/ForkPoolWorker-2] [ac5f3003-797c-4556-8daf-8054e0b0dc78] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:03:01.105208395Z [2024-02-24 00:03:01,104: INFO/ForkPoolWorker-15] [398248f7-aad3-4c3b-8b60-b32c65188134] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:03:01.108749657Z [2024-02-24 00:03:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc6c1a5f-eb7f-49a8-b24d-168f8f57ff71] received
2024-02-24T00:03:01.109134445Z [2024-02-24 00:03:01,108: INFO/ForkPoolWorker-16] [dad06347-0a1a-4d15-90c6-37ead3c89f4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:03:01.133350575Z [2024-02-24 00:03:01,133: INFO/ForkPoolWorker-3] [bc6c1a5f-eb7f-49a8-b24d-168f8f57ff71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:03:01.540159951Z [2024-02-24 00:03:01,536: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:03:01.637824360Z [2024-02-24 00:03:01,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:03:01.709311809Z [2024-02-24 00:03:01,707: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T00:03:01.713328438Z [2024-02-24 00:03:01,712: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:03:01.740050753Z [2024-02-24 00:03:01,739: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:03:01.741292032Z [2024-02-24 00:03:01,741: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:03:01.741421004Z [2024-02-24 00:03:01,741: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:03:01.741514068Z [2024-02-24 00:03:01,741: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T00:03:01.741831783Z [2024-02-24 00:03:01,741: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:03:01.770227873Z [2024-02-24 00:03:01,766: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:03:01.843641094Z [2024-02-24 00:03:01,840: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:03:01.856099280Z [2024-02-24 00:03:01,848: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:03:01.861233946Z [2024-02-24 00:03:01,860: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:03:02.607415440Z [2024-02-24 00:03:02,606: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac5f3003-797c-4556-8daf-8054e0b0dc78] succeeded in 1.5098185520000698s: None
2024-02-24T00:03:03.385722056Z [2024-02-24 00:03:03,385: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:03:03.389202544Z [2024-02-24 00:03:03,388: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:03:03.399533303Z [2024-02-24 00:03:03,399: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:03:03.403943591Z [2024-02-24 00:03:03,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:03:03.409079211Z [2024-02-24 00:03:03,408: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:03:03.410852569Z [2024-02-24 00:03:03,410: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:03:03.410913844Z [2024-02-24 00:03:03,410: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:03:03.410919041Z [2024-02-24 00:03:03,410: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:03:03.411030002Z [2024-02-24 00:03:03,410: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:03:03.411076653Z [2024-02-24 00:03:03,411: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:03:03.411273100Z [2024-02-24 00:03:03,411: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:03:03.411321074Z [2024-02-24 00:03:03,411: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:03:03.416205795Z [2024-02-24 00:03:03,415: INFO/ForkPoolWorker-3] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:03:03.441672858Z [2024-02-24 00:03:03,441: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:03:03.444323999Z [2024-02-24 00:03:03,444: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:03:03.444731463Z [2024-02-24 00:03:03,444: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:03:03.445131876Z [2024-02-24 00:03:03,444: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:03:03.445516824Z [2024-02-24 00:03:03,445: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:03:03.445850645Z [2024-02-24 00:03:03,445: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:03:03.446346020Z [2024-02-24 00:03:03,446: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:03:03.446988629Z [2024-02-24 00:03:03,446: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:03:03.453292509Z [2024-02-24 00:03:03,453: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:03:03.497624929Z [2024-02-24 00:03:03,497: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:03:03.548677750Z [2024-02-24 00:03:03,548: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:03:03.552302860Z [2024-02-24 00:03:03,551: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:03:03.580352041Z [2024-02-24 00:03:03,579: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:03:03.584847878Z [2024-02-24 00:03:03,584: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:03:03.593608038Z [2024-02-24 00:03:03,593: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:03:03.599918271Z [2024-02-24 00:03:03,599: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:03:03.601708211Z [2024-02-24 00:03:03,601: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:03:03.601814116Z [2024-02-24 00:03:03,601: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:03:03.601922689Z [2024-02-24 00:03:03,601: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:03:03.602128261Z [2024-02-24 00:03:03,601: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:03:03.602185633Z [2024-02-24 00:03:03,602: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:03:03.602474705Z [2024-02-24 00:03:03,602: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:03:03.605199443Z [2024-02-24 00:03:03,602: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:03:03.611544444Z [2024-02-24 00:03:03,609: INFO/ForkPoolWorker-16] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:03:03.624509868Z [2024-02-24 00:03:03,624: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:03:03.625764660Z [2024-02-24 00:03:03,625: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:03:03.625818492Z [2024-02-24 00:03:03,625: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:03:03.625846773Z [2024-02-24 00:03:03,625: INFO/ForkPoolWorker-1] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:03:03.626003909Z [2024-02-24 00:03:03,625: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:03:03.626038959Z [2024-02-24 00:03:03,625: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:03:03.626456579Z [2024-02-24 00:03:03,626: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:03:03.626494233Z [2024-02-24 00:03:03,626: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:03:03.631982607Z [2024-02-24 00:03:03,631: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:03:03.719677401Z [2024-02-24 00:03:03,719: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:03:03.774004952Z [2024-02-24 00:03:03,772: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:03:05.523254755Z [2024-02-24 00:03:05,522: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bc6c1a5f-eb7f-49a8-b24d-168f8f57ff71] succeeded in 4.412249097999847s: None
2024-02-24T00:03:06.010282453Z [2024-02-24 00:03:06,009: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dad06347-0a1a-4d15-90c6-37ead3c89f4e] succeeded in 4.917824505000226s: None
2024-02-24T00:03:06.474941720Z [2024-02-24 00:03:06,474: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1697fe7e-6334-414d-8e4c-1f2ff0385f98] succeeded in 5.380175469999813s: None
2024-02-24T00:03:06.480450914Z [2024-02-24 00:03:06,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[398248f7-aad3-4c3b-8b60-b32c65188134] succeeded in 5.388794153999697s: None
2024-02-24T00:04:01.264169399Z [2024-02-24 00:04:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a2effb33-a33b-4bf2-a337-6954ea552bc6] received
2024-02-24T00:04:01.269293922Z [2024-02-24 00:04:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1ee131f-f89e-46aa-b7da-fcb15ea7f1f0] received
2024-02-24T00:04:01.272530761Z [2024-02-24 00:04:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[000e2115-5bcc-4a52-bb5b-46a62f357b88] received
2024-02-24T00:04:01.288613267Z [2024-02-24 00:04:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c22c610-636e-4fd3-ac93-b22e7005fca0] received
2024-02-24T00:04:01.288634412Z [2024-02-24 00:04:01,287: INFO/ForkPoolWorker-15] [a2effb33-a33b-4bf2-a337-6954ea552bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:04:01.292188805Z [2024-02-24 00:04:01,291: INFO/ForkPoolWorker-16] [b1ee131f-f89e-46aa-b7da-fcb15ea7f1f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:04:01.296211676Z [2024-02-24 00:04:01,295: INFO/ForkPoolWorker-1] [000e2115-5bcc-4a52-bb5b-46a62f357b88] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:04:01.309612343Z [2024-02-24 00:04:01,306: INFO/ForkPoolWorker-2] [9c22c610-636e-4fd3-ac93-b22e7005fca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:04:01.321934788Z [2024-02-24 00:04:01,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10a72d52-9a7d-4cbb-b5bb-9540a14b6697] received
2024-02-24T00:04:01.333862405Z [2024-02-24 00:04:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ef7e141-6108-4ed9-ab9e-0b9ff4756f36] received
2024-02-24T00:04:01.333896106Z [2024-02-24 00:04:01,331: INFO/ForkPoolWorker-3] [10a72d52-9a7d-4cbb-b5bb-9540a14b6697] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:04:01.356858665Z [2024-02-24 00:04:01,355: INFO/ForkPoolWorker-4] [3ef7e141-6108-4ed9-ab9e-0b9ff4756f36] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:04:01.669830338Z [2024-02-24 00:04:01,665: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:04:01.727539108Z [2024-02-24 00:04:01,724: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:04:01.867214665Z [2024-02-24 00:04:01,862: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:04:02.083241973Z [2024-02-24 00:04:02,066: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:04:02.090887457Z [2024-02-24 00:04:02,072: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:04:02.294368485Z [2024-02-24 00:04:02,256: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:04:02.930991523Z [2024-02-24 00:04:02,929: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:04:02.949537366Z [2024-02-24 00:04:02,949: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:02.954174768Z [2024-02-24 00:04:02,953: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:04:03.019572625Z [2024-02-24 00:04:03,019: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:04:03.020550819Z [2024-02-24 00:04:03,020: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:04:03.020607520Z [2024-02-24 00:04:03,020: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:04:03.020668808Z [2024-02-24 00:04:03,020: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:04:03.020854509Z [2024-02-24 00:04:03,020: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:04:03.131211410Z [2024-02-24 00:04:03,130: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:03.635717675Z [2024-02-24 00:04:03,635: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:04:03.651786087Z [2024-02-24 00:04:03,638: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:04:03.740773609Z [2024-02-24 00:04:03,740: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:04:03.756387456Z [2024-02-24 00:04:03,756: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:04:03.756409498Z [2024-02-24 00:04:03,756: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:04:03.760942641Z [2024-02-24 00:04:03,756: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:04:03.761309747Z [2024-02-24 00:04:03,760: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:04:03.761470933Z [2024-02-24 00:04:03,761: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:04:03.761940599Z [2024-02-24 00:04:03,761: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:04:03.764827958Z [2024-02-24 00:04:03,761: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:04:03.781039619Z [2024-02-24 00:04:03,772: INFO/ForkPoolWorker-3] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:04:03.899185069Z [2024-02-24 00:04:03,898: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a2effb33-a33b-4bf2-a337-6954ea552bc6] succeeded in 2.6282775029999357s: None
2024-02-24T00:04:03.950267294Z [2024-02-24 00:04:03,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[000e2115-5bcc-4a52-bb5b-46a62f357b88] succeeded in 2.6778416500001185s: None
2024-02-24T00:04:03.995530983Z [2024-02-24 00:04:03,995: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:04.057047744Z [2024-02-24 00:04:04,056: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:04:04.060480848Z [2024-02-24 00:04:04,060: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:04:04.099119534Z [2024-02-24 00:04:04,098: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:04:04.101008484Z [2024-02-24 00:04:04,100: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:04:04.101035594Z [2024-02-24 00:04:04,100: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:04:04.101047193Z [2024-02-24 00:04:04,100: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:04:04.101189051Z [2024-02-24 00:04:04,101: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:04:04.101215110Z [2024-02-24 00:04:04,101: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:04:04.102205909Z [2024-02-24 00:04:04,102: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:04:04.102245028Z [2024-02-24 00:04:04,102: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:04:04.116765857Z [2024-02-24 00:04:04,116: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:04:04.205330302Z [2024-02-24 00:04:04,205: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:04.234097220Z [2024-02-24 00:04:04,233: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T00:04:04.237518711Z [2024-02-24 00:04:04,237: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:04:04.279403342Z [2024-02-24 00:04:04,279: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:04:04.282196363Z [2024-02-24 00:04:04,281: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:04:04.282346953Z [2024-02-24 00:04:04,282: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:04:04.282427112Z [2024-02-24 00:04:04,282: INFO/ForkPoolWorker-4] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:04:04.282694965Z [2024-02-24 00:04:04,282: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:04:04.282768890Z [2024-02-24 00:04:04,282: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T00:04:04.284579933Z [2024-02-24 00:04:04,284: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:04:04.284772502Z [2024-02-24 00:04:04,284: INFO/ForkPoolWorker-4] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:04:04.302660792Z [2024-02-24 00:04:04,302: INFO/ForkPoolWorker-4] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:04:04.471517229Z [2024-02-24 00:04:04,471: INFO/ForkPoolWorker-4] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:04.551236940Z [2024-02-24 00:04:04,550: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:04:04.555125716Z [2024-02-24 00:04:04,554: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:04:04.594806937Z [2024-02-24 00:04:04,594: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:04:04.596546522Z [2024-02-24 00:04:04,596: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:04:04.596744149Z [2024-02-24 00:04:04,596: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:04:04.596899277Z [2024-02-24 00:04:04,596: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:04:04.597119329Z [2024-02-24 00:04:04,596: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:04:04.597267447Z [2024-02-24 00:04:04,597: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:04:04.597596015Z [2024-02-24 00:04:04,597: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:04:04.597756713Z [2024-02-24 00:04:04,597: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:04:04.603446782Z [2024-02-24 00:04:04,603: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:04:04.690291998Z [2024-02-24 00:04:04,690: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:04:06.825522012Z [2024-02-24 00:04:06,825: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[10a72d52-9a7d-4cbb-b5bb-9540a14b6697] succeeded in 5.507369865999863s: None
2024-02-24T00:04:06.908894098Z [2024-02-24 00:04:06,908: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[3ef7e141-6108-4ed9-ab9e-0b9ff4756f36] succeeded in 5.56476473199973s: None
2024-02-24T00:04:07.625935766Z [2024-02-24 00:04:07,625: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9c22c610-636e-4fd3-ac93-b22e7005fca0] succeeded in 6.337899998000012s: None
2024-02-24T00:04:08.088580848Z [2024-02-24 00:04:08,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1ee131f-f89e-46aa-b7da-fcb15ea7f1f0] succeeded in 6.817854634000014s: None
2024-02-24T00:05:01.201360248Z [2024-02-24 00:05:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[902d5704-71f8-4f90-b495-bf0848ed22e6] received
2024-02-24T00:05:01.203883900Z [2024-02-24 00:05:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d99b0dd-fbd5-42d0-b759-7f40b4e08d03] received
2024-02-24T00:05:01.206090927Z [2024-02-24 00:05:01,205: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[795decc4-5366-4f8b-bae4-ce112a1b2313] received
2024-02-24T00:05:01.226553268Z [2024-02-24 00:05:01,226: INFO/ForkPoolWorker-15] [902d5704-71f8-4f90-b495-bf0848ed22e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:01.237256401Z [2024-02-24 00:05:01,237: INFO/ForkPoolWorker-16] [0d99b0dd-fbd5-42d0-b759-7f40b4e08d03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:01.245755991Z [2024-02-24 00:05:01,245: INFO/ForkPoolWorker-1] [795decc4-5366-4f8b-bae4-ce112a1b2313] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:05:01.270088091Z [2024-02-24 00:05:01,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7aa8930-8740-4d08-bdc0-fefee1d06868] received
2024-02-24T00:05:01.281223488Z [2024-02-24 00:05:01,277: INFO/ForkPoolWorker-2] [c7aa8930-8740-4d08-bdc0-fefee1d06868] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:05:01.287175969Z [2024-02-24 00:05:01,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5de045e3-b004-4da5-b995-43283377475e] received
2024-02-24T00:05:01.289561067Z [2024-02-24 00:05:01,289: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc22a7ef-4cd9-4948-9a27-46ab630f850b] received
2024-02-24T00:05:01.308437415Z [2024-02-24 00:05:01,308: INFO/ForkPoolWorker-4] [bc22a7ef-4cd9-4948-9a27-46ab630f850b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:05:01.319661012Z [2024-02-24 00:05:01,319: INFO/ForkPoolWorker-3] [5de045e3-b004-4da5-b995-43283377475e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:05:01.334654657Z [2024-02-24 00:05:01,334: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01840df5-ef7b-414d-bf4f-36173b250930] received
2024-02-24T00:05:01.363263928Z [2024-02-24 00:05:01,362: INFO/ForkPoolWorker-5] [01840df5-ef7b-414d-bf4f-36173b250930] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:05:01.641341506Z [2024-02-24 00:05:01,638: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:01.693277487Z [2024-02-24 00:05:01,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:01.774129736Z [2024-02-24 00:05:01,770: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:05:02.197867685Z [2024-02-24 00:05:02,193: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:05:02.267645703Z [2024-02-24 00:05:02,263: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:05:02.528449649Z [2024-02-24 00:05:02,523: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:05:02.560182557Z [2024-02-24 00:05:02,555: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:05:02.774506622Z [2024-02-24 00:05:02,774: INFO/ForkPoolWorker-5] Getting SDNC list
2024-02-24T00:05:02.806116470Z [2024-02-24 00:05:02,778: INFO/ForkPoolWorker-5] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:02.886936782Z [2024-02-24 00:05:02,886: INFO/ForkPoolWorker-5] Connected to database osm version 1.2
2024-02-24T00:05:02.890393265Z [2024-02-24 00:05:02,889: INFO/ForkPoolWorker-5] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:05:02.890463305Z [2024-02-24 00:05:02,890: INFO/ForkPoolWorker-5] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:05:02.890530943Z [2024-02-24 00:05:02,890: INFO/ForkPoolWorker-5] Getting SDNC list OK
2024-02-24T00:05:02.890960214Z [2024-02-24 00:05:02,890: INFO/ForkPoolWorker-5] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:05:02.999584780Z [2024-02-24 00:05:02,999: INFO/ForkPoolWorker-5] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:03.763949224Z [2024-02-24 00:05:03,763: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:05:03.767598865Z [2024-02-24 00:05:03,767: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:03.818242123Z [2024-02-24 00:05:03,818: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:05:03.819941788Z [2024-02-24 00:05:03,819: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:03.820129549Z [2024-02-24 00:05:03,819: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:03.820184636Z [2024-02-24 00:05:03,820: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:03.820343273Z [2024-02-24 00:05:03,820: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:03.820408433Z [2024-02-24 00:05:03,820: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:05:03.820699426Z [2024-02-24 00:05:03,820: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:03.820802051Z [2024-02-24 00:05:03,820: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:03.832788761Z [2024-02-24 00:05:03,832: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:03.968405834Z [2024-02-24 00:05:03,968: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:05:03.973609306Z [2024-02-24 00:05:03,972: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:04.017886005Z [2024-02-24 00:05:04,017: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:04.022909241Z [2024-02-24 00:05:04,022: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:05:04.026892304Z [2024-02-24 00:05:04,026: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:04.026935869Z [2024-02-24 00:05:04,026: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:04.026967745Z [2024-02-24 00:05:04,026: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:04.027081455Z [2024-02-24 00:05:04,026: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:04.027112504Z [2024-02-24 00:05:04,027: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:05:04.027355055Z [2024-02-24 00:05:04,027: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:04.027388673Z [2024-02-24 00:05:04,027: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:04.034644277Z [2024-02-24 00:05:04,034: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:04.151197837Z [2024-02-24 00:05:04,150: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[01840df5-ef7b-414d-bf4f-36173b250930] succeeded in 2.8126489800001764s: None
2024-02-24T00:05:04.197011973Z [2024-02-24 00:05:04,196: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.extract_metrics_from_vnfrs scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:04.519003129Z [2024-02-24 00:05:04,517: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:05:04.533783119Z [2024-02-24 00:05:04,532: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:04.569257041Z [2024-02-24 00:05:04,569: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:05:04.572190778Z [2024-02-24 00:05:04,571: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:04.572285377Z [2024-02-24 00:05:04,572: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:04.573493098Z [2024-02-24 00:05:04,572: INFO/ForkPoolWorker-2] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:04.573710525Z [2024-02-24 00:05:04,573: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:04.573860577Z [2024-02-24 00:05:04,573: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:05:04.575645537Z [2024-02-24 00:05:04,574: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:05:04.575868551Z [2024-02-24 00:05:04,575: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:04.589377927Z [2024-02-24 00:05:04,589: INFO/ForkPoolWorker-2] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:04.731927713Z [2024-02-24 00:05:04,731: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:04.733614736Z [2024-02-24 00:05:04,733: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:05:04.737075709Z [2024-02-24 00:05:04,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:04.772639113Z [2024-02-24 00:05:04,772: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:05:04.780246865Z [2024-02-24 00:05:04,779: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:04.780478351Z [2024-02-24 00:05:04,780: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:04.780620731Z [2024-02-24 00:05:04,780: INFO/ForkPoolWorker-1] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:04.780843592Z [2024-02-24 00:05:04,780: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:04.780979290Z [2024-02-24 00:05:04,780: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:05:04.781374448Z [2024-02-24 00:05:04,781: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:05:04.782023303Z [2024-02-24 00:05:04,781: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:04.784656416Z [2024-02-24 00:05:04,784: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T00:05:04.786992042Z [2024-02-24 00:05:04,786: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:04.803684969Z [2024-02-24 00:05:04,803: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:04.849151126Z [2024-02-24 00:05:04,848: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:05:04.850837117Z [2024-02-24 00:05:04,850: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:04.850889161Z [2024-02-24 00:05:04,850: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:04.850936313Z [2024-02-24 00:05:04,850: INFO/ForkPoolWorker-4] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:04.851099036Z [2024-02-24 00:05:04,850: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:04.851177483Z [2024-02-24 00:05:04,851: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T00:05:04.851494856Z [2024-02-24 00:05:04,851: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:05:04.851509480Z [2024-02-24 00:05:04,851: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:04.857095217Z [2024-02-24 00:05:04,856: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:04.894264236Z [2024-02-24 00:05:04,891: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d99b0dd-fbd5-42d0-b759-7f40b4e08d03] succeeded in 3.684965268000269s: None
2024-02-24T00:05:04.964955607Z [2024-02-24 00:05:04,964: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:04.991213472Z [2024-02-24 00:05:04,990: INFO/ForkPoolWorker-4] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:05.083474373Z [2024-02-24 00:05:05,083: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:05:05.086949413Z [2024-02-24 00:05:05,086: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:05.109670413Z [2024-02-24 00:05:05,109: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:05:05.111289441Z [2024-02-24 00:05:05,111: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:05.111395792Z [2024-02-24 00:05:05,111: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:05.111470972Z [2024-02-24 00:05:05,111: INFO/ForkPoolWorker-3] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:05.111758522Z [2024-02-24 00:05:05,111: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:05.111944296Z [2024-02-24 00:05:05,111: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:05:05.112660314Z [2024-02-24 00:05:05,112: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:05:05.112942857Z [2024-02-24 00:05:05,112: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:05.118573196Z [2024-02-24 00:05:05,118: INFO/ForkPoolWorker-3] Creating DAG vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:05.212918358Z [2024-02-24 00:05:05,212: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[902d5704-71f8-4f90-b495-bf0848ed22e6] succeeded in 4.008044707999943s: None
2024-02-24T00:05:05.216559278Z [2024-02-24 00:05:05,216: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:06.113405832Z [2024-02-24 00:05:06,113: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c56f59d1-1a99-4d3b-bd2d-9190faf9dec3] received
2024-02-24T00:05:06.116345019Z [2024-02-24 00:05:06,115: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e131313e-dfa4-4fd5-a29e-8af09efd0003] received
2024-02-24T00:05:06.122215859Z [2024-02-24 00:05:06,121: INFO/ForkPoolWorker-15] [c56f59d1-1a99-4d3b-bd2d-9190faf9dec3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'split_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:06.122899590Z [2024-02-24 00:05:06,122: INFO/ForkPoolWorker-16] [e131313e-dfa4-4fd5-a29e-8af09efd0003] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:06.406126978Z [2024-02-24 00:05:06,402: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:06.424333966Z [2024-02-24 00:05:06,420: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:06.618217619Z [2024-02-24 00:05:06,617: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c7aa8930-8740-4d08-bdc0-fefee1d06868] succeeded in 5.350726728000154s: None
2024-02-24T00:05:07.098130414Z [2024-02-24 00:05:07,097: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[5de045e3-b004-4da5-b995-43283377475e] succeeded in 5.791230104999613s: None
2024-02-24T00:05:07.115137526Z [2024-02-24 00:05:07,114: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[795decc4-5366-4f8b-bae4-ce112a1b2313] succeeded in 5.905280758000117s: None
2024-02-24T00:05:07.174813338Z [2024-02-24 00:05:07,174: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[bc22a7ef-4cd9-4948-9a27-46ab630f850b] succeeded in 5.882782767999743s: None
2024-02-24T00:05:07.652526026Z [2024-02-24 00:05:07,652: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:05:07.656026936Z [2024-02-24 00:05:07,655: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:07.675082855Z [2024-02-24 00:05:07,674: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:05:07.676699062Z [2024-02-24 00:05:07,676: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:05:07.677923141Z [2024-02-24 00:05:07,677: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:07.677946255Z [2024-02-24 00:05:07,677: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:07.678027858Z [2024-02-24 00:05:07,677: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:07.678144951Z [2024-02-24 00:05:07,677: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:07.678167927Z [2024-02-24 00:05:07,678: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:05:07.678393162Z [2024-02-24 00:05:07,678: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:07.678424075Z [2024-02-24 00:05:07,678: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:07.679278887Z [2024-02-24 00:05:07,678: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:07.684708732Z [2024-02-24 00:05:07,684: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:07.699241267Z [2024-02-24 00:05:07,699: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:05:07.700612050Z [2024-02-24 00:05:07,700: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:07.700774486Z [2024-02-24 00:05:07,700: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:07.700932840Z [2024-02-24 00:05:07,700: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:07.701162903Z [2024-02-24 00:05:07,700: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:07.701312248Z [2024-02-24 00:05:07,701: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:05:07.701662014Z [2024-02-24 00:05:07,701: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:07.701941322Z [2024-02-24 00:05:07,701: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:07.708458397Z [2024-02-24 00:05:07,708: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:07.761538726Z [2024-02-24 00:05:07,761: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:07.802038128Z [2024-02-24 00:05:07,801: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.split_metrics scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:08.367686913Z [2024-02-24 00:05:08,367: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e131313e-dfa4-4fd5-a29e-8af09efd0003] succeeded in 2.2489486800000122s: None
2024-02-24T00:05:08.447496393Z [2024-02-24 00:05:08,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c56f59d1-1a99-4d3b-bd2d-9190faf9dec3] succeeded in 2.3319416429999364s: None
2024-02-24T00:05:08.758850767Z [2024-02-24 00:05:08,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b32105f5-e84a-4696-8ac0-a258061a9516] received
2024-02-24T00:05:08.764488355Z [2024-02-24 00:05:08,764: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1735ec69-d62f-44e8-826c-0bc562725a0f] received
2024-02-24T00:05:08.766203148Z [2024-02-24 00:05:08,765: INFO/ForkPoolWorker-15] [b32105f5-e84a-4696-8ac0-a258061a9516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:05:08.779343467Z [2024-02-24 00:05:08,778: INFO/ForkPoolWorker-16] [1735ec69-d62f-44e8-826c-0bc562725a0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'collect_metrics', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:05:09.047789218Z [2024-02-24 00:05:09,044: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:09.059686981Z [2024-02-24 00:05:09,056: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:10.152960668Z [2024-02-24 00:05:10,152: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:05:10.156221759Z [2024-02-24 00:05:10,155: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:10.156511995Z [2024-02-24 00:05:10,156: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:05:10.160023433Z [2024-02-24 00:05:10,159: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:10.177635550Z [2024-02-24 00:05:10,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:05:10.178404259Z [2024-02-24 00:05:10,178: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:05:10.179604951Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:10.179654506Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:10.179745841Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:10.179805069Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:10.179951938Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:10.179960023Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:10.180021612Z [2024-02-24 00:05:10,179: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:05:10.180155771Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:10.180485814Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:10.180675690Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:05:10.180824859Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:10.181069290Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:10.181082611Z [2024-02-24 00:05:10,180: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:10.181168118Z [2024-02-24 00:05:10,181: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:10.187649806Z [2024-02-24 00:05:10,187: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:10.188528704Z [2024-02-24 00:05:10,188: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:10.266128782Z [2024-02-24 00:05:10,265: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:10.279952410Z [2024-02-24 00:05:10,279: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.collect_metrics scheduled__2024-02-24T00:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:10.810928555Z [2024-02-24 00:05:10,810: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b32105f5-e84a-4696-8ac0-a258061a9516] succeeded in 2.049129381000057s: None
2024-02-24T00:05:10.900247401Z [2024-02-24 00:05:10,899: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1735ec69-d62f-44e8-826c-0bc562725a0f] succeeded in 2.1334842109999954s: None
2024-02-24T00:05:11.217879492Z [2024-02-24 00:05:11,216: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d1e1529-7b1b-4c2f-84d0-ccc73c2c1bca] received
2024-02-24T00:05:11.224745334Z [2024-02-24 00:05:11,224: INFO/ForkPoolWorker-15] [4d1e1529-7b1b-4c2f-84d0-ccc73c2c1bca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'send_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:11.246765411Z [2024-02-24 00:05:11,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01f8106a-29eb-4c45-885e-3288774047c0] received
2024-02-24T00:05:11.253971055Z [2024-02-24 00:05:11,249: INFO/ForkPoolWorker-16] [01f8106a-29eb-4c45-885e-3288774047c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:05:11.514016327Z [2024-02-24 00:05:11,510: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:11.599527256Z [2024-02-24 00:05:11,596: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:05:12.637401823Z [2024-02-24 00:05:12,629: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:05:12.637429120Z [2024-02-24 00:05:12,633: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:12.699110073Z [2024-02-24 00:05:12,698: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:05:12.701275459Z [2024-02-24 00:05:12,701: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:12.701658021Z [2024-02-24 00:05:12,701: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:12.702248243Z [2024-02-24 00:05:12,701: INFO/ForkPoolWorker-15] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:12.702452969Z [2024-02-24 00:05:12,702: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:12.702575005Z [2024-02-24 00:05:12,702: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:05:12.702951037Z [2024-02-24 00:05:12,702: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:12.703868933Z [2024-02-24 00:05:12,702: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:12.710511784Z [2024-02-24 00:05:12,710: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:12.831642307Z [2024-02-24 00:05:12,831: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99.send_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:12.892902285Z [2024-02-24 00:05:12,892: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:05:12.896462687Z [2024-02-24 00:05:12,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:05:12.914626425Z [2024-02-24 00:05:12,914: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:05:12.915934868Z [2024-02-24 00:05:12,915: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:05:12.916152975Z [2024-02-24 00:05:12,916: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:05:12.916257239Z [2024-02-24 00:05:12,916: INFO/ForkPoolWorker-16] Read VIM 5cbc2639-34c0-46b1-ba92-00e9df6eea99 (basic_08_vim_test)
2024-02-24T00:05:12.916462675Z [2024-02-24 00:05:12,916: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'name': 'basic_08_vim_test', 'vim_type': 'openstack'}]
2024-02-24T00:05:12.916623595Z [2024-02-24 00:05:12,916: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:05:12.916953462Z [2024-02-24 00:05:12,916: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:05:12.917390342Z [2024-02-24 00:05:12,917: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:05:12.923381182Z [2024-02-24 00:05:12,923: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99
2024-02-24T00:05:13.005042358Z [2024-02-24 00:05:13,004: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:05:13.373394645Z [2024-02-24 00:05:13,372: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d1e1529-7b1b-4c2f-84d0-ccc73c2c1bca] succeeded in 2.155139094000333s: None
2024-02-24T00:05:13.631174095Z [2024-02-24 00:05:13,630: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01f8106a-29eb-4c45-885e-3288774047c0] succeeded in 2.394638021999981s: None
2024-02-24T00:06:00.977838934Z [2024-02-24 00:06:00,977: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[914111c9-65a0-4f31-a890-cc373a47b824] received
2024-02-24T00:06:00.980307288Z [2024-02-24 00:06:00,980: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c23b00e-f65f-429f-8afb-1621856567bf] received
2024-02-24T00:06:00.982385545Z [2024-02-24 00:06:00,982: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de08f9a3-f56a-49de-89e4-d038aedce17e] received
2024-02-24T00:06:00.984886438Z [2024-02-24 00:06:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d17b1f8c-f8cc-463a-98b2-638aa24b5cdb] received
2024-02-24T00:06:00.986329694Z [2024-02-24 00:06:00,986: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42be071c-b238-4b64-9dad-fd7da3b95a3e] received
2024-02-24T00:06:00.993401904Z [2024-02-24 00:06:00,993: INFO/ForkPoolWorker-3] [42be071c-b238-4b64-9dad-fd7da3b95a3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:06:00.993813531Z [2024-02-24 00:06:00,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e76d51f-5131-4a1e-9b23-07fab7ba7435] received
2024-02-24T00:06:00.996406327Z [2024-02-24 00:06:00,996: INFO/ForkPoolWorker-2] [d17b1f8c-f8cc-463a-98b2-638aa24b5cdb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:06:00.997199009Z [2024-02-24 00:06:00,996: INFO/ForkPoolWorker-15] [914111c9-65a0-4f31-a890-cc373a47b824] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:06:00.998693927Z [2024-02-24 00:06:00,998: INFO/ForkPoolWorker-1] [de08f9a3-f56a-49de-89e4-d038aedce17e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:06:00.998711417Z [2024-02-24 00:06:00,998: INFO/ForkPoolWorker-16] [0c23b00e-f65f-429f-8afb-1621856567bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:06:01.014193733Z [2024-02-24 00:06:01,013: INFO/ForkPoolWorker-4] [7e76d51f-5131-4a1e-9b23-07fab7ba7435] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:06:01.456029924Z [2024-02-24 00:06:01,452: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:01.588200360Z [2024-02-24 00:06:01,584: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:01.612633171Z [2024-02-24 00:06:01,607: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:06:01.619131258Z [2024-02-24 00:06:01,603: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:06:01.812212833Z [2024-02-24 00:06:01,808: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:01.833809133Z [2024-02-24 00:06:01,820: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:01.937329619Z [2024-02-24 00:06:01,936: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:06:01.982772470Z [2024-02-24 00:06:01,982: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T00:06:01.993985233Z [2024-02-24 00:06:01,993: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:02.059036568Z [2024-02-24 00:06:02,058: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:06:02.062714236Z [2024-02-24 00:06:02,062: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:06:02.062748691Z [2024-02-24 00:06:02,062: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:06:02.062876636Z [2024-02-24 00:06:02,062: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T00:06:02.063168481Z [2024-02-24 00:06:02,063: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:06:02.183409261Z [2024-02-24 00:06:02,183: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:06:02.967245686Z [2024-02-24 00:06:02,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[914111c9-65a0-4f31-a890-cc373a47b824] succeeded in 1.9846644080002989s: None
2024-02-24T00:06:03.188671890Z [2024-02-24 00:06:03,188: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d17b1f8c-f8cc-463a-98b2-638aa24b5cdb] succeeded in 2.201365205000002s: None
2024-02-24T00:06:03.418702908Z [2024-02-24 00:06:03,418: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T00:06:03.422115218Z [2024-02-24 00:06:03,421: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.451002507Z [2024-02-24 00:06:03,450: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:06:03.455501368Z [2024-02-24 00:06:03,455: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.455806866Z [2024-02-24 00:06:03,455: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.456181879Z [2024-02-24 00:06:03,455: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.456371435Z [2024-02-24 00:06:03,456: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T00:06:03.456916024Z [2024-02-24 00:06:03,456: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:06:03.457311876Z [2024-02-24 00:06:03,456: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:03.471235203Z [2024-02-24 00:06:03,470: WARNING/ForkPoolWorker-4] Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:03.472656953Z [2024-02-24 00:06:03,471: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:03.473883497Z [2024-02-24 00:06:03,473: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T00:06:03.477924581Z [2024-02-24 00:06:03,477: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.491583594Z [2024-02-24 00:06:03,491: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T00:06:03.492881406Z [2024-02-24 00:06:03,492: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.492902912Z [2024-02-24 00:06:03,492: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.493083317Z [2024-02-24 00:06:03,492: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.493299116Z [2024-02-24 00:06:03,493: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T00:06:03.493980410Z [2024-02-24 00:06:03,493: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:06:03.494181877Z [2024-02-24 00:06:03,493: INFO/ForkPoolWorker-4] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:03.496000449Z [2024-02-24 00:06:03,495: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:06:03.499396031Z [2024-02-24 00:06:03,498: ERROR/ForkPoolWorker-4] [7e76d51f-5131-4a1e-9b23-07fab7ba7435] Failed to execute task Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:06:03.499411232Z Traceback (most recent call last):
2024-02-24T00:06:03.499415744Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:06:03.499419319Z     args.func(args)
2024-02-24T00:06:03.499423567Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:06:03.499428021Z     return func(*args, **kwargs)
2024-02-24T00:06:03.499448992Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:06:03.499452603Z     return f(*args, **kwargs)
2024-02-24T00:06:03.499455616Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:06:03.499458665Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:06:03.499461602Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:06:03.499478702Z     raise AirflowException(
2024-02-24T00:06:03.499482453Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:06:03.499915799Z [2024-02-24 00:06:03,499: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.534062577Z [2024-02-24 00:06:03,533: ERROR/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[7e76d51f-5131-4a1e-9b23-07fab7ba7435] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7e76d51f-5131-4a1e-9b23-07fab7ba7435')
2024-02-24T00:06:03.534084377Z Traceback (most recent call last):
2024-02-24T00:06:03.534088439Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:06:03.534091625Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:06:03.534094709Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:06:03.534098236Z     return self.run(*args, **kwargs)
2024-02-24T00:06:03.534102114Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:06:03.534106125Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:06:03.534109608Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:06:03.534113282Z     raise AirflowException(msg)
2024-02-24T00:06:03.534117429Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 7e76d51f-5131-4a1e-9b23-07fab7ba7435
2024-02-24T00:06:03.552151666Z [2024-02-24 00:06:03,551: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:06:03.556377412Z [2024-02-24 00:06:03,556: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.556491419Z [2024-02-24 00:06:03,556: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.556695074Z [2024-02-24 00:06:03,556: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.556797543Z [2024-02-24 00:06:03,556: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:06:03.557604374Z [2024-02-24 00:06:03,557: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:06:03.557725616Z [2024-02-24 00:06:03,557: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:03.674777996Z [2024-02-24 00:06:03,674: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:06:03.682180459Z [2024-02-24 00:06:03,681: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.689428711Z [2024-02-24 00:06:03,689: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:06:03.746973583Z [2024-02-24 00:06:03,746: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:06:03.750814285Z [2024-02-24 00:06:03,750: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.750903212Z [2024-02-24 00:06:03,750: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.751042854Z [2024-02-24 00:06:03,750: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.751120671Z [2024-02-24 00:06:03,751: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:06:03.751399201Z [2024-02-24 00:06:03,751: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:06:03.751482857Z [2024-02-24 00:06:03,751: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:03.849462435Z [2024-02-24 00:06:03,849: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:06:03.906559219Z [2024-02-24 00:06:03,906: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:06:03.910203730Z [2024-02-24 00:06:03,909: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.947411465Z [2024-02-24 00:06:03,947: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:06:03.951941633Z [2024-02-24 00:06:03,951: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.951981746Z [2024-02-24 00:06:03,951: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.952161008Z [2024-02-24 00:06:03,951: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.952172889Z [2024-02-24 00:06:03,952: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:06:03.952639023Z [2024-02-24 00:06:03,952: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:06:03.952653364Z [2024-02-24 00:06:03,952: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:03.963268343Z [2024-02-24 00:06:03,962: WARNING/ForkPoolWorker-1] Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:03.964445064Z [2024-02-24 00:06:03,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:03.965457299Z [2024-02-24 00:06:03,965: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:06:03.968247490Z [2024-02-24 00:06:03,967: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:03.990308957Z [2024-02-24 00:06:03,989: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:06:03.997348055Z [2024-02-24 00:06:03,997: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:03.997368076Z [2024-02-24 00:06:03,997: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:03.997612866Z [2024-02-24 00:06:03,997: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:03.997722741Z [2024-02-24 00:06:03,997: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:06:03.998177640Z [2024-02-24 00:06:03,997: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:06:03.998325125Z [2024-02-24 00:06:03,998: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:04.005881194Z [2024-02-24 00:06:04,005: ERROR/ForkPoolWorker-1] [de08f9a3-f56a-49de-89e4-d038aedce17e] Failed to execute task Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:06:04.005898305Z Traceback (most recent call last):
2024-02-24T00:06:04.005902762Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:06:04.005906741Z     args.func(args)
2024-02-24T00:06:04.005911267Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:06:04.005915287Z     return func(*args, **kwargs)
2024-02-24T00:06:04.005918833Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:06:04.005922098Z     return f(*args, **kwargs)
2024-02-24T00:06:04.005925160Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:06:04.005928207Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:06:04.005931695Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:06:04.005934533Z     raise AirflowException(
2024-02-24T00:06:04.005938368Z airflow.exceptions.AirflowException: Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:06:04.043000022Z [2024-02-24 00:06:04,042: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[de08f9a3-f56a-49de-89e4-d038aedce17e] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id de08f9a3-f56a-49de-89e4-d038aedce17e')
2024-02-24T00:06:04.043041082Z Traceback (most recent call last):
2024-02-24T00:06:04.043046064Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:06:04.043049150Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:06:04.043052901Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:06:04.043056296Z     return self.run(*args, **kwargs)
2024-02-24T00:06:04.043059977Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:06:04.043063543Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:06:04.043066859Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:06:04.043085618Z     raise AirflowException(msg)
2024-02-24T00:06:04.043089570Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id de08f9a3-f56a-49de-89e4-d038aedce17e
2024-02-24T00:06:06.704423166Z [2024-02-24 00:06:06,703: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c23b00e-f65f-429f-8afb-1621856567bf] succeeded in 5.720284889999675s: None
2024-02-24T00:06:08.227755018Z [2024-02-24 00:06:08,227: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[42be071c-b238-4b64-9dad-fd7da3b95a3e] succeeded in 7.238773376000154s: None
2024-02-24T00:06:15.252165340Z [2024-02-24 00:06:15,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d0736b3-f6a5-450d-b8c5-10ab6daa534b] received
2024-02-24T00:06:15.258446864Z [2024-02-24 00:06:15,258: INFO/ForkPoolWorker-15] [6d0736b3-f6a5-450d-b8c5-10ab6daa534b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:06:15.265839727Z [2024-02-24 00:06:15,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[acddc740-e7be-4304-b28a-24d3af2f437a] received
2024-02-24T00:06:15.276111234Z [2024-02-24 00:06:15,275: INFO/ForkPoolWorker-16] [acddc740-e7be-4304-b28a-24d3af2f437a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:06:15.543394582Z [2024-02-24 00:06:15,540: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:15.550251484Z [2024-02-24 00:06:15,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:16.623259718Z [2024-02-24 00:06:16,622: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:06:16.626554716Z [2024-02-24 00:06:16,626: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:16.657000010Z [2024-02-24 00:06:16,656: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:06:16.658514777Z [2024-02-24 00:06:16,658: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:16.658673457Z [2024-02-24 00:06:16,658: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:16.658921241Z [2024-02-24 00:06:16,658: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:16.659028812Z [2024-02-24 00:06:16,658: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:06:16.659473660Z [2024-02-24 00:06:16,659: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:06:16.659589998Z [2024-02-24 00:06:16,659: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:16.666931988Z [2024-02-24 00:06:16,666: WARNING/ForkPoolWorker-15] Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:16.667829699Z [2024-02-24 00:06:16,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:06:16.668632957Z [2024-02-24 00:06:16,668: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:06:16.671251859Z [2024-02-24 00:06:16,670: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:16.686383799Z [2024-02-24 00:06:16,686: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:06:16.687674072Z [2024-02-24 00:06:16,687: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:16.687784765Z [2024-02-24 00:06:16,687: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:16.687983014Z [2024-02-24 00:06:16,687: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:16.688042678Z [2024-02-24 00:06:16,687: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:06:16.688503684Z [2024-02-24 00:06:16,688: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:06:16.688757707Z [2024-02-24 00:06:16,688: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:16.692379510Z [2024-02-24 00:06:16,691: ERROR/ForkPoolWorker-15] [6d0736b3-f6a5-450d-b8c5-10ab6daa534b] Failed to execute task Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:06:16.692397530Z Traceback (most recent call last):
2024-02-24T00:06:16.692406261Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:06:16.692439276Z     args.func(args)
2024-02-24T00:06:16.692447876Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:06:16.692455309Z     return func(*args, **kwargs)
2024-02-24T00:06:16.692461708Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:06:16.692468186Z     return f(*args, **kwargs)
2024-02-24T00:06:16.692474622Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:06:16.692480985Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:06:16.692487381Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:06:16.692494080Z     raise AirflowException(
2024-02-24T00:06:16.692525130Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:06:16.723373674Z [2024-02-24 00:06:16,722: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d0736b3-f6a5-450d-b8c5-10ab6daa534b] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6d0736b3-f6a5-450d-b8c5-10ab6daa534b')
2024-02-24T00:06:16.723409955Z Traceback (most recent call last):
2024-02-24T00:06:16.723415520Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:06:16.723427798Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:06:16.723431587Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:06:16.723434633Z     return self.run(*args, **kwargs)
2024-02-24T00:06:16.723438617Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:06:16.723442143Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:06:16.723445152Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:06:16.723448615Z     raise AirflowException(msg)
2024-02-24T00:06:16.723454596Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 6d0736b3-f6a5-450d-b8c5-10ab6daa534b
2024-02-24T00:06:16.752292455Z [2024-02-24 00:06:16,751: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:06:16.755674188Z [2024-02-24 00:06:16,755: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:16.776816017Z [2024-02-24 00:06:16,776: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:06:16.778194552Z [2024-02-24 00:06:16,777: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:16.778267057Z [2024-02-24 00:06:16,778: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:16.778486070Z [2024-02-24 00:06:16,778: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:16.778525448Z [2024-02-24 00:06:16,778: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:06:16.778786926Z [2024-02-24 00:06:16,778: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:06:16.778860591Z [2024-02-24 00:06:16,778: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:16.785422542Z [2024-02-24 00:06:16,785: WARNING/ForkPoolWorker-16] Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:16.786724450Z [2024-02-24 00:06:16,785: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:06:16.787613297Z [2024-02-24 00:06:16,787: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:06:16.790680707Z [2024-02-24 00:06:16,790: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:06:16.808507155Z [2024-02-24 00:06:16,808: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:06:16.810273324Z [2024-02-24 00:06:16,809: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:06:16.810303947Z [2024-02-24 00:06:16,810: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:06:16.810536541Z [2024-02-24 00:06:16,810: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:06:16.810615207Z [2024-02-24 00:06:16,810: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:06:16.811108351Z [2024-02-24 00:06:16,810: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:06:16.811128790Z [2024-02-24 00:06:16,811: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:06:16.817132494Z [2024-02-24 00:06:16,816: ERROR/ForkPoolWorker-16] [acddc740-e7be-4304-b28a-24d3af2f437a] Failed to execute task Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:06:16.817158512Z Traceback (most recent call last):
2024-02-24T00:06:16.817211722Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:06:16.817219847Z     args.func(args)
2024-02-24T00:06:16.817226698Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:06:16.817233651Z     return func(*args, **kwargs)
2024-02-24T00:06:16.817239693Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:06:16.817306989Z     return f(*args, **kwargs)
2024-02-24T00:06:16.817314521Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:06:16.817320685Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:06:16.817326785Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:06:16.817356422Z     raise AirflowException(
2024-02-24T00:06:16.817364197Z airflow.exceptions.AirflowException: Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:06:16.863369184Z [2024-02-24 00:06:16,862: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[acddc740-e7be-4304-b28a-24d3af2f437a] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id acddc740-e7be-4304-b28a-24d3af2f437a')
2024-02-24T00:06:16.863432176Z Traceback (most recent call last):
2024-02-24T00:06:16.863439205Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:06:16.863443960Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:06:16.863449199Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:06:16.863454033Z     return self.run(*args, **kwargs)
2024-02-24T00:06:16.863459447Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:06:16.863464818Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:06:16.863469436Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:06:16.863474745Z     raise AirflowException(msg)
2024-02-24T00:06:16.863532572Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id acddc740-e7be-4304-b28a-24d3af2f437a
2024-02-24T00:07:00.842717547Z [2024-02-24 00:07:00,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[880e412a-7526-4a37-a70a-119a0c9d1c20] received
2024-02-24T00:07:00.844851793Z [2024-02-24 00:07:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5ec7ae1-efa2-4f82-9d4c-f02af03c1b32] received
2024-02-24T00:07:00.852232747Z [2024-02-24 00:07:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a6915ca-9415-44fc-8f8f-b31194e9d74c] received
2024-02-24T00:07:00.852452809Z [2024-02-24 00:07:00,852: INFO/ForkPoolWorker-15] [880e412a-7526-4a37-a70a-119a0c9d1c20] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:07:00.853048172Z [2024-02-24 00:07:00,852: INFO/ForkPoolWorker-16] [e5ec7ae1-efa2-4f82-9d4c-f02af03c1b32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:07:00.856511748Z [2024-02-24 00:07:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35e2c5aa-9c2a-410e-a8b8-6859711448fe] received
2024-02-24T00:07:00.868870949Z [2024-02-24 00:07:00,868: INFO/ForkPoolWorker-1] [3a6915ca-9415-44fc-8f8f-b31194e9d74c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:07:00.871748173Z [2024-02-24 00:07:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02a5c51d-4f3d-4a02-888c-676c29cd54d9] received
2024-02-24T00:07:00.871869904Z [2024-02-24 00:07:00,871: INFO/ForkPoolWorker-2] [35e2c5aa-9c2a-410e-a8b8-6859711448fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:07:00.878198490Z [2024-02-24 00:07:00,877: INFO/ForkPoolWorker-3] [02a5c51d-4f3d-4a02-888c-676c29cd54d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:07:01.253936447Z [2024-02-24 00:07:01,246: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:07:01.302793414Z [2024-02-24 00:07:01,293: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:07:01.316116939Z [2024-02-24 00:07:01,313: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:07:01.538617850Z [2024-02-24 00:07:01,538: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:07:01.547237598Z [2024-02-24 00:07:01,546: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:01.575539570Z [2024-02-24 00:07:01,568: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:07:01.609378334Z [2024-02-24 00:07:01,604: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:07:01.610842700Z [2024-02-24 00:07:01,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:07:01.613101000Z [2024-02-24 00:07:01,612: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:07:01.613172794Z [2024-02-24 00:07:01,613: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:07:01.613208385Z [2024-02-24 00:07:01,613: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:07:01.613394217Z [2024-02-24 00:07:01,613: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:07:01.760605270Z [2024-02-24 00:07:01,760: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:07:02.481372506Z [2024-02-24 00:07:02,480: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[880e412a-7526-4a37-a70a-119a0c9d1c20] succeeded in 1.6352863160000197s: None
2024-02-24T00:07:02.825314048Z [2024-02-24 00:07:02,824: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:07:02.830762161Z [2024-02-24 00:07:02,830: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:02.864929454Z [2024-02-24 00:07:02,864: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:07:02.866807758Z [2024-02-24 00:07:02,866: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:02.867457752Z [2024-02-24 00:07:02,867: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:02.868041999Z [2024-02-24 00:07:02,867: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:02.869200333Z [2024-02-24 00:07:02,869: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:07:02.869517838Z [2024-02-24 00:07:02,869: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:07:02.869765526Z [2024-02-24 00:07:02,869: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:02.878157492Z [2024-02-24 00:07:02,877: WARNING/ForkPoolWorker-3] Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:07:02.880807837Z [2024-02-24 00:07:02,879: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:07:02.882567369Z [2024-02-24 00:07:02,882: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:07:02.884377372Z [2024-02-24 00:07:02,884: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:07:02.888057216Z [2024-02-24 00:07:02,887: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:02.893315661Z [2024-02-24 00:07:02,892: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:02.911346745Z [2024-02-24 00:07:02,911: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:07:02.913206727Z [2024-02-24 00:07:02,912: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:02.913398360Z [2024-02-24 00:07:02,913: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:02.913611113Z [2024-02-24 00:07:02,913: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:02.913792403Z [2024-02-24 00:07:02,913: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:07:02.914505621Z [2024-02-24 00:07:02,914: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:07:02.914778768Z [2024-02-24 00:07:02,914: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:02.920306259Z [2024-02-24 00:07:02,919: ERROR/ForkPoolWorker-3] [02a5c51d-4f3d-4a02-888c-676c29cd54d9] Failed to execute task Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:07:02.920324376Z Traceback (most recent call last):
2024-02-24T00:07:02.920328362Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:07:02.920332102Z     args.func(args)
2024-02-24T00:07:02.920336566Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:07:02.920340333Z     return func(*args, **kwargs)
2024-02-24T00:07:02.920343488Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:07:02.920346739Z     return f(*args, **kwargs)
2024-02-24T00:07:02.920349783Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:07:02.920352985Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:07:02.920356100Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:07:02.920359207Z     raise AirflowException(
2024-02-24T00:07:02.920362906Z airflow.exceptions.AirflowException: Dag 'vim_status_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:07:02.929134918Z [2024-02-24 00:07:02,928: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:07:02.930590189Z [2024-02-24 00:07:02,930: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:02.930646340Z [2024-02-24 00:07:02,930: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:02.930788814Z [2024-02-24 00:07:02,930: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:02.930831280Z [2024-02-24 00:07:02,930: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:07:02.931094756Z [2024-02-24 00:07:02,930: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:07:02.931100215Z [2024-02-24 00:07:02,931: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:02.937598090Z [2024-02-24 00:07:02,937: WARNING/ForkPoolWorker-1] Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:07:02.938673101Z [2024-02-24 00:07:02,937: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:07:02.939576852Z [2024-02-24 00:07:02,939: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:07:02.942425002Z [2024-02-24 00:07:02,942: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:02.954047617Z [2024-02-24 00:07:02,953: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:07:02.955370157Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:02.955441606Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:02.955479866Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:02.955530829Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:07:02.955741123Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:07:02.955785818Z [2024-02-24 00:07:02,955: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:02.959928429Z [2024-02-24 00:07:02,959: ERROR/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[02a5c51d-4f3d-4a02-888c-676c29cd54d9] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 02a5c51d-4f3d-4a02-888c-676c29cd54d9')
2024-02-24T00:07:02.959946568Z Traceback (most recent call last):
2024-02-24T00:07:02.959951436Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:07:02.959956014Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:07:02.959960190Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:07:02.959964296Z     return self.run(*args, **kwargs)
2024-02-24T00:07:02.959969376Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:07:02.959974379Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:07:02.959978338Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:07:02.959983503Z     raise AirflowException(msg)
2024-02-24T00:07:02.959988503Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 02a5c51d-4f3d-4a02-888c-676c29cd54d9
2024-02-24T00:07:02.960088962Z [2024-02-24 00:07:02,959: ERROR/ForkPoolWorker-1] [3a6915ca-9415-44fc-8f8f-b31194e9d74c] Failed to execute task Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse..
2024-02-24T00:07:02.960096812Z Traceback (most recent call last):
2024-02-24T00:07:02.960118524Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T00:07:02.960123457Z     args.func(args)
2024-02-24T00:07:02.960127958Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T00:07:02.960132496Z     return func(*args, **kwargs)
2024-02-24T00:07:02.960136430Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T00:07:02.960140580Z     return f(*args, **kwargs)
2024-02-24T00:07:02.960144662Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T00:07:02.960149112Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T00:07:02.960153139Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T00:07:02.960157068Z     raise AirflowException(
2024-02-24T00:07:02.960162103Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_5cbc2639-34c0-46b1-ba92-00e9df6eea99' could not be found; either it does not exist or it failed to parse.
2024-02-24T00:07:02.989527341Z [2024-02-24 00:07:02,988: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3a6915ca-9415-44fc-8f8f-b31194e9d74c] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3a6915ca-9415-44fc-8f8f-b31194e9d74c')
2024-02-24T00:07:02.989558594Z Traceback (most recent call last):
2024-02-24T00:07:02.989565879Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T00:07:02.989572767Z     R = retval = fun(*args, **kwargs)
2024-02-24T00:07:02.989578377Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T00:07:02.989583975Z     return self.run(*args, **kwargs)
2024-02-24T00:07:02.989590301Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T00:07:02.989596454Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T00:07:02.989601979Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T00:07:02.989608396Z     raise AirflowException(msg)
2024-02-24T00:07:02.989614768Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 3a6915ca-9415-44fc-8f8f-b31194e9d74c
2024-02-24T00:07:03.196527566Z [2024-02-24 00:07:03,196: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:07:03.199807284Z [2024-02-24 00:07:03,199: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:03.223269349Z [2024-02-24 00:07:03,223: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:07:03.224694157Z [2024-02-24 00:07:03,224: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:03.224798237Z [2024-02-24 00:07:03,224: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:03.225135763Z [2024-02-24 00:07:03,224: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:03.225233188Z [2024-02-24 00:07:03,225: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:07:03.226616578Z [2024-02-24 00:07:03,226: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:07:03.226698718Z [2024-02-24 00:07:03,226: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:03.271605614Z [2024-02-24 00:07:03,271: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:07:03.274702445Z [2024-02-24 00:07:03,274: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:07:03.300005885Z [2024-02-24 00:07:03,299: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:07:03.302029693Z [2024-02-24 00:07:03,301: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:07:03.302200452Z [2024-02-24 00:07:03,302: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:07:03.302465508Z [2024-02-24 00:07:03,302: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:07:03.302594228Z [2024-02-24 00:07:03,302: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:07:03.303008564Z [2024-02-24 00:07:03,302: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:07:03.303163873Z [2024-02-24 00:07:03,302: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:07:03.313765473Z [2024-02-24 00:07:03,313: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:07:03.395659248Z [2024-02-24 00:07:03,395: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:07:05.231096621Z [2024-02-24 00:07:05,230: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5ec7ae1-efa2-4f82-9d4c-f02af03c1b32] succeeded in 4.384765484999662s: None
2024-02-24T00:07:05.480394910Z [2024-02-24 00:07:05,479: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[35e2c5aa-9c2a-410e-a8b8-6859711448fe] succeeded in 4.614245798999946s: None
2024-02-24T00:08:00.998841255Z [2024-02-24 00:08:00,998: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9824f8ed-e8fa-491d-ba5b-023bb3a1a572] received
2024-02-24T00:08:01.003698034Z [2024-02-24 00:08:01,003: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a98582b4-8a68-47e0-bb23-b43ea94d3093] received
2024-02-24T00:08:01.007961483Z [2024-02-24 00:08:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a79351f-2fe7-48c5-b027-ec25d3e2d71e] received
2024-02-24T00:08:01.012014351Z [2024-02-24 00:08:01,011: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22790e60-e930-4c1a-80be-4f5daf6adbe5] received
2024-02-24T00:08:01.013804695Z [2024-02-24 00:08:01,013: INFO/ForkPoolWorker-15] [9824f8ed-e8fa-491d-ba5b-023bb3a1a572] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:08:01.019256215Z [2024-02-24 00:08:01,018: INFO/ForkPoolWorker-1] [2a79351f-2fe7-48c5-b027-ec25d3e2d71e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:08:01.019914964Z [2024-02-24 00:08:01,019: INFO/ForkPoolWorker-2] [22790e60-e930-4c1a-80be-4f5daf6adbe5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:08:01.023288212Z [2024-02-24 00:08:01,023: INFO/ForkPoolWorker-16] [a98582b4-8a68-47e0-bb23-b43ea94d3093] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:08:01.364223641Z [2024-02-24 00:08:01,361: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:08:01.519862712Z [2024-02-24 00:08:01,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:08:01.552193537Z [2024-02-24 00:08:01,548: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:08:01.722685545Z [2024-02-24 00:08:01,722: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:08:01.885296055Z [2024-02-24 00:08:01,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:08:02.286906672Z [2024-02-24 00:08:02,286: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a79351f-2fe7-48c5-b027-ec25d3e2d71e] succeeded in 1.273091470000054s: None
2024-02-24T00:08:02.308230841Z [2024-02-24 00:08:02,307: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:08:02.312671971Z [2024-02-24 00:08:02,312: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:08:02.346659822Z [2024-02-24 00:08:02,346: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:08:02.347760553Z [2024-02-24 00:08:02,347: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:08:02.347927933Z [2024-02-24 00:08:02,347: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:08:02.348004342Z [2024-02-24 00:08:02,347: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:08:02.348274991Z [2024-02-24 00:08:02,348: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:08:02.521724788Z [2024-02-24 00:08:02,521: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:08:03.031528085Z [2024-02-24 00:08:03,031: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:08:03.034990014Z [2024-02-24 00:08:03,034: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:08:03.059483968Z [2024-02-24 00:08:03,059: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:08:03.064310268Z [2024-02-24 00:08:03,064: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:08:03.064415227Z [2024-02-24 00:08:03,064: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:08:03.067424405Z [2024-02-24 00:08:03,067: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:08:03.067962648Z [2024-02-24 00:08:03,067: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:08:03.068148431Z [2024-02-24 00:08:03,067: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:08:03.068257490Z [2024-02-24 00:08:03,068: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:08:03.068667331Z [2024-02-24 00:08:03,068: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:08:03.068773343Z [2024-02-24 00:08:03,068: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:08:03.114641446Z [2024-02-24 00:08:03,114: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:08:03.118939158Z [2024-02-24 00:08:03,118: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:08:03.119155336Z [2024-02-24 00:08:03,118: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:08:03.119410239Z [2024-02-24 00:08:03,119: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:08:03.119558451Z [2024-02-24 00:08:03,119: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:08:03.119947960Z [2024-02-24 00:08:03,119: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:08:03.120051414Z [2024-02-24 00:08:03,119: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:08:03.186279550Z [2024-02-24 00:08:03,185: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:08:03.227150409Z [2024-02-24 00:08:03,226: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:08:03.306177098Z [2024-02-24 00:08:03,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a98582b4-8a68-47e0-bb23-b43ea94d3093] succeeded in 2.2969974229999934s: None
2024-02-24T00:08:05.052246114Z [2024-02-24 00:08:05,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9824f8ed-e8fa-491d-ba5b-023bb3a1a572] succeeded in 4.047259846000088s: None
2024-02-24T00:08:05.199339891Z [2024-02-24 00:08:05,198: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[22790e60-e930-4c1a-80be-4f5daf6adbe5] succeeded in 4.185882972999934s: None
2024-02-24T00:09:00.935277642Z [2024-02-24 00:09:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6400c059-5870-4e70-8c32-8abe1749b9da] received
2024-02-24T00:09:00.946392018Z [2024-02-24 00:09:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d66a3438-354d-4e8f-b2b1-b8e85aa514da] received
2024-02-24T00:09:00.953576454Z [2024-02-24 00:09:00,953: INFO/ForkPoolWorker-15] [6400c059-5870-4e70-8c32-8abe1749b9da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:09:00.953888111Z [2024-02-24 00:09:00,953: INFO/ForkPoolWorker-16] [d66a3438-354d-4e8f-b2b1-b8e85aa514da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:09:00.965922647Z [2024-02-24 00:09:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9238bde-0434-4cc3-8fd8-977a6e7bd22d] received
2024-02-24T00:09:00.985228363Z [2024-02-24 00:09:00,984: INFO/ForkPoolWorker-1] [e9238bde-0434-4cc3-8fd8-977a6e7bd22d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:09:01.364630771Z [2024-02-24 00:09:01,360: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:09:01.408461976Z [2024-02-24 00:09:01,405: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:09:01.448035597Z [2024-02-24 00:09:01,444: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:09:01.618122543Z [2024-02-24 00:09:01,617: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:09:01.623111163Z [2024-02-24 00:09:01,622: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:09:01.653272195Z [2024-02-24 00:09:01,653: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:09:01.667019439Z [2024-02-24 00:09:01,666: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:09:01.667041834Z [2024-02-24 00:09:01,666: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:09:01.667046215Z [2024-02-24 00:09:01,666: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:09:01.667049381Z [2024-02-24 00:09:01,666: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:09:01.767848779Z [2024-02-24 00:09:01,767: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:09:02.474597237Z [2024-02-24 00:09:02,472: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9238bde-0434-4cc3-8fd8-977a6e7bd22d] succeeded in 1.504863755000315s: None
2024-02-24T00:09:02.923421946Z [2024-02-24 00:09:02,922: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:09:02.926340876Z [2024-02-24 00:09:02,925: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:09:02.948445697Z [2024-02-24 00:09:02,947: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:09:02.952749635Z [2024-02-24 00:09:02,952: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:09:02.954864501Z [2024-02-24 00:09:02,954: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:09:02.956239304Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:09:02.956370248Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:09:02.956550926Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:09:02.956672299Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:09:02.956968711Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:09:02.957100053Z [2024-02-24 00:09:02,956: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:09:02.992760853Z [2024-02-24 00:09:02,992: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:09:02.994728737Z [2024-02-24 00:09:02,994: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:09:02.994899613Z [2024-02-24 00:09:02,994: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:09:02.995116646Z [2024-02-24 00:09:02,994: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:09:02.995253459Z [2024-02-24 00:09:02,995: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:09:02.995603739Z [2024-02-24 00:09:02,995: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:09:02.995726453Z [2024-02-24 00:09:02,995: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:09:03.058812552Z [2024-02-24 00:09:03,058: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:09:03.096390466Z [2024-02-24 00:09:03,096: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:09:05.850981278Z [2024-02-24 00:09:05,850: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6400c059-5870-4e70-8c32-8abe1749b9da] succeeded in 4.909205086999918s: None
2024-02-24T00:09:06.323475952Z [2024-02-24 00:09:06,322: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d66a3438-354d-4e8f-b2b1-b8e85aa514da] succeeded in 5.375642287000119s: None
2024-02-24T00:10:00.666719316Z [2024-02-24 00:10:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26c469f3-becc-4fdd-830e-375d1431bec9] received
2024-02-24T00:10:00.670274637Z [2024-02-24 00:10:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8e82fc9-6f52-4268-832d-6a6fce0ac0f4] received
2024-02-24T00:10:00.676554018Z [2024-02-24 00:10:00,676: INFO/ForkPoolWorker-15] [26c469f3-becc-4fdd-830e-375d1431bec9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:10:00.681148079Z [2024-02-24 00:10:00,680: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a5d9da92-055a-4f00-9a48-2e307ce42405] received
2024-02-24T00:10:00.682702197Z [2024-02-24 00:10:00,682: INFO/ForkPoolWorker-16] [d8e82fc9-6f52-4268-832d-6a6fce0ac0f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:10:00.692709439Z [2024-02-24 00:10:00,692: INFO/ForkPoolWorker-1] [a5d9da92-055a-4f00-9a48-2e307ce42405] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:10:00.698419265Z [2024-02-24 00:10:00,698: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7a440bb-e7cd-4e9d-b16b-d8977945148b] received
2024-02-24T00:10:00.706065129Z [2024-02-24 00:10:00,705: INFO/ForkPoolWorker-2] [a7a440bb-e7cd-4e9d-b16b-d8977945148b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:10:00.713149814Z [2024-02-24 00:10:00,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06c53678-6a7c-407e-bc78-7d417352d455] received
2024-02-24T00:10:00.720439401Z [2024-02-24 00:10:00,720: INFO/ForkPoolWorker-3] [06c53678-6a7c-407e-bc78-7d417352d455] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:10:01.161159769Z [2024-02-24 00:10:01,156: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:10:01.219086864Z [2024-02-24 00:10:01,215: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:10:01.580321010Z [2024-02-24 00:10:01,573: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:10:01.637174028Z [2024-02-24 00:10:01,633: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:10:01.656960338Z [2024-02-24 00:10:01,644: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:10:01.727897761Z [2024-02-24 00:10:01,727: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:10:01.746479584Z [2024-02-24 00:10:01,741: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:01.819942805Z [2024-02-24 00:10:01,819: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:10:01.822978958Z [2024-02-24 00:10:01,822: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:10:01.823154226Z [2024-02-24 00:10:01,822: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:10:01.826343475Z [2024-02-24 00:10:01,823: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:10:01.826791412Z [2024-02-24 00:10:01,826: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:10:01.929838761Z [2024-02-24 00:10:01,929: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:01.956579899Z [2024-02-24 00:10:01,956: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:02.753164298Z [2024-02-24 00:10:02,752: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a5d9da92-055a-4f00-9a48-2e307ce42405] succeeded in 2.068535786999746s: None
2024-02-24T00:10:02.861885294Z [2024-02-24 00:10:02,861: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:10:02.866208268Z [2024-02-24 00:10:02,865: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:02.870483842Z [2024-02-24 00:10:02,870: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8e82fc9-6f52-4268-832d-6a6fce0ac0f4] succeeded in 2.1970429399998466s: None
2024-02-24T00:10:02.891252798Z [2024-02-24 00:10:02,891: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:10:02.892502640Z [2024-02-24 00:10:02,892: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:02.893163824Z [2024-02-24 00:10:02,892: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:02.893381124Z [2024-02-24 00:10:02,893: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:02.893486383Z [2024-02-24 00:10:02,893: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:10:02.893930112Z [2024-02-24 00:10:02,893: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:10:02.894102645Z [2024-02-24 00:10:02,893: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:03.091749574Z [2024-02-24 00:10:03,091: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:03.739182886Z [2024-02-24 00:10:03,738: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:10:03.748518877Z [2024-02-24 00:10:03,742: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:03.778729242Z [2024-02-24 00:10:03,778: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:10:03.780186190Z [2024-02-24 00:10:03,779: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:03.780361817Z [2024-02-24 00:10:03,780: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:03.780569206Z [2024-02-24 00:10:03,780: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:03.780702946Z [2024-02-24 00:10:03,780: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:10:03.781162514Z [2024-02-24 00:10:03,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:10:03.781299351Z [2024-02-24 00:10:03,781: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:03.872967500Z [2024-02-24 00:10:03,872: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:04.218388304Z [2024-02-24 00:10:04,217: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:10:04.221613534Z [2024-02-24 00:10:04,221: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:04.243108495Z [2024-02-24 00:10:04,242: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:10:04.245337183Z [2024-02-24 00:10:04,245: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:04.245491558Z [2024-02-24 00:10:04,245: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:04.245966248Z [2024-02-24 00:10:04,245: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:04.246156873Z [2024-02-24 00:10:04,245: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:10:04.246591604Z [2024-02-24 00:10:04,246: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:10:04.246797837Z [2024-02-24 00:10:04,246: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:04.344759353Z [2024-02-24 00:10:04,344: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:04.545252602Z [2024-02-24 00:10:04,544: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26c469f3-becc-4fdd-830e-375d1431bec9] succeeded in 3.873589316000107s: None
2024-02-24T00:10:05.012863700Z [2024-02-24 00:10:05,012: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a7a440bb-e7cd-4e9d-b16b-d8977945148b] succeeded in 4.313159308000195s: None
2024-02-24T00:10:05.314481463Z [2024-02-24 00:10:05,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e8a5f68-5f54-4f3e-b1e3-a9b17879f003] received
2024-02-24T00:10:05.323187512Z [2024-02-24 00:10:05,322: INFO/ForkPoolWorker-15] [9e8a5f68-5f54-4f3e-b1e3-a9b17879f003] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:10:05.644084528Z [2024-02-24 00:10:05,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:10:06.220123781Z [2024-02-24 00:10:06,219: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[06c53678-6a7c-407e-bc78-7d417352d455] succeeded in 5.50546937900026s: None
2024-02-24T00:10:06.855370085Z [2024-02-24 00:10:06,854: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:10:06.858927727Z [2024-02-24 00:10:06,858: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:06.882914866Z [2024-02-24 00:10:06,882: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:10:06.884573979Z [2024-02-24 00:10:06,884: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:06.884621507Z [2024-02-24 00:10:06,884: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:06.884832845Z [2024-02-24 00:10:06,884: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:06.884852079Z [2024-02-24 00:10:06,884: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:10:06.885211184Z [2024-02-24 00:10:06,885: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:10:06.885255587Z [2024-02-24 00:10:06,885: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:06.977351652Z [2024-02-24 00:10:06,976: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:07.652949193Z [2024-02-24 00:10:07,652: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c842c687-2539-4d50-ae6d-622fbdaab39c] received
2024-02-24T00:10:07.660616452Z [2024-02-24 00:10:07,660: INFO/ForkPoolWorker-16] [c842c687-2539-4d50-ae6d-622fbdaab39c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:10:07.720728116Z [2024-02-24 00:10:07,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e8a5f68-5f54-4f3e-b1e3-a9b17879f003] succeeded in 2.4040761420001218s: None
2024-02-24T00:10:07.944834925Z [2024-02-24 00:10:07,941: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:10:09.101612144Z [2024-02-24 00:10:09,101: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:10:09.105037657Z [2024-02-24 00:10:09,104: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:09.127276115Z [2024-02-24 00:10:09,127: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:10:09.128721789Z [2024-02-24 00:10:09,128: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:09.128747353Z [2024-02-24 00:10:09,128: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:09.128877234Z [2024-02-24 00:10:09,128: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:09.128915015Z [2024-02-24 00:10:09,128: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:10:09.129218638Z [2024-02-24 00:10:09,129: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:10:09.129267588Z [2024-02-24 00:10:09,129: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:09.218576394Z [2024-02-24 00:10:09,218: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:09.891077844Z [2024-02-24 00:10:09,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c842c687-2539-4d50-ae6d-622fbdaab39c] succeeded in 2.2361595470001703s: None
2024-02-24T00:10:10.583991182Z [2024-02-24 00:10:10,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe60a163-49d6-42a1-b883-04e785be043d] received
2024-02-24T00:10:10.595074526Z [2024-02-24 00:10:10,594: INFO/ForkPoolWorker-15] [fe60a163-49d6-42a1-b883-04e785be043d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:10:10.906642557Z [2024-02-24 00:10:10,902: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:10:12.121740758Z [2024-02-24 00:10:12,121: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:10:12.125904742Z [2024-02-24 00:10:12,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:10:12.147974821Z [2024-02-24 00:10:12,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:10:12.149564011Z [2024-02-24 00:10:12,149: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:10:12.149601539Z [2024-02-24 00:10:12,149: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:10:12.149855793Z [2024-02-24 00:10:12,149: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:10:12.149872266Z [2024-02-24 00:10:12,149: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:10:12.150393846Z [2024-02-24 00:10:12,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:10:12.150426600Z [2024-02-24 00:10:12,150: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:10:12.241241591Z [2024-02-24 00:10:12,240: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:10:12.940775707Z [2024-02-24 00:10:12,940: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe60a163-49d6-42a1-b883-04e785be043d] succeeded in 2.3538097189998552s: None
2024-02-24T00:11:01.053670023Z [2024-02-24 00:11:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecadbf8d-fae3-47c0-8d2c-358140783d13] received
2024-02-24T00:11:01.060263917Z [2024-02-24 00:11:01,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7077179a-14ec-451f-80b8-9d8b519271f4] received
2024-02-24T00:11:01.061061751Z [2024-02-24 00:11:01,060: INFO/ForkPoolWorker-15] [ecadbf8d-fae3-47c0-8d2c-358140783d13] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:11:01.070344296Z [2024-02-24 00:11:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07860ae8-b654-4068-a539-5f324ef58853] received
2024-02-24T00:11:01.078883660Z [2024-02-24 00:11:01,078: INFO/ForkPoolWorker-16] [7077179a-14ec-451f-80b8-9d8b519271f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:11:01.087514480Z [2024-02-24 00:11:01,087: INFO/ForkPoolWorker-1] [07860ae8-b654-4068-a539-5f324ef58853] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:11:01.414490611Z [2024-02-24 00:11:01,411: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:11:01.443669968Z [2024-02-24 00:11:01,440: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:11:01.500582974Z [2024-02-24 00:11:01,497: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:11:01.576676171Z [2024-02-24 00:11:01,576: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:11:01.580639456Z [2024-02-24 00:11:01,580: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:11:01.601343200Z [2024-02-24 00:11:01,601: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:11:01.602489080Z [2024-02-24 00:11:01,602: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:11:01.602640181Z [2024-02-24 00:11:01,602: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:11:01.602783661Z [2024-02-24 00:11:01,602: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:11:01.603049390Z [2024-02-24 00:11:01,602: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:11:01.712708580Z [2024-02-24 00:11:01,712: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:11:02.466267079Z [2024-02-24 00:11:02,465: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecadbf8d-fae3-47c0-8d2c-358140783d13] succeeded in 1.4111984589999338s: None
2024-02-24T00:11:02.857234290Z [2024-02-24 00:11:02,856: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:11:02.862656167Z [2024-02-24 00:11:02,862: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:11:02.892847320Z [2024-02-24 00:11:02,892: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:11:02.896714929Z [2024-02-24 00:11:02,896: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:11:02.896737982Z [2024-02-24 00:11:02,896: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:11:02.896845677Z [2024-02-24 00:11:02,896: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:11:02.896854640Z [2024-02-24 00:11:02,896: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:11:02.897163274Z [2024-02-24 00:11:02,897: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:11:02.897206908Z [2024-02-24 00:11:02,897: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:11:02.955222158Z [2024-02-24 00:11:02,954: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:11:02.958678063Z [2024-02-24 00:11:02,958: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:11:02.994421392Z [2024-02-24 00:11:02,994: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:11:02.996733320Z [2024-02-24 00:11:02,996: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:11:02.996747773Z [2024-02-24 00:11:02,996: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:11:02.996890438Z [2024-02-24 00:11:02,996: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:11:02.996896502Z [2024-02-24 00:11:02,996: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:11:02.997119765Z [2024-02-24 00:11:02,996: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:11:02.997147800Z [2024-02-24 00:11:02,997: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:11:03.007041424Z [2024-02-24 00:11:03,006: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:11:03.125149073Z [2024-02-24 00:11:03,124: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:11:05.316182265Z [2024-02-24 00:11:05,315: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7077179a-14ec-451f-80b8-9d8b519271f4] succeeded in 4.248641055999997s: None
2024-02-24T00:11:06.565752659Z [2024-02-24 00:11:06,565: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[07860ae8-b654-4068-a539-5f324ef58853] succeeded in 5.4926773110000795s: None
2024-02-24T00:12:00.887649618Z [2024-02-24 00:12:00,887: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d97a098-4b25-483f-96a6-d13e32a14fa2] received
2024-02-24T00:12:00.890219006Z [2024-02-24 00:12:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6c4ec8b-39eb-4c3a-af42-7d8b557442a9] received
2024-02-24T00:12:00.891783196Z [2024-02-24 00:12:00,891: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af0c42a8-1104-4dab-84a0-bf4a77b05a60] received
2024-02-24T00:12:00.896502279Z [2024-02-24 00:12:00,896: INFO/ForkPoolWorker-15] [0d97a098-4b25-483f-96a6-d13e32a14fa2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:12:00.898261689Z [2024-02-24 00:12:00,893: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f9493df-0e96-404f-8083-8fab401e4775] received
2024-02-24T00:12:00.904280190Z [2024-02-24 00:12:00,903: INFO/ForkPoolWorker-16] [f6c4ec8b-39eb-4c3a-af42-7d8b557442a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:12:00.910681465Z [2024-02-24 00:12:00,910: INFO/ForkPoolWorker-2] [9f9493df-0e96-404f-8083-8fab401e4775] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:12:00.911059971Z [2024-02-24 00:12:00,910: INFO/ForkPoolWorker-1] [af0c42a8-1104-4dab-84a0-bf4a77b05a60] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:12:01.241948649Z [2024-02-24 00:12:01,231: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:12:01.280728504Z [2024-02-24 00:12:01,276: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:12:01.337840360Z [2024-02-24 00:12:01,330: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:12:01.399031178Z [2024-02-24 00:12:01,394: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:12:01.608516603Z [2024-02-24 00:12:01,608: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:12:01.608715832Z [2024-02-24 00:12:01,608: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:12:01.612484866Z [2024-02-24 00:12:01,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:12:01.643448968Z [2024-02-24 00:12:01,643: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:12:01.644635816Z [2024-02-24 00:12:01,644: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:12:01.647966432Z [2024-02-24 00:12:01,647: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:12:01.648013962Z [2024-02-24 00:12:01,647: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:12:01.648260945Z [2024-02-24 00:12:01,648: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:12:01.821937078Z [2024-02-24 00:12:01,821: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:12:02.447658938Z [2024-02-24 00:12:02,447: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6c4ec8b-39eb-4c3a-af42-7d8b557442a9] succeeded in 1.55482805299971s: None
2024-02-24T00:12:02.667891134Z [2024-02-24 00:12:02,666: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d97a098-4b25-483f-96a6-d13e32a14fa2] succeeded in 1.7776549390000582s: None
2024-02-24T00:12:02.875775853Z [2024-02-24 00:12:02,875: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:12:02.879083715Z [2024-02-24 00:12:02,878: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:12:02.901322127Z [2024-02-24 00:12:02,901: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:12:02.903247437Z [2024-02-24 00:12:02,902: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:12:02.903398676Z [2024-02-24 00:12:02,903: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:12:02.903620434Z [2024-02-24 00:12:02,903: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:12:02.903725421Z [2024-02-24 00:12:02,903: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:12:02.904068234Z [2024-02-24 00:12:02,903: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:12:02.904151649Z [2024-02-24 00:12:02,904: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:12:03.007781002Z [2024-02-24 00:12:03,007: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:12:03.011102810Z [2024-02-24 00:12:03,010: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:12:03.014876714Z [2024-02-24 00:12:03,014: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:12:03.043792692Z [2024-02-24 00:12:03,043: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:12:03.044984111Z [2024-02-24 00:12:03,044: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:12:03.045086034Z [2024-02-24 00:12:03,044: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:12:03.045251166Z [2024-02-24 00:12:03,045: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:12:03.045275647Z [2024-02-24 00:12:03,045: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:12:03.045592927Z [2024-02-24 00:12:03,045: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:12:03.045612304Z [2024-02-24 00:12:03,045: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:12:03.154218550Z [2024-02-24 00:12:03,153: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:12:04.714687324Z [2024-02-24 00:12:04,714: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f9493df-0e96-404f-8083-8fab401e4775] succeeded in 3.8136634689999482s: None
2024-02-24T00:12:06.359006771Z [2024-02-24 00:12:06,358: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[af0c42a8-1104-4dab-84a0-bf4a77b05a60] succeeded in 5.462862820999817s: None
2024-02-24T00:13:00.798608918Z [2024-02-24 00:13:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2dcd62d0-fa54-4ad0-ba2d-d334ca837a13] received
2024-02-24T00:13:00.804818163Z [2024-02-24 00:13:00,804: INFO/ForkPoolWorker-15] [2dcd62d0-fa54-4ad0-ba2d-d334ca837a13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:13:00.815930802Z [2024-02-24 00:13:00,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff671cf0-3c07-417f-b722-4244bd668527] received
2024-02-24T00:13:00.820967465Z [2024-02-24 00:13:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5ee4c5a-55db-43d1-a31c-5ac2d1b52f19] received
2024-02-24T00:13:00.824336090Z [2024-02-24 00:13:00,824: INFO/ForkPoolWorker-16] [ff671cf0-3c07-417f-b722-4244bd668527] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:13:00.835530261Z [2024-02-24 00:13:00,835: INFO/ForkPoolWorker-1] [f5ee4c5a-55db-43d1-a31c-5ac2d1b52f19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:13:01.179696892Z [2024-02-24 00:13:01,176: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:13:01.187584852Z [2024-02-24 00:13:01,182: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:13:01.203072273Z [2024-02-24 00:13:01,199: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:13:01.378510696Z [2024-02-24 00:13:01,377: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:13:01.382433169Z [2024-02-24 00:13:01,382: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:13:01.406086858Z [2024-02-24 00:13:01,405: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:13:01.410818743Z [2024-02-24 00:13:01,410: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:13:01.411001489Z [2024-02-24 00:13:01,410: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:13:01.411169069Z [2024-02-24 00:13:01,410: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:13:01.411611208Z [2024-02-24 00:13:01,411: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:13:01.535466799Z [2024-02-24 00:13:01,535: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:13:02.203614091Z [2024-02-24 00:13:02,203: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff671cf0-3c07-417f-b722-4244bd668527] succeeded in 1.3862785019996409s: None
2024-02-24T00:13:02.497416636Z [2024-02-24 00:13:02,496: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:13:02.501164230Z [2024-02-24 00:13:02,500: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:13:02.518040325Z [2024-02-24 00:13:02,514: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:13:02.518083756Z [2024-02-24 00:13:02,517: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:13:02.531439848Z [2024-02-24 00:13:02,531: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:13:02.533650963Z [2024-02-24 00:13:02,533: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:13:02.533730383Z [2024-02-24 00:13:02,533: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:13:02.533800201Z [2024-02-24 00:13:02,533: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:13:02.533884218Z [2024-02-24 00:13:02,533: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:13:02.534118861Z [2024-02-24 00:13:02,533: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:13:02.534169717Z [2024-02-24 00:13:02,534: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:13:02.543844816Z [2024-02-24 00:13:02,543: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:13:02.545520223Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:13:02.545541367Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:13:02.545624645Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:13:02.545649074Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:13:02.546027352Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:13:02.546033114Z [2024-02-24 00:13:02,545: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:13:02.627018658Z [2024-02-24 00:13:02,625: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:13:02.644253045Z [2024-02-24 00:13:02,643: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:13:04.386527478Z [2024-02-24 00:13:04,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2dcd62d0-fa54-4ad0-ba2d-d334ca837a13] succeeded in 3.5865317019997747s: None
2024-02-24T00:13:05.021155110Z [2024-02-24 00:13:05,020: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f5ee4c5a-55db-43d1-a31c-5ac2d1b52f19] succeeded in 4.198062929999651s: None
2024-02-24T00:14:00.299179028Z [2024-02-24 00:14:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f16b4eb5-8b6c-4dfb-9398-cea140e83df0] received
2024-02-24T00:14:00.304575290Z [2024-02-24 00:14:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00000b2c-ad90-4e76-ab90-0ae766e72b1e] received
2024-02-24T00:14:00.308797693Z [2024-02-24 00:14:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[086d9240-dbd4-43ba-ae28-c90f6cbbe0b2] received
2024-02-24T00:14:00.311912291Z [2024-02-24 00:14:00,311: INFO/ForkPoolWorker-15] [f16b4eb5-8b6c-4dfb-9398-cea140e83df0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:14:00.316155368Z [2024-02-24 00:14:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c1779b9-a415-43bc-a79a-161b94025618] received
2024-02-24T00:14:00.317167384Z [2024-02-24 00:14:00,316: INFO/ForkPoolWorker-1] [086d9240-dbd4-43ba-ae28-c90f6cbbe0b2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:14:00.319297713Z [2024-02-24 00:14:00,319: INFO/ForkPoolWorker-16] [00000b2c-ad90-4e76-ab90-0ae766e72b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:14:00.336663130Z [2024-02-24 00:14:00,336: INFO/ForkPoolWorker-2] [1c1779b9-a415-43bc-a79a-161b94025618] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:14:00.633310311Z [2024-02-24 00:14:00,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:14:00.633601432Z [2024-02-24 00:14:00,629: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:14:00.718795816Z [2024-02-24 00:14:00,715: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:14:00.750665768Z [2024-02-24 00:14:00,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:14:00.897148274Z [2024-02-24 00:14:00,894: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:14:00.899282231Z [2024-02-24 00:14:00,898: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:14:00.904925000Z [2024-02-24 00:14:00,904: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:14:00.951584649Z [2024-02-24 00:14:00,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:14:00.952632639Z [2024-02-24 00:14:00,952: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:14:00.952835176Z [2024-02-24 00:14:00,952: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:14:00.952984250Z [2024-02-24 00:14:00,952: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:14:00.953259892Z [2024-02-24 00:14:00,953: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:14:01.066771579Z [2024-02-24 00:14:01,066: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:14:01.534825016Z [2024-02-24 00:14:01,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f16b4eb5-8b6c-4dfb-9398-cea140e83df0] succeeded in 1.2333594960000482s: None
2024-02-24T00:14:01.779213533Z [2024-02-24 00:14:01,778: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[086d9240-dbd4-43ba-ae28-c90f6cbbe0b2] succeeded in 1.4683656689999225s: None
2024-02-24T00:14:01.980423981Z [2024-02-24 00:14:01,980: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:14:01.983949666Z [2024-02-24 00:14:01,983: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:14:02.007940569Z [2024-02-24 00:14:02,007: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:14:02.009210743Z [2024-02-24 00:14:02,008: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:14:02.009280274Z [2024-02-24 00:14:02,009: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:14:02.009465943Z [2024-02-24 00:14:02,009: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:14:02.009563940Z [2024-02-24 00:14:02,009: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:14:02.009942515Z [2024-02-24 00:14:02,009: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:14:02.010014853Z [2024-02-24 00:14:02,009: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:14:02.091825613Z [2024-02-24 00:14:02,091: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:14:02.189072606Z [2024-02-24 00:14:02,188: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:14:02.193521779Z [2024-02-24 00:14:02,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:14:02.230129860Z [2024-02-24 00:14:02,229: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:14:02.231628783Z [2024-02-24 00:14:02,231: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:14:02.231816714Z [2024-02-24 00:14:02,231: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:14:02.232003481Z [2024-02-24 00:14:02,231: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:14:02.232082611Z [2024-02-24 00:14:02,231: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:14:02.232424224Z [2024-02-24 00:14:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:14:02.232481955Z [2024-02-24 00:14:02,232: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:14:02.337049266Z [2024-02-24 00:14:02,336: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:14:03.973900112Z [2024-02-24 00:14:03,973: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c1779b9-a415-43bc-a79a-161b94025618] succeeded in 3.651172819000294s: None
2024-02-24T00:14:04.043231406Z [2024-02-24 00:14:04,042: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00000b2c-ad90-4e76-ab90-0ae766e72b1e] succeeded in 3.7366523699997742s: None
2024-02-24T00:15:00.256436370Z [2024-02-24 00:15:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[686a3bd8-2bff-46a8-889e-5c6560abc60e] received
2024-02-24T00:15:00.262213447Z [2024-02-24 00:15:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85d5a130-8084-4d01-bb39-b3cfeda47142] received
2024-02-24T00:15:00.275851617Z [2024-02-24 00:15:00,275: INFO/ForkPoolWorker-15] [686a3bd8-2bff-46a8-889e-5c6560abc60e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:15:00.276075254Z [2024-02-24 00:15:00,275: INFO/ForkPoolWorker-16] [85d5a130-8084-4d01-bb39-b3cfeda47142] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:15:00.286747773Z [2024-02-24 00:15:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad1d8c2d-acd4-47dd-8ff4-35926b06708c] received
2024-02-24T00:15:00.296247272Z [2024-02-24 00:15:00,295: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3be86a9-be97-4379-ba8e-3c7edaea8b0b] received
2024-02-24T00:15:00.302823867Z [2024-02-24 00:15:00,302: INFO/ForkPoolWorker-1] [ad1d8c2d-acd4-47dd-8ff4-35926b06708c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:15:00.303933653Z [2024-02-24 00:15:00,303: INFO/ForkPoolWorker-2] [e3be86a9-be97-4379-ba8e-3c7edaea8b0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:15:00.665564419Z [2024-02-24 00:15:00,662: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:15:00.700351088Z [2024-02-24 00:15:00,697: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:15:00.733184300Z [2024-02-24 00:15:00,728: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:15:00.862466535Z [2024-02-24 00:15:00,857: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:15:00.958897605Z [2024-02-24 00:15:00,958: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:15:00.964512439Z [2024-02-24 00:15:00,964: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:01.008244404Z [2024-02-24 00:15:01,008: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:15:01.015462328Z [2024-02-24 00:15:01,014: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:15:01.015904058Z [2024-02-24 00:15:01,015: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:15:01.016099012Z [2024-02-24 00:15:01,015: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:15:01.016489694Z [2024-02-24 00:15:01,016: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:15:01.129545402Z [2024-02-24 00:15:01,129: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:01.862241920Z [2024-02-24 00:15:01,861: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85d5a130-8084-4d01-bb39-b3cfeda47142] succeeded in 1.5974131359998864s: None
2024-02-24T00:15:02.058024041Z [2024-02-24 00:15:02,057: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:15:02.061677587Z [2024-02-24 00:15:02,061: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:02.086408776Z [2024-02-24 00:15:02,086: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:15:02.088015813Z [2024-02-24 00:15:02,087: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:02.088034057Z [2024-02-24 00:15:02,087: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:02.088195336Z [2024-02-24 00:15:02,087: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:02.088309896Z [2024-02-24 00:15:02,088: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:15:02.088942487Z [2024-02-24 00:15:02,088: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:15:02.088958364Z [2024-02-24 00:15:02,088: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:02.176361571Z [2024-02-24 00:15:02,175: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:15:02.179886139Z [2024-02-24 00:15:02,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:02.187815177Z [2024-02-24 00:15:02,187: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:02.205827722Z [2024-02-24 00:15:02,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:15:02.207866405Z [2024-02-24 00:15:02,207: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:02.208098573Z [2024-02-24 00:15:02,207: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:02.208346118Z [2024-02-24 00:15:02,208: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:02.208511940Z [2024-02-24 00:15:02,208: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:15:02.209083805Z [2024-02-24 00:15:02,208: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:15:02.209399245Z [2024-02-24 00:15:02,209: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:02.245317263Z [2024-02-24 00:15:02,244: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:15:02.251529863Z [2024-02-24 00:15:02,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:02.275780776Z [2024-02-24 00:15:02,275: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:15:02.277026689Z [2024-02-24 00:15:02,276: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:02.277045143Z [2024-02-24 00:15:02,276: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:02.277272929Z [2024-02-24 00:15:02,276: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:02.277406044Z [2024-02-24 00:15:02,277: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:15:02.277881969Z [2024-02-24 00:15:02,277: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:15:02.277900535Z [2024-02-24 00:15:02,277: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:02.302306087Z [2024-02-24 00:15:02,301: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:02.382090528Z [2024-02-24 00:15:02,379: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:03.061394964Z [2024-02-24 00:15:03,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[686a3bd8-2bff-46a8-889e-5c6560abc60e] succeeded in 2.7976841380000224s: None
2024-02-24T00:15:03.768078075Z [2024-02-24 00:15:03,763: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3be86a9-be97-4379-ba8e-3c7edaea8b0b] succeeded in 3.465109455000402s: None
2024-02-24T00:15:03.993464258Z [2024-02-24 00:15:03,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0379279d-6802-495b-8ae4-88caba666cd7] received
2024-02-24T00:15:04.006755375Z [2024-02-24 00:15:04,006: INFO/ForkPoolWorker-15] [0379279d-6802-495b-8ae4-88caba666cd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:15:04.322951492Z [2024-02-24 00:15:04,322: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ad1d8c2d-acd4-47dd-8ff4-35926b06708c] succeeded in 4.024662428999818s: None
2024-02-24T00:15:04.334195255Z [2024-02-24 00:15:04,331: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:15:05.450419073Z [2024-02-24 00:15:05,450: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:15:05.453742123Z [2024-02-24 00:15:05,453: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:05.470965507Z [2024-02-24 00:15:05,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:15:05.472294860Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:05.472394693Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:05.472532206Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:05.472630611Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:15:05.472884754Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:15:05.472948337Z [2024-02-24 00:15:05,472: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:05.554591718Z [2024-02-24 00:15:05,554: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:06.161572023Z [2024-02-24 00:15:06,161: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0379279d-6802-495b-8ae4-88caba666cd7] succeeded in 2.164963777000139s: None
2024-02-24T00:15:06.693720036Z [2024-02-24 00:15:06,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79b2f9a9-bc18-40d8-93ce-c100ae82aa94] received
2024-02-24T00:15:06.704846705Z [2024-02-24 00:15:06,704: INFO/ForkPoolWorker-15] [79b2f9a9-bc18-40d8-93ce-c100ae82aa94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:15:07.013858893Z [2024-02-24 00:15:07,010: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:15:08.128478012Z [2024-02-24 00:15:08,127: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:15:08.131686949Z [2024-02-24 00:15:08,131: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:08.153570440Z [2024-02-24 00:15:08,153: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:15:08.155007917Z [2024-02-24 00:15:08,154: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:08.155065470Z [2024-02-24 00:15:08,154: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:08.155283622Z [2024-02-24 00:15:08,155: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:08.155425567Z [2024-02-24 00:15:08,155: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:15:08.155755330Z [2024-02-24 00:15:08,155: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:15:08.155768660Z [2024-02-24 00:15:08,155: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:08.243961384Z [2024-02-24 00:15:08,243: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:08.778796370Z [2024-02-24 00:15:08,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79b2f9a9-bc18-40d8-93ce-c100ae82aa94] succeeded in 2.083313829999952s: None
2024-02-24T00:15:09.021204846Z [2024-02-24 00:15:09,020: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[712db18c-cafd-4b30-b31e-766137c673dc] received
2024-02-24T00:15:09.028632296Z [2024-02-24 00:15:09,028: INFO/ForkPoolWorker-15] [712db18c-cafd-4b30-b31e-766137c673dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:15:09.282883005Z [2024-02-24 00:15:09,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:15:10.373300408Z [2024-02-24 00:15:10,372: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:15:10.376644670Z [2024-02-24 00:15:10,376: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:15:10.400294442Z [2024-02-24 00:15:10,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:15:10.401954547Z [2024-02-24 00:15:10,401: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:15:10.401976000Z [2024-02-24 00:15:10,401: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:15:10.402166823Z [2024-02-24 00:15:10,401: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:15:10.402267812Z [2024-02-24 00:15:10,402: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:15:10.402622545Z [2024-02-24 00:15:10,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:15:10.402672674Z [2024-02-24 00:15:10,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:15:10.491586879Z [2024-02-24 00:15:10,491: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:15:11.013166257Z [2024-02-24 00:15:11,012: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[712db18c-cafd-4b30-b31e-766137c673dc] succeeded in 1.989666152999689s: None
2024-02-24T00:16:00.808360680Z [2024-02-24 00:16:00,808: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e85866a8-1f47-4ffe-9f9b-e9b9092d1f69] received
2024-02-24T00:16:00.816811617Z [2024-02-24 00:16:00,816: INFO/ForkPoolWorker-15] [e85866a8-1f47-4ffe-9f9b-e9b9092d1f69] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:16:00.818932719Z [2024-02-24 00:16:00,818: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4150870-23f0-41c3-bcd3-4ca3aba942bc] received
2024-02-24T00:16:00.821979495Z [2024-02-24 00:16:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3aff8eee-cd26-4e8c-98dc-655537cf83f6] received
2024-02-24T00:16:00.824722554Z [2024-02-24 00:16:00,824: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e14fff4f-19b9-4f20-9e59-a2922fe86566] received
2024-02-24T00:16:00.833824453Z [2024-02-24 00:16:00,833: INFO/ForkPoolWorker-2] [e14fff4f-19b9-4f20-9e59-a2922fe86566] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:16:00.834741022Z [2024-02-24 00:16:00,833: INFO/ForkPoolWorker-1] [3aff8eee-cd26-4e8c-98dc-655537cf83f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:16:00.835438121Z [2024-02-24 00:16:00,835: INFO/ForkPoolWorker-16] [b4150870-23f0-41c3-bcd3-4ca3aba942bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:16:01.478865666Z [2024-02-24 00:16:01,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:16:01.729104559Z [2024-02-24 00:16:01,721: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:16:01.759435960Z [2024-02-24 00:16:01,753: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:16:01.920020155Z [2024-02-24 00:16:01,904: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:16:01.951546660Z [2024-02-24 00:16:01,951: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:16:01.963398312Z [2024-02-24 00:16:01,962: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:16:02.099799611Z [2024-02-24 00:16:02,099: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:16:02.104560547Z [2024-02-24 00:16:02,104: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:16:02.104880245Z [2024-02-24 00:16:02,104: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:16:02.105061395Z [2024-02-24 00:16:02,104: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:16:02.105437060Z [2024-02-24 00:16:02,105: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:16:02.296471440Z [2024-02-24 00:16:02,296: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:16:02.405887167Z [2024-02-24 00:16:02,395: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:16:03.883205955Z [2024-02-24 00:16:03,882: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e85866a8-1f47-4ffe-9f9b-e9b9092d1f69] succeeded in 3.072206751000067s: None
2024-02-24T00:16:03.963079770Z [2024-02-24 00:16:03,962: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b4150870-23f0-41c3-bcd3-4ca3aba942bc] succeeded in 3.142028322999977s: None
2024-02-24T00:16:04.304884840Z [2024-02-24 00:16:04,304: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:16:04.310992483Z [2024-02-24 00:16:04,310: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:16:04.441909062Z [2024-02-24 00:16:04,441: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:16:04.450665199Z [2024-02-24 00:16:04,442: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:16:04.450695979Z [2024-02-24 00:16:04,442: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:16:04.450699575Z [2024-02-24 00:16:04,442: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:16:04.450702812Z [2024-02-24 00:16:04,442: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:16:04.450705841Z [2024-02-24 00:16:04,443: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:16:04.450708931Z [2024-02-24 00:16:04,443: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:16:04.580757176Z [2024-02-24 00:16:04,580: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:16:04.584982495Z [2024-02-24 00:16:04,584: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:16:04.637103506Z [2024-02-24 00:16:04,636: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:16:04.671617175Z [2024-02-24 00:16:04,671: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:16:04.675927392Z [2024-02-24 00:16:04,675: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:16:04.676034613Z [2024-02-24 00:16:04,675: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:16:04.676283289Z [2024-02-24 00:16:04,675: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:16:04.676414683Z [2024-02-24 00:16:04,676: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:16:04.676872822Z [2024-02-24 00:16:04,676: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:16:04.676998337Z [2024-02-24 00:16:04,676: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:16:04.843995576Z [2024-02-24 00:16:04,843: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:16:06.211897223Z [2024-02-24 00:16:06,211: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3aff8eee-cd26-4e8c-98dc-655537cf83f6] succeeded in 5.388125986999967s: None
2024-02-24T00:16:07.208209501Z [2024-02-24 00:16:07,207: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e14fff4f-19b9-4f20-9e59-a2922fe86566] succeeded in 6.380956421000064s: None
2024-02-24T00:17:00.922926317Z [2024-02-24 00:17:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[163d09a7-a1eb-4345-92d1-b13976c509a3] received
2024-02-24T00:17:00.934706843Z [2024-02-24 00:17:00,934: INFO/ForkPoolWorker-15] [163d09a7-a1eb-4345-92d1-b13976c509a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:17:00.937429616Z [2024-02-24 00:17:00,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[481ba2ea-29dc-4fb8-9104-4858fad0456f] received
2024-02-24T00:17:00.948455695Z [2024-02-24 00:17:00,948: INFO/ForkPoolWorker-16] [481ba2ea-29dc-4fb8-9104-4858fad0456f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:17:00.958509658Z [2024-02-24 00:17:00,958: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20264d20-2c5d-423f-b0ec-21386f9f402a] received
2024-02-24T00:17:00.966360283Z [2024-02-24 00:17:00,966: INFO/ForkPoolWorker-1] [20264d20-2c5d-423f-b0ec-21386f9f402a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:17:01.474355026Z [2024-02-24 00:17:01,470: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:17:01.519169850Z [2024-02-24 00:17:01,512: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:17:01.544757961Z [2024-02-24 00:17:01,540: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:17:01.801651755Z [2024-02-24 00:17:01,801: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:17:01.806164780Z [2024-02-24 00:17:01,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:17:01.841879413Z [2024-02-24 00:17:01,841: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:17:01.844532317Z [2024-02-24 00:17:01,844: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:17:01.844726354Z [2024-02-24 00:17:01,844: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:17:01.844863223Z [2024-02-24 00:17:01,844: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:17:01.845211745Z [2024-02-24 00:17:01,845: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:17:01.997501398Z [2024-02-24 00:17:01,997: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:17:02.668739901Z [2024-02-24 00:17:02,664: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[163d09a7-a1eb-4345-92d1-b13976c509a3] succeeded in 1.7396916409998084s: None
2024-02-24T00:17:02.842997324Z [2024-02-24 00:17:02,842: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:17:02.846460312Z [2024-02-24 00:17:02,846: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:17:02.914514583Z [2024-02-24 00:17:02,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:17:02.916265364Z [2024-02-24 00:17:02,915: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:17:02.917059821Z [2024-02-24 00:17:02,916: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:17:02.919213553Z [2024-02-24 00:17:02,918: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:17:02.919294607Z [2024-02-24 00:17:02,919: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:17:02.919647098Z [2024-02-24 00:17:02,919: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:17:02.920143017Z [2024-02-24 00:17:02,919: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:17:03.007019672Z [2024-02-24 00:17:03,006: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:17:03.291654862Z [2024-02-24 00:17:03,291: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:17:03.296135832Z [2024-02-24 00:17:03,295: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:17:03.340029216Z [2024-02-24 00:17:03,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:17:03.341995834Z [2024-02-24 00:17:03,341: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:17:03.342280564Z [2024-02-24 00:17:03,342: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:17:03.342606332Z [2024-02-24 00:17:03,342: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:17:03.342823288Z [2024-02-24 00:17:03,342: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:17:03.343360186Z [2024-02-24 00:17:03,343: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:17:03.343630230Z [2024-02-24 00:17:03,343: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:17:03.446651136Z [2024-02-24 00:17:03,446: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:17:05.293510484Z [2024-02-24 00:17:05,293: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[20264d20-2c5d-423f-b0ec-21386f9f402a] succeeded in 4.333159075999902s: None
2024-02-24T00:17:05.310715800Z [2024-02-24 00:17:05,310: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[481ba2ea-29dc-4fb8-9104-4858fad0456f] succeeded in 4.371060982000017s: None
2024-02-24T00:18:01.119113480Z [2024-02-24 00:18:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ebee02-31bb-47ae-8474-1b1925ffa2c3] received
2024-02-24T00:18:01.127279139Z [2024-02-24 00:18:01,126: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa730b07-e713-49df-bf55-b360c2c5f07b] received
2024-02-24T00:18:01.131900676Z [2024-02-24 00:18:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60f7fa3a-1397-469c-8a43-71540283b9f1] received
2024-02-24T00:18:01.137887880Z [2024-02-24 00:18:01,137: INFO/ForkPoolWorker-15] [c4ebee02-31bb-47ae-8474-1b1925ffa2c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:18:01.140486216Z [2024-02-24 00:18:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8c72414-4ac8-4cd5-bb7c-8b60c88b2449] received
2024-02-24T00:18:01.143200786Z [2024-02-24 00:18:01,142: INFO/ForkPoolWorker-16] [fa730b07-e713-49df-bf55-b360c2c5f07b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:18:01.146571051Z [2024-02-24 00:18:01,146: INFO/ForkPoolWorker-1] [60f7fa3a-1397-469c-8a43-71540283b9f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:18:01.151621566Z [2024-02-24 00:18:01,151: INFO/ForkPoolWorker-2] [b8c72414-4ac8-4cd5-bb7c-8b60c88b2449] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:18:01.496201495Z [2024-02-24 00:18:01,492: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:18:01.552831981Z [2024-02-24 00:18:01,549: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:18:01.592895714Z [2024-02-24 00:18:01,589: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:18:01.680812710Z [2024-02-24 00:18:01,676: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:18:01.798453329Z [2024-02-24 00:18:01,797: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:18:01.868145128Z [2024-02-24 00:18:01,867: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:18:01.873835830Z [2024-02-24 00:18:01,873: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:18:01.897364510Z [2024-02-24 00:18:01,897: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:18:01.899162280Z [2024-02-24 00:18:01,898: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:18:01.899419523Z [2024-02-24 00:18:01,899: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:18:01.899579441Z [2024-02-24 00:18:01,899: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:18:01.899981811Z [2024-02-24 00:18:01,899: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:18:02.069757705Z [2024-02-24 00:18:02,069: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:18:02.579250885Z [2024-02-24 00:18:02,578: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4ebee02-31bb-47ae-8474-1b1925ffa2c3] succeeded in 1.4505506649998097s: None
2024-02-24T00:18:02.788307825Z [2024-02-24 00:18:02,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fa730b07-e713-49df-bf55-b360c2c5f07b] succeeded in 1.6563482790002126s: None
2024-02-24T00:18:03.183927370Z [2024-02-24 00:18:03,183: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:18:03.187262637Z [2024-02-24 00:18:03,186: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:18:03.219001587Z [2024-02-24 00:18:03,218: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:18:03.223127767Z [2024-02-24 00:18:03,222: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:18:03.223297232Z [2024-02-24 00:18:03,223: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:18:03.223568259Z [2024-02-24 00:18:03,223: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:18:03.223824727Z [2024-02-24 00:18:03,223: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:18:03.224276501Z [2024-02-24 00:18:03,224: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:18:03.224454396Z [2024-02-24 00:18:03,224: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:18:03.227714173Z [2024-02-24 00:18:03,227: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:18:03.231028961Z [2024-02-24 00:18:03,230: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:18:03.262016318Z [2024-02-24 00:18:03,261: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:18:03.263663550Z [2024-02-24 00:18:03,263: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:18:03.263700529Z [2024-02-24 00:18:03,263: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:18:03.263871340Z [2024-02-24 00:18:03,263: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:18:03.263936497Z [2024-02-24 00:18:03,263: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:18:03.264360373Z [2024-02-24 00:18:03,264: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:18:03.264443943Z [2024-02-24 00:18:03,264: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:18:03.311046130Z [2024-02-24 00:18:03,310: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:18:03.363847694Z [2024-02-24 00:18:03,363: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:18:05.582990942Z [2024-02-24 00:18:05,582: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[60f7fa3a-1397-469c-8a43-71540283b9f1] succeeded in 4.4452819319999435s: None
2024-02-24T00:18:06.253613893Z [2024-02-24 00:18:06,253: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b8c72414-4ac8-4cd5-bb7c-8b60c88b2449] succeeded in 5.110719918000086s: None
2024-02-24T00:19:00.168865609Z [2024-02-24 00:19:00,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd7df7b9-fdc0-4b13-90e0-edcb66046bc4] received
2024-02-24T00:19:00.172085349Z [2024-02-24 00:19:00,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bd8de86d-cd35-4d69-8b33-4883464eb459] received
2024-02-24T00:19:00.174095681Z [2024-02-24 00:19:00,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff8f3fe-7955-493d-ac08-c6dca84c49e9] received
2024-02-24T00:19:00.185654579Z [2024-02-24 00:19:00,185: INFO/ForkPoolWorker-16] [bd8de86d-cd35-4d69-8b33-4883464eb459] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:19:00.189108256Z [2024-02-24 00:19:00,188: INFO/ForkPoolWorker-15] [fd7df7b9-fdc0-4b13-90e0-edcb66046bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:19:00.189419814Z [2024-02-24 00:19:00,189: INFO/ForkPoolWorker-1] [7ff8f3fe-7955-493d-ac08-c6dca84c49e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:19:00.479955261Z [2024-02-24 00:19:00,476: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:19:00.493682305Z [2024-02-24 00:19:00,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:19:00.597301225Z [2024-02-24 00:19:00,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:19:00.650062215Z [2024-02-24 00:19:00,649: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:19:00.655482179Z [2024-02-24 00:19:00,654: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:19:00.681679107Z [2024-02-24 00:19:00,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:19:00.683869473Z [2024-02-24 00:19:00,683: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:19:00.684150580Z [2024-02-24 00:19:00,683: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:19:00.684255007Z [2024-02-24 00:19:00,684: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:19:00.684591193Z [2024-02-24 00:19:00,684: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:19:00.777577320Z [2024-02-24 00:19:00,777: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:19:01.535810417Z [2024-02-24 00:19:01,535: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd7df7b9-fdc0-4b13-90e0-edcb66046bc4] succeeded in 1.360315965999689s: None
2024-02-24T00:19:01.777540324Z [2024-02-24 00:19:01,777: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:19:01.781109897Z [2024-02-24 00:19:01,780: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:19:01.803007457Z [2024-02-24 00:19:01,802: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:19:01.804402935Z [2024-02-24 00:19:01,804: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:19:01.804540184Z [2024-02-24 00:19:01,804: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:19:01.804733880Z [2024-02-24 00:19:01,804: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:19:01.804906182Z [2024-02-24 00:19:01,804: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:19:01.805314846Z [2024-02-24 00:19:01,805: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:19:01.805443778Z [2024-02-24 00:19:01,805: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:19:01.906405556Z [2024-02-24 00:19:01,906: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:19:02.133627076Z [2024-02-24 00:19:02,133: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:19:02.137566919Z [2024-02-24 00:19:02,137: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:19:02.169571952Z [2024-02-24 00:19:02,169: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:19:02.171681626Z [2024-02-24 00:19:02,171: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:19:02.172009191Z [2024-02-24 00:19:02,171: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:19:02.172321526Z [2024-02-24 00:19:02,172: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:19:02.172527087Z [2024-02-24 00:19:02,172: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:19:02.173170277Z [2024-02-24 00:19:02,172: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:19:02.173409177Z [2024-02-24 00:19:02,173: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:19:02.270148029Z [2024-02-24 00:19:02,269: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:19:03.480466484Z [2024-02-24 00:19:03,480: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bd8de86d-cd35-4d69-8b33-4883464eb459] succeeded in 3.3062677719999556s: None
2024-02-24T00:19:04.846652753Z [2024-02-24 00:19:04,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ff8f3fe-7955-493d-ac08-c6dca84c49e9] succeeded in 4.668856888999926s: None
2024-02-24T00:20:00.558287417Z [2024-02-24 00:20:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bd16d20-34b4-45d9-8c40-82b76f476e29] received
2024-02-24T00:20:00.560549736Z [2024-02-24 00:20:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1cf57df-2eed-4d95-aff2-b398fe7a7af7] received
2024-02-24T00:20:00.563950703Z [2024-02-24 00:20:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d2803106-41d5-4b0c-9fd5-fe1a03ea4366] received
2024-02-24T00:20:00.571730361Z [2024-02-24 00:20:00,571: INFO/ForkPoolWorker-1] [d2803106-41d5-4b0c-9fd5-fe1a03ea4366] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:20:00.572767522Z [2024-02-24 00:20:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7aa5a67a-25ff-4023-8706-2693c15a2ee0] received
2024-02-24T00:20:00.573060389Z [2024-02-24 00:20:00,572: INFO/ForkPoolWorker-16] [b1cf57df-2eed-4d95-aff2-b398fe7a7af7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:20:00.578644513Z [2024-02-24 00:20:00,578: INFO/ForkPoolWorker-15] [4bd16d20-34b4-45d9-8c40-82b76f476e29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:20:00.593205703Z [2024-02-24 00:20:00,592: INFO/ForkPoolWorker-2] [7aa5a67a-25ff-4023-8706-2693c15a2ee0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:20:00.598280191Z [2024-02-24 00:20:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[296cd8db-c937-4512-b1d0-5be535f140eb] received
2024-02-24T00:20:00.631569908Z [2024-02-24 00:20:00,630: INFO/ForkPoolWorker-3] [296cd8db-c937-4512-b1d0-5be535f140eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:20:00.971823007Z [2024-02-24 00:20:00,968: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:20:01.001869363Z [2024-02-24 00:20:00,997: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:20:01.092963231Z [2024-02-24 00:20:01,084: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:20:01.114691940Z [2024-02-24 00:20:01,109: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:20:01.314951982Z [2024-02-24 00:20:01,303: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:20:01.399090748Z [2024-02-24 00:20:01,398: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:01.530963160Z [2024-02-24 00:20:01,530: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T00:20:01.535267432Z [2024-02-24 00:20:01,534: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:01.563335230Z [2024-02-24 00:20:01,563: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:20:01.565914063Z [2024-02-24 00:20:01,565: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:20:01.566630959Z [2024-02-24 00:20:01,566: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:20:01.566960491Z [2024-02-24 00:20:01,566: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T00:20:01.567473943Z [2024-02-24 00:20:01,567: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:20:01.696993996Z [2024-02-24 00:20:01,696: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:02.045693919Z [2024-02-24 00:20:02,045: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1cf57df-2eed-4d95-aff2-b398fe7a7af7] succeeded in 1.482677977000094s: None
2024-02-24T00:20:02.468389132Z [2024-02-24 00:20:02,467: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[296cd8db-c937-4512-b1d0-5be535f140eb] succeeded in 1.8612450929999795s: None
2024-02-24T00:20:02.986395839Z [2024-02-24 00:20:02,985: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:20:02.994535349Z [2024-02-24 00:20:02,994: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:03.055940629Z [2024-02-24 00:20:03,055: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:20:03.057327662Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:03.057357592Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:03.057558988Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:03.057685334Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:20:03.058037154Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:20:03.058066811Z [2024-02-24 00:20:03,057: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:03.096881298Z [2024-02-24 00:20:03,096: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:20:03.103354260Z [2024-02-24 00:20:03,102: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:03.140325344Z [2024-02-24 00:20:03,139: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:20:03.144448796Z [2024-02-24 00:20:03,144: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:03.144753862Z [2024-02-24 00:20:03,144: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:03.144940871Z [2024-02-24 00:20:03,144: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:03.145018792Z [2024-02-24 00:20:03,144: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:20:03.145503553Z [2024-02-24 00:20:03,145: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:20:03.145557177Z [2024-02-24 00:20:03,145: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:03.169293197Z [2024-02-24 00:20:03,168: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:03.180079329Z [2024-02-24 00:20:03,179: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:20:03.186185478Z [2024-02-24 00:20:03,185: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:03.246998175Z [2024-02-24 00:20:03,246: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:20:03.252173306Z [2024-02-24 00:20:03,251: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:03.252330253Z [2024-02-24 00:20:03,252: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:03.252510053Z [2024-02-24 00:20:03,252: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:03.252549951Z [2024-02-24 00:20:03,252: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:20:03.252846575Z [2024-02-24 00:20:03,252: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:20:03.252913152Z [2024-02-24 00:20:03,252: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:03.356395129Z [2024-02-24 00:20:03,356: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:03.390197354Z [2024-02-24 00:20:03,389: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:04.153794167Z [2024-02-24 00:20:04,153: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4bd16d20-34b4-45d9-8c40-82b76f476e29] succeeded in 3.591079398000147s: None
2024-02-24T00:20:04.411204465Z [2024-02-24 00:20:04,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bc8cee3-7364-4797-9c16-e3a396bbcd39] received
2024-02-24T00:20:04.420559911Z [2024-02-24 00:20:04,420: INFO/ForkPoolWorker-15] [5bc8cee3-7364-4797-9c16-e3a396bbcd39] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:20:04.738426648Z [2024-02-24 00:20:04,735: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:20:05.275745337Z [2024-02-24 00:20:05,275: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7aa5a67a-25ff-4023-8706-2693c15a2ee0] succeeded in 4.700305990000288s: None
2024-02-24T00:20:05.984896668Z [2024-02-24 00:20:05,984: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:20:05.988409624Z [2024-02-24 00:20:05,987: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:06.016146845Z [2024-02-24 00:20:06,015: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:20:06.017537428Z [2024-02-24 00:20:06,017: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:06.017725827Z [2024-02-24 00:20:06,017: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:06.017919823Z [2024-02-24 00:20:06,017: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:06.018013580Z [2024-02-24 00:20:06,017: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:20:06.018259088Z [2024-02-24 00:20:06,018: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:20:06.018717787Z [2024-02-24 00:20:06,018: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:06.093901965Z [2024-02-24 00:20:06,093: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d2803106-41d5-4b0c-9fd5-fe1a03ea4366] succeeded in 5.528301984999871s: None
2024-02-24T00:20:06.110835229Z [2024-02-24 00:20:06,110: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:06.899958178Z [2024-02-24 00:20:06,899: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bc8cee3-7364-4797-9c16-e3a396bbcd39] succeeded in 2.4863456369998858s: None
2024-02-24T00:20:06.922468430Z [2024-02-24 00:20:06,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31525931-ee52-4d1e-9eed-9d65b114e597] received
2024-02-24T00:20:06.939218576Z [2024-02-24 00:20:06,938: INFO/ForkPoolWorker-15] [31525931-ee52-4d1e-9eed-9d65b114e597] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:20:07.206011184Z [2024-02-24 00:20:07,202: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:20:08.295641810Z [2024-02-24 00:20:08,295: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:20:08.299023765Z [2024-02-24 00:20:08,298: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:08.316737130Z [2024-02-24 00:20:08,316: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:20:08.318382659Z [2024-02-24 00:20:08,318: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:08.318399508Z [2024-02-24 00:20:08,318: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:08.318658331Z [2024-02-24 00:20:08,318: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:08.318671363Z [2024-02-24 00:20:08,318: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:20:08.319255237Z [2024-02-24 00:20:08,318: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:20:08.319268015Z [2024-02-24 00:20:08,319: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:08.408093403Z [2024-02-24 00:20:08,407: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:09.049626274Z [2024-02-24 00:20:09,048: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[31525931-ee52-4d1e-9eed-9d65b114e597] succeeded in 2.124279908999597s: None
2024-02-24T00:20:09.327695839Z [2024-02-24 00:20:09,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6f40d9b-0ea9-4872-875b-8b4c551ac3df] received
2024-02-24T00:20:09.342270529Z [2024-02-24 00:20:09,341: INFO/ForkPoolWorker-15] [b6f40d9b-0ea9-4872-875b-8b4c551ac3df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:20:09.679645740Z [2024-02-24 00:20:09,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:20:10.880668816Z [2024-02-24 00:20:10,880: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:20:10.884338462Z [2024-02-24 00:20:10,883: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:20:10.909012613Z [2024-02-24 00:20:10,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:20:10.910873204Z [2024-02-24 00:20:10,910: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:20:10.910978066Z [2024-02-24 00:20:10,910: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:20:10.911373243Z [2024-02-24 00:20:10,911: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:20:10.911481502Z [2024-02-24 00:20:10,911: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:20:10.912333355Z [2024-02-24 00:20:10,912: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:20:10.912502191Z [2024-02-24 00:20:10,912: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:20:11.006582656Z [2024-02-24 00:20:11,006: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:20:11.648742885Z [2024-02-24 00:20:11,648: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6f40d9b-0ea9-4872-875b-8b4c551ac3df] succeeded in 2.3167494839999563s: None
2024-02-24T00:21:00.786749564Z [2024-02-24 00:21:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbcf1534-2dbb-4e13-8be6-c31393552026] received
2024-02-24T00:21:00.799644380Z [2024-02-24 00:21:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4362caeb-d6d7-4f3c-94c0-7c5bae839f14] received
2024-02-24T00:21:00.800361128Z [2024-02-24 00:21:00,800: INFO/ForkPoolWorker-15] [cbcf1534-2dbb-4e13-8be6-c31393552026] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:21:00.804109822Z [2024-02-24 00:21:00,803: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42a75c19-6e0b-4c25-80e4-433ac92d02b6] received
2024-02-24T00:21:00.809390153Z [2024-02-24 00:21:00,809: INFO/ForkPoolWorker-16] [4362caeb-d6d7-4f3c-94c0-7c5bae839f14] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:21:00.811609716Z [2024-02-24 00:21:00,811: INFO/ForkPoolWorker-1] [42a75c19-6e0b-4c25-80e4-433ac92d02b6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:21:01.143136243Z [2024-02-24 00:21:01,139: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:21:01.203260289Z [2024-02-24 00:21:01,199: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:21:01.327799447Z [2024-02-24 00:21:01,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:21:01.497897387Z [2024-02-24 00:21:01,497: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:21:01.501975904Z [2024-02-24 00:21:01,501: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:21:01.525079569Z [2024-02-24 00:21:01,524: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:21:01.526367846Z [2024-02-24 00:21:01,526: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:21:01.526427027Z [2024-02-24 00:21:01,526: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:21:01.526545551Z [2024-02-24 00:21:01,526: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:21:01.526811907Z [2024-02-24 00:21:01,526: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:21:01.633522181Z [2024-02-24 00:21:01,633: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:21:02.321079537Z [2024-02-24 00:21:02,320: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbcf1534-2dbb-4e13-8be6-c31393552026] succeeded in 1.5318140750000566s: None
2024-02-24T00:21:02.544587371Z [2024-02-24 00:21:02,543: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:21:02.548179595Z [2024-02-24 00:21:02,547: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:21:02.572828671Z [2024-02-24 00:21:02,572: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:21:02.574921359Z [2024-02-24 00:21:02,574: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:21:02.575089678Z [2024-02-24 00:21:02,574: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:21:02.575297362Z [2024-02-24 00:21:02,575: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:21:02.575395116Z [2024-02-24 00:21:02,575: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:21:02.575838308Z [2024-02-24 00:21:02,575: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:21:02.575845385Z [2024-02-24 00:21:02,575: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:21:02.590941464Z [2024-02-24 00:21:02,590: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:21:02.594424638Z [2024-02-24 00:21:02,593: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:21:02.619170473Z [2024-02-24 00:21:02,618: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:21:02.620801447Z [2024-02-24 00:21:02,620: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:21:02.620872776Z [2024-02-24 00:21:02,620: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:21:02.621020343Z [2024-02-24 00:21:02,620: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:21:02.621044745Z [2024-02-24 00:21:02,620: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:21:02.621995946Z [2024-02-24 00:21:02,621: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:21:02.622009694Z [2024-02-24 00:21:02,621: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:21:02.702108067Z [2024-02-24 00:21:02,701: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:21:02.790345652Z [2024-02-24 00:21:02,790: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:21:05.119901632Z [2024-02-24 00:21:05,119: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[42a75c19-6e0b-4c25-80e4-433ac92d02b6] succeeded in 4.314060057000006s: None
2024-02-24T00:21:05.660290255Z [2024-02-24 00:21:05,659: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4362caeb-d6d7-4f3c-94c0-7c5bae839f14] succeeded in 4.857704426000055s: None
2024-02-24T00:22:01.079792444Z [2024-02-24 00:22:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5168d665-72d4-4030-ab0f-0f9052b3eab4] received
2024-02-24T00:22:01.083103620Z [2024-02-24 00:22:01,082: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c952b209-e96d-4b4d-ae1c-2461e8c7875c] received
2024-02-24T00:22:01.093246352Z [2024-02-24 00:22:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe573c35-8bd9-4e56-ba89-b96bc779539f] received
2024-02-24T00:22:01.098962518Z [2024-02-24 00:22:01,098: INFO/ForkPoolWorker-15] [5168d665-72d4-4030-ab0f-0f9052b3eab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:22:01.099414657Z [2024-02-24 00:22:01,096: INFO/ForkPoolWorker-16] [c952b209-e96d-4b4d-ae1c-2461e8c7875c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:22:01.103376124Z [2024-02-24 00:22:01,103: INFO/ForkPoolWorker-1] [fe573c35-8bd9-4e56-ba89-b96bc779539f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:22:01.107014759Z [2024-02-24 00:22:01,106: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d302694b-2f8b-44e8-b0de-537951060c79] received
2024-02-24T00:22:01.126160519Z [2024-02-24 00:22:01,125: INFO/ForkPoolWorker-2] [d302694b-2f8b-44e8-b0de-537951060c79] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:22:01.627876683Z [2024-02-24 00:22:01,624: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:22:01.664817033Z [2024-02-24 00:22:01,661: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:22:01.683676692Z [2024-02-24 00:22:01,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:22:01.693452449Z [2024-02-24 00:22:01,690: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:22:01.881318838Z [2024-02-24 00:22:01,880: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T00:22:01.886204971Z [2024-02-24 00:22:01,885: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:22:01.918453358Z [2024-02-24 00:22:01,918: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:22:01.919846307Z [2024-02-24 00:22:01,919: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:22:01.920068947Z [2024-02-24 00:22:01,919: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:22:01.920217456Z [2024-02-24 00:22:01,920: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T00:22:01.920505687Z [2024-02-24 00:22:01,920: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:22:01.948120810Z [2024-02-24 00:22:01,947: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:22:02.080708806Z [2024-02-24 00:22:02,080: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:22:02.624264178Z [2024-02-24 00:22:02,623: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5168d665-72d4-4030-ab0f-0f9052b3eab4] succeeded in 1.5398198000002594s: None
2024-02-24T00:22:02.937543635Z [2024-02-24 00:22:02,937: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d302694b-2f8b-44e8-b0de-537951060c79] succeeded in 1.8273841579998589s: None
2024-02-24T00:22:03.183776340Z [2024-02-24 00:22:03,183: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:22:03.187150221Z [2024-02-24 00:22:03,186: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:22:03.187475223Z [2024-02-24 00:22:03,187: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:22:03.190924027Z [2024-02-24 00:22:03,190: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:22:03.221649417Z [2024-02-24 00:22:03,221: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:22:03.223346969Z [2024-02-24 00:22:03,223: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:22:03.223434141Z [2024-02-24 00:22:03,223: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:22:03.223667946Z [2024-02-24 00:22:03,223: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:22:03.223715760Z [2024-02-24 00:22:03,223: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:22:03.224170637Z [2024-02-24 00:22:03,223: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:22:03.224250346Z [2024-02-24 00:22:03,224: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:22:03.225720132Z [2024-02-24 00:22:03,225: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:22:03.227587044Z [2024-02-24 00:22:03,227: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:22:03.227792146Z [2024-02-24 00:22:03,227: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:22:03.228028378Z [2024-02-24 00:22:03,227: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:22:03.228194165Z [2024-02-24 00:22:03,228: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:22:03.228663175Z [2024-02-24 00:22:03,228: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:22:03.228817184Z [2024-02-24 00:22:03,228: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:22:03.329429942Z [2024-02-24 00:22:03,329: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:22:03.334502122Z [2024-02-24 00:22:03,334: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:22:05.051505057Z [2024-02-24 00:22:05,051: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c952b209-e96d-4b4d-ae1c-2461e8c7875c] succeeded in 3.9658285569998952s: None
2024-02-24T00:22:05.314073791Z [2024-02-24 00:22:05,313: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe573c35-8bd9-4e56-ba89-b96bc779539f] succeeded in 4.21845152700007s: None
2024-02-24T00:23:00.950202442Z [2024-02-24 00:23:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9532231f-4eaf-450e-a266-d717ca5262fc] received
2024-02-24T00:23:00.957531876Z [2024-02-24 00:23:00,957: INFO/ForkPoolWorker-15] [9532231f-4eaf-450e-a266-d717ca5262fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:23:00.968114172Z [2024-02-24 00:23:00,967: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[167fa109-57bc-439e-8794-a5d1e65c0f29] received
2024-02-24T00:23:00.979785361Z [2024-02-24 00:23:00,979: INFO/ForkPoolWorker-16] [167fa109-57bc-439e-8794-a5d1e65c0f29] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:23:00.984423788Z [2024-02-24 00:23:00,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[649e3a0b-65f4-44da-9ae6-f9c72f9d964b] received
2024-02-24T00:23:00.994578597Z [2024-02-24 00:23:00,994: INFO/ForkPoolWorker-1] [649e3a0b-65f4-44da-9ae6-f9c72f9d964b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:23:01.319159734Z [2024-02-24 00:23:01,315: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:23:01.343691871Z [2024-02-24 00:23:01,340: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:23:01.411741487Z [2024-02-24 00:23:01,404: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:23:01.651776957Z [2024-02-24 00:23:01,651: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:23:01.656241242Z [2024-02-24 00:23:01,655: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:23:01.682698697Z [2024-02-24 00:23:01,682: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:23:01.683938280Z [2024-02-24 00:23:01,683: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:23:01.684100862Z [2024-02-24 00:23:01,683: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:23:01.684293815Z [2024-02-24 00:23:01,684: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:23:01.684633472Z [2024-02-24 00:23:01,684: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:23:01.797848435Z [2024-02-24 00:23:01,797: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:23:02.479208404Z [2024-02-24 00:23:02,477: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[649e3a0b-65f4-44da-9ae6-f9c72f9d964b] succeeded in 1.4916908280001735s: None
2024-02-24T00:23:02.533266990Z [2024-02-24 00:23:02,532: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:23:02.536794295Z [2024-02-24 00:23:02,536: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:23:02.553209922Z [2024-02-24 00:23:02,552: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:23:02.554601206Z [2024-02-24 00:23:02,554: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:23:02.554710765Z [2024-02-24 00:23:02,554: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:23:02.554915586Z [2024-02-24 00:23:02,554: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:23:02.555116095Z [2024-02-24 00:23:02,554: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:23:02.555435572Z [2024-02-24 00:23:02,555: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:23:02.555538303Z [2024-02-24 00:23:02,555: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:23:02.577961526Z [2024-02-24 00:23:02,577: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:23:02.581709868Z [2024-02-24 00:23:02,581: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:23:02.604122207Z [2024-02-24 00:23:02,603: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:23:02.605507376Z [2024-02-24 00:23:02,605: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:23:02.605631082Z [2024-02-24 00:23:02,605: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:23:02.605935861Z [2024-02-24 00:23:02,605: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:23:02.606060925Z [2024-02-24 00:23:02,605: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:23:02.606473572Z [2024-02-24 00:23:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:23:02.606603324Z [2024-02-24 00:23:02,606: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:23:02.644136233Z [2024-02-24 00:23:02,643: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:23:02.730630748Z [2024-02-24 00:23:02,730: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:23:04.717075373Z [2024-02-24 00:23:04,716: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[167fa109-57bc-439e-8794-a5d1e65c0f29] succeeded in 3.746091940000042s: None
2024-02-24T00:23:05.247438693Z [2024-02-24 00:23:05,247: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9532231f-4eaf-450e-a266-d717ca5262fc] succeeded in 4.295760206000068s: None
2024-02-24T00:24:00.615282323Z [2024-02-24 00:24:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e84d98bc-5f38-40ff-b5cb-da887338551f] received
2024-02-24T00:24:00.618575273Z [2024-02-24 00:24:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca58f240-79cd-4215-8690-7d080e8e198f] received
2024-02-24T00:24:00.621747013Z [2024-02-24 00:24:00,621: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6680045e-6dca-4c40-8d72-fcf26dd706f9] received
2024-02-24T00:24:00.625138250Z [2024-02-24 00:24:00,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b31486a-beb1-4f92-a69f-6992738f4ba0] received
2024-02-24T00:24:00.631610634Z [2024-02-24 00:24:00,631: INFO/ForkPoolWorker-16] [ca58f240-79cd-4215-8690-7d080e8e198f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:24:00.636494505Z [2024-02-24 00:24:00,635: INFO/ForkPoolWorker-15] [e84d98bc-5f38-40ff-b5cb-da887338551f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:24:00.654048157Z [2024-02-24 00:24:00,653: INFO/ForkPoolWorker-1] [6680045e-6dca-4c40-8d72-fcf26dd706f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:24:00.657418863Z [2024-02-24 00:24:00,656: INFO/ForkPoolWorker-2] [1b31486a-beb1-4f92-a69f-6992738f4ba0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:24:01.020570499Z [2024-02-24 00:24:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:24:01.037193859Z [2024-02-24 00:24:01,033: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:24:01.128444209Z [2024-02-24 00:24:01,124: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:24:01.323480961Z [2024-02-24 00:24:01,319: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:24:01.341950090Z [2024-02-24 00:24:01,341: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:24:01.445447663Z [2024-02-24 00:24:01,445: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:24:01.450017072Z [2024-02-24 00:24:01,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:24:01.500730589Z [2024-02-24 00:24:01,500: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:24:01.503384599Z [2024-02-24 00:24:01,503: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:24:01.503658277Z [2024-02-24 00:24:01,503: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:24:01.503796916Z [2024-02-24 00:24:01,503: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:24:01.504153486Z [2024-02-24 00:24:01,503: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:24:01.653434182Z [2024-02-24 00:24:01,653: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:24:01.966294082Z [2024-02-24 00:24:01,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e84d98bc-5f38-40ff-b5cb-da887338551f] succeeded in 1.3472612189998472s: None
2024-02-24T00:24:02.524998315Z [2024-02-24 00:24:02,523: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6680045e-6dca-4c40-8d72-fcf26dd706f9] succeeded in 1.8992313210001157s: None
2024-02-24T00:24:02.611861885Z [2024-02-24 00:24:02,611: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:24:02.615378549Z [2024-02-24 00:24:02,614: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:24:02.672793082Z [2024-02-24 00:24:02,662: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:24:02.672836799Z [2024-02-24 00:24:02,663: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:24:02.672841784Z [2024-02-24 00:24:02,664: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:24:02.672845689Z [2024-02-24 00:24:02,664: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:24:02.672849527Z [2024-02-24 00:24:02,664: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:24:02.672852717Z [2024-02-24 00:24:02,664: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:24:02.672858749Z [2024-02-24 00:24:02,664: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:24:02.761078533Z [2024-02-24 00:24:02,760: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:24:02.900164708Z [2024-02-24 00:24:02,899: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:24:02.903729958Z [2024-02-24 00:24:02,903: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:24:02.927857649Z [2024-02-24 00:24:02,927: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:24:02.929435735Z [2024-02-24 00:24:02,929: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:24:02.929628652Z [2024-02-24 00:24:02,929: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:24:02.929939144Z [2024-02-24 00:24:02,929: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:24:02.930148299Z [2024-02-24 00:24:02,930: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:24:02.930648720Z [2024-02-24 00:24:02,930: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:24:02.930809566Z [2024-02-24 00:24:02,930: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:24:03.041168654Z [2024-02-24 00:24:03,040: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:24:05.246923682Z [2024-02-24 00:24:05,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ca58f240-79cd-4215-8690-7d080e8e198f] succeeded in 4.624873305000165s: None
2024-02-24T00:24:05.299605521Z [2024-02-24 00:24:05,299: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1b31486a-beb1-4f92-a69f-6992738f4ba0] succeeded in 4.6704992400000265s: None
2024-02-24T00:25:00.874640155Z [2024-02-24 00:25:00,874: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d40a3120-0e29-4347-8cc2-00fa24f35873] received
2024-02-24T00:25:00.877088346Z [2024-02-24 00:25:00,876: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af1a8b59-529e-4a0c-8132-bd33a83fa141] received
2024-02-24T00:25:00.881865557Z [2024-02-24 00:25:00,881: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d86754ed-1ca6-40cb-b1f2-3528189b0c56] received
2024-02-24T00:25:00.889325833Z [2024-02-24 00:25:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01f77385-12e2-48cf-9fe2-7216f69f870c] received
2024-02-24T00:25:00.897077963Z [2024-02-24 00:25:00,896: INFO/ForkPoolWorker-15] [d40a3120-0e29-4347-8cc2-00fa24f35873] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:25:00.902934470Z [2024-02-24 00:25:00,902: INFO/ForkPoolWorker-2] [01f77385-12e2-48cf-9fe2-7216f69f870c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:25:00.910489786Z [2024-02-24 00:25:00,910: INFO/ForkPoolWorker-1] [d86754ed-1ca6-40cb-b1f2-3528189b0c56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:25:00.914832890Z [2024-02-24 00:25:00,914: INFO/ForkPoolWorker-16] [af1a8b59-529e-4a0c-8132-bd33a83fa141] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:25:01.313902349Z [2024-02-24 00:25:01,302: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:25:01.330687085Z [2024-02-24 00:25:01,325: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:25:01.503155088Z [2024-02-24 00:25:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:25:01.523431644Z [2024-02-24 00:25:01,520: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:25:01.669853277Z [2024-02-24 00:25:01,669: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:25:01.673886490Z [2024-02-24 00:25:01,673: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:01.694376629Z [2024-02-24 00:25:01,694: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:25:01.695504050Z [2024-02-24 00:25:01,695: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:25:01.695658082Z [2024-02-24 00:25:01,695: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:25:01.695782467Z [2024-02-24 00:25:01,695: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:25:01.696060739Z [2024-02-24 00:25:01,695: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:25:01.812430913Z [2024-02-24 00:25:01,812: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:02.475161952Z [2024-02-24 00:25:02,474: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d40a3120-0e29-4347-8cc2-00fa24f35873] succeeded in 1.5919270529998357s: None
2024-02-24T00:25:02.756125812Z [2024-02-24 00:25:02,755: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:25:02.769293171Z [2024-02-24 00:25:02,768: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:02.811999464Z [2024-02-24 00:25:02,811: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:25:02.813603716Z [2024-02-24 00:25:02,813: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:02.814003033Z [2024-02-24 00:25:02,813: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:02.814227578Z [2024-02-24 00:25:02,813: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:02.814323721Z [2024-02-24 00:25:02,814: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:25:02.816229157Z [2024-02-24 00:25:02,816: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:25:02.816274295Z [2024-02-24 00:25:02,816: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:02.917719505Z [2024-02-24 00:25:02,917: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:25:02.921130197Z [2024-02-24 00:25:02,920: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:02.935011828Z [2024-02-24 00:25:02,934: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:02.950951881Z [2024-02-24 00:25:02,950: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:25:02.954326442Z [2024-02-24 00:25:02,953: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:02.970488784Z [2024-02-24 00:25:02,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:25:02.977201012Z [2024-02-24 00:25:02,976: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:02.977318573Z [2024-02-24 00:25:02,977: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:02.977499134Z [2024-02-24 00:25:02,977: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:02.977629448Z [2024-02-24 00:25:02,977: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:25:02.979100816Z [2024-02-24 00:25:02,978: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:25:02.980321039Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:02.980355456Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:25:02.980369587Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:02.980486245Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:02.980693758Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:02.980820522Z [2024-02-24 00:25:02,980: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:25:02.981207663Z [2024-02-24 00:25:02,981: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:25:02.981335613Z [2024-02-24 00:25:02,981: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:03.082454584Z [2024-02-24 00:25:03,082: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:03.083949767Z [2024-02-24 00:25:03,083: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:03.665674265Z [2024-02-24 00:25:03,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c9037fd-65fb-42b1-94ca-22333596c402] received
2024-02-24T00:25:03.698206632Z [2024-02-24 00:25:03,696: INFO/ForkPoolWorker-15] [5c9037fd-65fb-42b1-94ca-22333596c402] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:25:03.733926874Z [2024-02-24 00:25:03,731: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d86754ed-1ca6-40cb-b1f2-3528189b0c56] succeeded in 2.8478208710002946s: None
2024-02-24T00:25:04.043731615Z [2024-02-24 00:25:04,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:25:04.667068393Z [2024-02-24 00:25:04,666: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01f77385-12e2-48cf-9fe2-7216f69f870c] succeeded in 3.7758036720001655s: None
2024-02-24T00:25:05.115845716Z [2024-02-24 00:25:05,115: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[af1a8b59-529e-4a0c-8132-bd33a83fa141] succeeded in 4.2347808909999s: None
2024-02-24T00:25:05.229369491Z [2024-02-24 00:25:05,228: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:25:05.232904527Z [2024-02-24 00:25:05,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:05.258001949Z [2024-02-24 00:25:05,257: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:25:05.260293086Z [2024-02-24 00:25:05,259: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:05.260389590Z [2024-02-24 00:25:05,260: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:05.260683115Z [2024-02-24 00:25:05,260: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:05.260826360Z [2024-02-24 00:25:05,260: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:25:05.261274520Z [2024-02-24 00:25:05,261: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:25:05.261427379Z [2024-02-24 00:25:05,261: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:05.372024198Z [2024-02-24 00:25:05,371: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:06.008394052Z [2024-02-24 00:25:06,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c9037fd-65fb-42b1-94ca-22333596c402] succeeded in 2.324920556000052s: None
2024-02-24T00:25:06.695250191Z [2024-02-24 00:25:06,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[457a96ef-5945-40de-ab8f-b7e94d9ea5ff] received
2024-02-24T00:25:06.707257192Z [2024-02-24 00:25:06,706: INFO/ForkPoolWorker-15] [457a96ef-5945-40de-ab8f-b7e94d9ea5ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:25:07.136378179Z [2024-02-24 00:25:07,132: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:25:08.463953470Z [2024-02-24 00:25:08,463: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:25:08.467561469Z [2024-02-24 00:25:08,466: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:08.489485675Z [2024-02-24 00:25:08,489: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:25:08.492876569Z [2024-02-24 00:25:08,492: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:08.493153813Z [2024-02-24 00:25:08,492: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:08.493538068Z [2024-02-24 00:25:08,493: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:08.493906032Z [2024-02-24 00:25:08,493: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:25:08.494625544Z [2024-02-24 00:25:08,494: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:25:08.494891935Z [2024-02-24 00:25:08,494: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:08.618488211Z [2024-02-24 00:25:08,618: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:09.208294507Z [2024-02-24 00:25:09,207: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[457a96ef-5945-40de-ab8f-b7e94d9ea5ff] succeeded in 2.510237524999866s: None
2024-02-24T00:25:09.707770995Z [2024-02-24 00:25:09,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62c2b03f-1c40-499b-a80a-c48bb69a8d22] received
2024-02-24T00:25:09.717908704Z [2024-02-24 00:25:09,717: INFO/ForkPoolWorker-15] [62c2b03f-1c40-499b-a80a-c48bb69a8d22] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:25:10.021928447Z [2024-02-24 00:25:10,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:25:11.159847399Z [2024-02-24 00:25:11,159: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:25:11.163112973Z [2024-02-24 00:25:11,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:25:11.185538899Z [2024-02-24 00:25:11,185: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:25:11.187300739Z [2024-02-24 00:25:11,187: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:25:11.187324207Z [2024-02-24 00:25:11,187: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:25:11.187486742Z [2024-02-24 00:25:11,187: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:25:11.187526719Z [2024-02-24 00:25:11,187: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:25:11.188078161Z [2024-02-24 00:25:11,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:25:11.188088944Z [2024-02-24 00:25:11,188: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:25:11.295738128Z [2024-02-24 00:25:11,295: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:25:11.950836044Z [2024-02-24 00:25:11,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62c2b03f-1c40-499b-a80a-c48bb69a8d22] succeeded in 2.2393655860000763s: None
2024-02-24T00:26:01.209981314Z [2024-02-24 00:26:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8d119e2b-8626-456a-bb54-de8fbff85ece] received
2024-02-24T00:26:01.224544203Z [2024-02-24 00:26:01,223: INFO/ForkPoolWorker-15] [8d119e2b-8626-456a-bb54-de8fbff85ece] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:26:01.250025837Z [2024-02-24 00:26:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f86e155d-cbb6-4c37-b83f-9d68bb1397a6] received
2024-02-24T00:26:01.253950724Z [2024-02-24 00:26:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31aa938d-895b-4505-9f67-c84178749acc] received
2024-02-24T00:26:01.260006974Z [2024-02-24 00:26:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fcf7d70-e3dc-4084-afbc-ef9265be7917] received
2024-02-24T00:26:01.275452895Z [2024-02-24 00:26:01,275: INFO/ForkPoolWorker-1] [31aa938d-895b-4505-9f67-c84178749acc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:26:01.286398488Z [2024-02-24 00:26:01,285: INFO/ForkPoolWorker-2] [3fcf7d70-e3dc-4084-afbc-ef9265be7917] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:26:01.292039373Z [2024-02-24 00:26:01,291: INFO/ForkPoolWorker-16] [f86e155d-cbb6-4c37-b83f-9d68bb1397a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:26:01.748714659Z [2024-02-24 00:26:01,740: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:26:01.814248707Z [2024-02-24 00:26:01,810: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:26:01.902599931Z [2024-02-24 00:26:01,899: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:26:01.954972983Z [2024-02-24 00:26:01,951: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:26:02.148033599Z [2024-02-24 00:26:02,147: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:26:02.157429366Z [2024-02-24 00:26:02,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:26:02.198911236Z [2024-02-24 00:26:02,198: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:26:02.202698324Z [2024-02-24 00:26:02,202: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:26:02.202943607Z [2024-02-24 00:26:02,202: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:26:02.203117538Z [2024-02-24 00:26:02,202: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:26:02.203471685Z [2024-02-24 00:26:02,203: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:26:02.345441054Z [2024-02-24 00:26:02,345: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:26:02.973015534Z [2024-02-24 00:26:02,972: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:26:03.426260910Z [2024-02-24 00:26:03,425: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8d119e2b-8626-456a-bb54-de8fbff85ece] succeeded in 2.213440988000002s: None
2024-02-24T00:26:04.006909824Z [2024-02-24 00:26:04,006: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31aa938d-895b-4505-9f67-c84178749acc] succeeded in 2.7527256759999545s: None
2024-02-24T00:26:04.126998112Z [2024-02-24 00:26:04,126: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:26:04.130811698Z [2024-02-24 00:26:04,130: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:26:04.140544052Z [2024-02-24 00:26:04,140: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:26:04.144419228Z [2024-02-24 00:26:04,143: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:26:04.177508721Z [2024-02-24 00:26:04,177: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:26:04.178334083Z [2024-02-24 00:26:04,178: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:26:04.179776902Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:26:04.179792884Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:26:04.179882664Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:26:04.179959606Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:26:04.179970847Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:26:04.180066193Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:26:04.180135472Z [2024-02-24 00:26:04,179: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:26:04.180204968Z [2024-02-24 00:26:04,180: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:26:04.180372499Z [2024-02-24 00:26:04,180: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:26:04.180441931Z [2024-02-24 00:26:04,180: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:26:04.180562527Z [2024-02-24 00:26:04,180: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:26:04.180739079Z [2024-02-24 00:26:04,180: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:26:04.256926252Z [2024-02-24 00:26:04,256: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:26:04.273264114Z [2024-02-24 00:26:04,272: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:26:06.368922560Z [2024-02-24 00:26:06,368: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3fcf7d70-e3dc-4084-afbc-ef9265be7917] succeeded in 5.1103824700003315s: None
2024-02-24T00:26:06.809266129Z [2024-02-24 00:26:06,808: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f86e155d-cbb6-4c37-b83f-9d68bb1397a6] succeeded in 5.557086267000159s: None
2024-02-24T00:27:00.331398215Z [2024-02-24 00:27:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3afa29b8-6982-4243-bdec-d4f6fb21eef2] received
2024-02-24T00:27:00.338090024Z [2024-02-24 00:27:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0b52c2a-647e-448a-be45-33af3e568a7d] received
2024-02-24T00:27:00.342781884Z [2024-02-24 00:27:00,341: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab4d59f7-2588-4333-a5ac-d2403b338fa8] received
2024-02-24T00:27:00.344937370Z [2024-02-24 00:27:00,344: INFO/ForkPoolWorker-16] [d0b52c2a-647e-448a-be45-33af3e568a7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:27:00.348795859Z [2024-02-24 00:27:00,348: INFO/ForkPoolWorker-15] [3afa29b8-6982-4243-bdec-d4f6fb21eef2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:27:00.353613502Z [2024-02-24 00:27:00,353: INFO/ForkPoolWorker-1] [ab4d59f7-2588-4333-a5ac-d2403b338fa8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:27:00.641009576Z [2024-02-24 00:27:00,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:27:00.671140322Z [2024-02-24 00:27:00,668: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:27:00.717129831Z [2024-02-24 00:27:00,708: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:27:00.818631868Z [2024-02-24 00:27:00,818: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:27:00.822953824Z [2024-02-24 00:27:00,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:27:00.846652733Z [2024-02-24 00:27:00,846: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:27:00.847731431Z [2024-02-24 00:27:00,847: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:27:00.847915042Z [2024-02-24 00:27:00,847: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:27:00.848030507Z [2024-02-24 00:27:00,847: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:27:00.848318377Z [2024-02-24 00:27:00,848: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:27:00.962490048Z [2024-02-24 00:27:00,961: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:27:01.683642455Z [2024-02-24 00:27:01,683: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ab4d59f7-2588-4333-a5ac-d2403b338fa8] succeeded in 1.3391789950001112s: None
2024-02-24T00:27:02.062157060Z [2024-02-24 00:27:02,061: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:27:02.066472088Z [2024-02-24 00:27:02,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:27:02.088238624Z [2024-02-24 00:27:02,088: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:27:02.089664057Z [2024-02-24 00:27:02,089: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:27:02.089698649Z [2024-02-24 00:27:02,089: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:27:02.089779306Z [2024-02-24 00:27:02,089: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:27:02.089858499Z [2024-02-24 00:27:02,089: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:27:02.090305644Z [2024-02-24 00:27:02,090: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:27:02.090382805Z [2024-02-24 00:27:02,090: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:27:02.164613256Z [2024-02-24 00:27:02,164: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:27:02.265082454Z [2024-02-24 00:27:02,264: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:27:02.268704530Z [2024-02-24 00:27:02,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:27:02.299095035Z [2024-02-24 00:27:02,298: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:27:02.302886695Z [2024-02-24 00:27:02,302: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:27:02.303035799Z [2024-02-24 00:27:02,302: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:27:02.303272988Z [2024-02-24 00:27:02,303: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:27:02.303422755Z [2024-02-24 00:27:02,303: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:27:02.303772121Z [2024-02-24 00:27:02,303: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:27:02.303886773Z [2024-02-24 00:27:02,303: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:27:02.455750948Z [2024-02-24 00:27:02,455: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:27:04.159804277Z [2024-02-24 00:27:04,159: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3afa29b8-6982-4243-bdec-d4f6fb21eef2] succeeded in 3.824384487000316s: None
2024-02-24T00:27:04.267276564Z [2024-02-24 00:27:04,266: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d0b52c2a-647e-448a-be45-33af3e568a7d] succeeded in 3.9276360779999777s: None
2024-02-24T00:28:00.800400601Z [2024-02-24 00:28:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80192177-18fc-458d-9b04-ef7113ad56c8] received
2024-02-24T00:28:00.803006056Z [2024-02-24 00:28:00,802: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32562288-cbcb-4d79-8579-b2002fd82fa4] received
2024-02-24T00:28:00.804994724Z [2024-02-24 00:28:00,804: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9fb1980-e3da-4238-b17b-f9b9107cc933] received
2024-02-24T00:28:00.813047220Z [2024-02-24 00:28:00,812: INFO/ForkPoolWorker-15] [80192177-18fc-458d-9b04-ef7113ad56c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:28:00.813315148Z [2024-02-24 00:28:00,813: INFO/ForkPoolWorker-1] [e9fb1980-e3da-4238-b17b-f9b9107cc933] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:28:00.813608584Z [2024-02-24 00:28:00,813: INFO/ForkPoolWorker-16] [32562288-cbcb-4d79-8579-b2002fd82fa4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:28:00.821359500Z [2024-02-24 00:28:00,821: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9121dca3-85ba-4cdd-a6b5-6667fd01bec0] received
2024-02-24T00:28:00.834818896Z [2024-02-24 00:28:00,834: INFO/ForkPoolWorker-2] [9121dca3-85ba-4cdd-a6b5-6667fd01bec0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:28:01.131590421Z [2024-02-24 00:28:01,128: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:28:01.155474889Z [2024-02-24 00:28:01,150: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:28:01.186809439Z [2024-02-24 00:28:01,183: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:28:01.386363270Z [2024-02-24 00:28:01,383: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:28:01.397040191Z [2024-02-24 00:28:01,394: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:28:01.404176265Z [2024-02-24 00:28:01,403: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:28:01.427898268Z [2024-02-24 00:28:01,427: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:28:01.429465035Z [2024-02-24 00:28:01,429: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:28:01.429659911Z [2024-02-24 00:28:01,429: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:28:01.430073921Z [2024-02-24 00:28:01,429: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:28:01.430308628Z [2024-02-24 00:28:01,430: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:28:01.546049543Z [2024-02-24 00:28:01,545: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:28:01.608351987Z [2024-02-24 00:28:01,608: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:28:02.169415701Z [2024-02-24 00:28:02,169: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32562288-cbcb-4d79-8579-b2002fd82fa4] succeeded in 1.3630842170000506s: None
2024-02-24T00:28:02.196926581Z [2024-02-24 00:28:02,196: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[80192177-18fc-458d-9b04-ef7113ad56c8] succeeded in 1.3941742319998411s: None
2024-02-24T00:28:02.777153830Z [2024-02-24 00:28:02,776: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:28:02.780737872Z [2024-02-24 00:28:02,780: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:28:02.814975958Z [2024-02-24 00:28:02,813: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:28:02.817444981Z [2024-02-24 00:28:02,817: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:28:02.817950770Z [2024-02-24 00:28:02,817: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:28:02.818194518Z [2024-02-24 00:28:02,817: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:28:02.818325354Z [2024-02-24 00:28:02,818: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:28:02.818707827Z [2024-02-24 00:28:02,818: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:28:02.818911131Z [2024-02-24 00:28:02,818: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:28:02.892477280Z [2024-02-24 00:28:02,892: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:28:02.895981567Z [2024-02-24 00:28:02,895: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:28:02.915803837Z [2024-02-24 00:28:02,915: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:28:02.916938105Z [2024-02-24 00:28:02,916: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:28:02.916978131Z [2024-02-24 00:28:02,916: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:28:02.917162243Z [2024-02-24 00:28:02,916: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:28:02.917223332Z [2024-02-24 00:28:02,917: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:28:02.917432712Z [2024-02-24 00:28:02,917: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:28:02.917478045Z [2024-02-24 00:28:02,917: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:28:02.922192366Z [2024-02-24 00:28:02,921: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:28:03.043854902Z [2024-02-24 00:28:03,043: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:28:05.990304920Z [2024-02-24 00:28:05,989: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9121dca3-85ba-4cdd-a6b5-6667fd01bec0] succeeded in 5.167284413999823s: None
2024-02-24T00:28:06.035519677Z [2024-02-24 00:28:06,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9fb1980-e3da-4238-b17b-f9b9107cc933] succeeded in 5.229151112999716s: None
2024-02-24T00:29:00.529900596Z [2024-02-24 00:29:00,529: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5af4b4ce-1bfd-4f0f-b018-4f1fc07f30a7] received
2024-02-24T00:29:00.539817771Z [2024-02-24 00:29:00,539: INFO/ForkPoolWorker-15] [5af4b4ce-1bfd-4f0f-b018-4f1fc07f30a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:29:00.542985296Z [2024-02-24 00:29:00,542: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5081a3d-9974-4d60-b1a3-2cea5bb46578] received
2024-02-24T00:29:00.550564058Z [2024-02-24 00:29:00,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f355066-dd91-499b-a584-acab34def0a8] received
2024-02-24T00:29:00.552324261Z [2024-02-24 00:29:00,552: INFO/ForkPoolWorker-16] [e5081a3d-9974-4d60-b1a3-2cea5bb46578] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:29:00.562483812Z [2024-02-24 00:29:00,562: INFO/ForkPoolWorker-1] [9f355066-dd91-499b-a584-acab34def0a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:29:00.824977907Z [2024-02-24 00:29:00,821: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:29:00.828075578Z [2024-02-24 00:29:00,824: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:29:00.850653645Z [2024-02-24 00:29:00,847: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:29:00.984353149Z [2024-02-24 00:29:00,983: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:29:00.988324287Z [2024-02-24 00:29:00,987: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:29:01.024884441Z [2024-02-24 00:29:01,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:29:01.039600474Z [2024-02-24 00:29:01,039: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:29:01.039629604Z [2024-02-24 00:29:01,039: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:29:01.039697495Z [2024-02-24 00:29:01,039: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:29:01.040032561Z [2024-02-24 00:29:01,039: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:29:01.151420963Z [2024-02-24 00:29:01,151: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:29:01.879785975Z [2024-02-24 00:29:01,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5af4b4ce-1bfd-4f0f-b018-4f1fc07f30a7] succeeded in 1.3475290809997205s: None
2024-02-24T00:29:02.065761923Z [2024-02-24 00:29:02,065: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:29:02.069150410Z [2024-02-24 00:29:02,068: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:29:02.096548808Z [2024-02-24 00:29:02,096: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:29:02.097982786Z [2024-02-24 00:29:02,097: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:29:02.098126212Z [2024-02-24 00:29:02,097: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:29:02.098358603Z [2024-02-24 00:29:02,098: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:29:02.098463348Z [2024-02-24 00:29:02,098: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:29:02.099923295Z [2024-02-24 00:29:02,099: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:29:02.099981229Z [2024-02-24 00:29:02,099: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:29:02.115845526Z [2024-02-24 00:29:02,115: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:29:02.119176751Z [2024-02-24 00:29:02,118: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:29:02.146988182Z [2024-02-24 00:29:02,146: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:29:02.148570517Z [2024-02-24 00:29:02,148: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:29:02.148747934Z [2024-02-24 00:29:02,148: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:29:02.149017786Z [2024-02-24 00:29:02,148: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:29:02.149128017Z [2024-02-24 00:29:02,148: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:29:02.149451032Z [2024-02-24 00:29:02,149: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:29:02.149590772Z [2024-02-24 00:29:02,149: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:29:02.186531574Z [2024-02-24 00:29:02,186: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:29:02.251459769Z [2024-02-24 00:29:02,251: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:29:03.967263950Z [2024-02-24 00:29:03,966: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5081a3d-9974-4d60-b1a3-2cea5bb46578] succeeded in 3.42231440400019s: None
2024-02-24T00:29:04.270100749Z [2024-02-24 00:29:04,269: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f355066-dd91-499b-a584-acab34def0a8] succeeded in 3.7176982870000757s: None
2024-02-24T00:30:00.577183171Z [2024-02-24 00:30:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad74a24f-b5fc-4a43-b414-f558081d9fff] received
2024-02-24T00:30:00.580627511Z [2024-02-24 00:30:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[edada86e-fec2-4a4d-8bbd-db92f0bfef03] received
2024-02-24T00:30:00.584187508Z [2024-02-24 00:30:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ddde855-9ad0-4bc7-bda9-8c1782713a5e] received
2024-02-24T00:30:00.586115622Z [2024-02-24 00:30:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6a4abb9-a02b-46a2-9f95-43f5d921ebf8] received
2024-02-24T00:30:00.588502419Z [2024-02-24 00:30:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b1dba4f-5a40-45d1-addb-664f4b741798] received
2024-02-24T00:30:00.598791918Z [2024-02-24 00:30:00,598: INFO/ForkPoolWorker-1] [4ddde855-9ad0-4bc7-bda9-8c1782713a5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:30:00.604951297Z [2024-02-24 00:30:00,604: INFO/ForkPoolWorker-2] [d6a4abb9-a02b-46a2-9f95-43f5d921ebf8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:30:00.605483934Z [2024-02-24 00:30:00,605: INFO/ForkPoolWorker-15] [ad74a24f-b5fc-4a43-b414-f558081d9fff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:30:00.610222943Z [2024-02-24 00:30:00,609: INFO/ForkPoolWorker-16] [edada86e-fec2-4a4d-8bbd-db92f0bfef03] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:30:00.612113531Z [2024-02-24 00:30:00,611: INFO/ForkPoolWorker-3] [3b1dba4f-5a40-45d1-addb-664f4b741798] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:30:00.947262896Z [2024-02-24 00:30:00,943: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:30:00.989631914Z [2024-02-24 00:30:00,985: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:30:01.060179770Z [2024-02-24 00:30:01,054: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:30:01.229792457Z [2024-02-24 00:30:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:30:01.229816175Z [2024-02-24 00:30:01,196: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:30:01.431483563Z [2024-02-24 00:30:01,430: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:30:01.438338128Z [2024-02-24 00:30:01,437: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:01.471840125Z [2024-02-24 00:30:01,471: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:30:01.472989469Z [2024-02-24 00:30:01,472: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:30:01.473101380Z [2024-02-24 00:30:01,472: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:30:01.473235528Z [2024-02-24 00:30:01,473: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:30:01.473477459Z [2024-02-24 00:30:01,473: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:30:01.487553524Z [2024-02-24 00:30:01,487: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:01.566350200Z [2024-02-24 00:30:01,566: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:02.180028156Z [2024-02-24 00:30:02,179: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[edada86e-fec2-4a4d-8bbd-db92f0bfef03] succeeded in 1.5963423539997166s: None
2024-02-24T00:30:02.374022971Z [2024-02-24 00:30:02,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ddde855-9ad0-4bc7-bda9-8c1782713a5e] succeeded in 1.7836579149998215s: None
2024-02-24T00:30:02.663405808Z [2024-02-24 00:30:02,660: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:30:02.665007895Z [2024-02-24 00:30:02,664: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:02.775701826Z [2024-02-24 00:30:02,775: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:30:02.779352742Z [2024-02-24 00:30:02,778: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:02.779402415Z [2024-02-24 00:30:02,779: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:02.779489386Z [2024-02-24 00:30:02,779: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:02.779497711Z [2024-02-24 00:30:02,779: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:30:02.780815215Z [2024-02-24 00:30:02,780: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:30:02.780832943Z [2024-02-24 00:30:02,780: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:02.942873761Z [2024-02-24 00:30:02,942: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:03.055658263Z [2024-02-24 00:30:03,055: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:30:03.059303456Z [2024-02-24 00:30:03,058: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:03.102179845Z [2024-02-24 00:30:03,101: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:30:03.103517534Z [2024-02-24 00:30:03,103: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:03.103655421Z [2024-02-24 00:30:03,103: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:03.103844335Z [2024-02-24 00:30:03,103: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:03.103962297Z [2024-02-24 00:30:03,103: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:30:03.104284899Z [2024-02-24 00:30:03,104: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:30:03.104506015Z [2024-02-24 00:30:03,104: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:03.182666853Z [2024-02-24 00:30:03,182: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:03.199783099Z [2024-02-24 00:30:03,197: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:30:03.205599681Z [2024-02-24 00:30:03,204: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:03.237236168Z [2024-02-24 00:30:03,236: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:30:03.239687647Z [2024-02-24 00:30:03,239: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:03.239717131Z [2024-02-24 00:30:03,239: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:03.239784541Z [2024-02-24 00:30:03,239: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:03.239816904Z [2024-02-24 00:30:03,239: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:30:03.246294602Z [2024-02-24 00:30:03,240: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:30:03.246327847Z [2024-02-24 00:30:03,245: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:03.375269212Z [2024-02-24 00:30:03,375: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:03.700426153Z [2024-02-24 00:30:03,700: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad74a24f-b5fc-4a43-b414-f558081d9fff] succeeded in 3.118490871999711s: None
2024-02-24T00:30:04.511776608Z [2024-02-24 00:30:04,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0420348-274f-4fc1-a0f0-d39fa2564c53] received
2024-02-24T00:30:04.520330884Z [2024-02-24 00:30:04,519: INFO/ForkPoolWorker-15] [e0420348-274f-4fc1-a0f0-d39fa2564c53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:30:04.755519179Z [2024-02-24 00:30:04,755: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[3b1dba4f-5a40-45d1-addb-664f4b741798] succeeded in 4.164319727999555s: None
2024-02-24T00:30:04.810462221Z [2024-02-24 00:30:04,807: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:30:05.236626340Z [2024-02-24 00:30:05,236: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d6a4abb9-a02b-46a2-9f95-43f5d921ebf8] succeeded in 4.649022544999752s: None
2024-02-24T00:30:05.975958390Z [2024-02-24 00:30:05,975: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:30:05.979584189Z [2024-02-24 00:30:05,979: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:05.999280904Z [2024-02-24 00:30:05,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:30:06.000512853Z [2024-02-24 00:30:06,000: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:06.000683998Z [2024-02-24 00:30:06,000: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:06.000961532Z [2024-02-24 00:30:06,000: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:06.000985688Z [2024-02-24 00:30:06,000: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:30:06.001367777Z [2024-02-24 00:30:06,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:30:06.001483140Z [2024-02-24 00:30:06,001: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:06.109657412Z [2024-02-24 00:30:06,109: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:06.752037248Z [2024-02-24 00:30:06,751: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0420348-274f-4fc1-a0f0-d39fa2564c53] succeeded in 2.238119538000319s: None
2024-02-24T00:30:06.921925219Z [2024-02-24 00:30:06,921: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b38468b4-80d2-4cbc-96eb-2631af69c6be] received
2024-02-24T00:30:06.935105313Z [2024-02-24 00:30:06,934: INFO/ForkPoolWorker-15] [b38468b4-80d2-4cbc-96eb-2631af69c6be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:30:07.272453033Z [2024-02-24 00:30:07,268: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:30:08.476496145Z [2024-02-24 00:30:08,475: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:30:08.479997321Z [2024-02-24 00:30:08,479: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:08.507849048Z [2024-02-24 00:30:08,507: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:30:08.510292179Z [2024-02-24 00:30:08,509: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:08.510404417Z [2024-02-24 00:30:08,510: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:08.510687221Z [2024-02-24 00:30:08,510: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:08.510879871Z [2024-02-24 00:30:08,510: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:30:08.511440721Z [2024-02-24 00:30:08,511: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:30:08.511470890Z [2024-02-24 00:30:08,511: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:08.611688412Z [2024-02-24 00:30:08,611: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:09.207208057Z [2024-02-24 00:30:09,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b38468b4-80d2-4cbc-96eb-2631af69c6be] succeeded in 2.2820504299997992s: None
2024-02-24T00:30:09.584161753Z [2024-02-24 00:30:09,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e8ea7ee-19c9-412c-8e33-04afa4007ca0] received
2024-02-24T00:30:09.592467554Z [2024-02-24 00:30:09,592: INFO/ForkPoolWorker-15] [4e8ea7ee-19c9-412c-8e33-04afa4007ca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:30:09.885939599Z [2024-02-24 00:30:09,882: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:30:11.029652749Z [2024-02-24 00:30:11,029: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:30:11.033199204Z [2024-02-24 00:30:11,032: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:30:11.051132369Z [2024-02-24 00:30:11,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:30:11.052367070Z [2024-02-24 00:30:11,052: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:30:11.052501955Z [2024-02-24 00:30:11,052: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:30:11.052744891Z [2024-02-24 00:30:11,052: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:30:11.052882308Z [2024-02-24 00:30:11,052: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:30:11.053374911Z [2024-02-24 00:30:11,053: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:30:11.053544745Z [2024-02-24 00:30:11,053: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:30:11.146332812Z [2024-02-24 00:30:11,145: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:30:11.726115960Z [2024-02-24 00:30:11,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e8ea7ee-19c9-412c-8e33-04afa4007ca0] succeeded in 2.1384683879996373s: None
2024-02-24T00:31:00.360480802Z [2024-02-24 00:31:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b560781e-a4ad-4b01-be4c-ac52cb159b64] received
2024-02-24T00:31:00.370965816Z [2024-02-24 00:31:00,370: INFO/ForkPoolWorker-15] [b560781e-a4ad-4b01-be4c-ac52cb159b64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:31:00.378906377Z [2024-02-24 00:31:00,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91095f5e-1ec7-4a14-8322-b2dd7ac3f100] received
2024-02-24T00:31:00.387495559Z [2024-02-24 00:31:00,387: INFO/ForkPoolWorker-16] [91095f5e-1ec7-4a14-8322-b2dd7ac3f100] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:31:00.387763078Z [2024-02-24 00:31:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a48e0c70-7875-4843-9113-6993ac6de51b] received
2024-02-24T00:31:00.405687155Z [2024-02-24 00:31:00,404: INFO/ForkPoolWorker-1] [a48e0c70-7875-4843-9113-6993ac6de51b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:31:00.743766212Z [2024-02-24 00:31:00,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:31:00.745078516Z [2024-02-24 00:31:00,740: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:31:00.757168112Z [2024-02-24 00:31:00,752: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:31:00.910489344Z [2024-02-24 00:31:00,910: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:31:00.914892865Z [2024-02-24 00:31:00,914: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:31:00.942817589Z [2024-02-24 00:31:00,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:31:00.944196888Z [2024-02-24 00:31:00,943: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:31:00.944402903Z [2024-02-24 00:31:00,944: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:31:00.944555656Z [2024-02-24 00:31:00,944: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:31:00.944837283Z [2024-02-24 00:31:00,944: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:31:01.066828871Z [2024-02-24 00:31:01,066: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:31:01.839816850Z [2024-02-24 00:31:01,839: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b560781e-a4ad-4b01-be4c-ac52cb159b64] succeeded in 1.4759181720000925s: None
2024-02-24T00:31:02.208257559Z [2024-02-24 00:31:02,207: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:31:02.212703323Z [2024-02-24 00:31:02,212: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:31:02.241879100Z [2024-02-24 00:31:02,241: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:31:02.243760947Z [2024-02-24 00:31:02,243: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:31:02.243784891Z [2024-02-24 00:31:02,243: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:31:02.243875849Z [2024-02-24 00:31:02,243: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:31:02.243901594Z [2024-02-24 00:31:02,243: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:31:02.244137971Z [2024-02-24 00:31:02,244: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:31:02.244164250Z [2024-02-24 00:31:02,244: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:31:02.338411478Z [2024-02-24 00:31:02,338: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:31:02.342021911Z [2024-02-24 00:31:02,341: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:31:02.373352763Z [2024-02-24 00:31:02,372: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:31:02.389463021Z [2024-02-24 00:31:02,389: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:31:02.394408536Z [2024-02-24 00:31:02,394: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:31:02.394778551Z [2024-02-24 00:31:02,394: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:31:02.395017951Z [2024-02-24 00:31:02,394: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:31:02.395193001Z [2024-02-24 00:31:02,395: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:31:02.395529243Z [2024-02-24 00:31:02,395: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:31:02.395883239Z [2024-02-24 00:31:02,395: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:31:02.548926931Z [2024-02-24 00:31:02,548: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:31:03.936219746Z [2024-02-24 00:31:03,935: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[91095f5e-1ec7-4a14-8322-b2dd7ac3f100] succeeded in 3.5551743969999734s: None
2024-02-24T00:31:04.452670847Z [2024-02-24 00:31:04,452: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a48e0c70-7875-4843-9113-6993ac6de51b] succeeded in 4.062872638000044s: None
2024-02-24T00:32:01.201832328Z [2024-02-24 00:32:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a94ddb9-2f0c-49f3-b9fd-83598bfb566d] received
2024-02-24T00:32:01.241329678Z [2024-02-24 00:32:01,240: INFO/ForkPoolWorker-15] [6a94ddb9-2f0c-49f3-b9fd-83598bfb566d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:32:01.257452321Z [2024-02-24 00:32:01,254: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80584f81-1c05-45a5-a3e3-146bf0e685d1] received
2024-02-24T00:32:01.261949747Z [2024-02-24 00:32:01,261: INFO/ForkPoolWorker-16] [80584f81-1c05-45a5-a3e3-146bf0e685d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:32:01.269020626Z [2024-02-24 00:32:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6c18750-3f80-485c-97fa-fb56de4abf1c] received
2024-02-24T00:32:01.291790968Z [2024-02-24 00:32:01,287: INFO/ForkPoolWorker-1] [e6c18750-3f80-485c-97fa-fb56de4abf1c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:32:01.310027257Z [2024-02-24 00:32:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc0706f5-7517-462c-9e81-927aa6145342] received
2024-02-24T00:32:01.336880518Z [2024-02-24 00:32:01,331: INFO/ForkPoolWorker-2] [cc0706f5-7517-462c-9e81-927aa6145342] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:32:01.623338460Z [2024-02-24 00:32:01,619: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:32:01.624350296Z [2024-02-24 00:32:01,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:32:01.629925134Z [2024-02-24 00:32:01,626: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:32:01.692067990Z [2024-02-24 00:32:01,687: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:32:01.921376764Z [2024-02-24 00:32:01,920: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:32:01.925329978Z [2024-02-24 00:32:01,924: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:32:01.952199069Z [2024-02-24 00:32:01,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:32:01.959143279Z [2024-02-24 00:32:01,958: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:32:01.959521445Z [2024-02-24 00:32:01,959: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:32:01.959874305Z [2024-02-24 00:32:01,959: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:32:01.960145137Z [2024-02-24 00:32:01,960: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:32:01.995016816Z [2024-02-24 00:32:01,994: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:32:02.048653942Z [2024-02-24 00:32:02,048: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:32:02.603741601Z [2024-02-24 00:32:02,603: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e6c18750-3f80-485c-97fa-fb56de4abf1c] succeeded in 1.3300468119996367s: None
2024-02-24T00:32:02.841028396Z [2024-02-24 00:32:02,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6a94ddb9-2f0c-49f3-b9fd-83598bfb566d] succeeded in 1.6368977419997464s: None
2024-02-24T00:32:03.070346273Z [2024-02-24 00:32:03,069: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:32:03.073846617Z [2024-02-24 00:32:03,073: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:32:03.093557848Z [2024-02-24 00:32:03,093: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:32:03.094849129Z [2024-02-24 00:32:03,094: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:32:03.094918239Z [2024-02-24 00:32:03,094: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:32:03.094965582Z [2024-02-24 00:32:03,094: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:32:03.095034675Z [2024-02-24 00:32:03,094: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:32:03.095325476Z [2024-02-24 00:32:03,095: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:32:03.095342924Z [2024-02-24 00:32:03,095: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:32:03.168954832Z [2024-02-24 00:32:03,168: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:32:03.172355528Z [2024-02-24 00:32:03,171: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:32:03.180115815Z [2024-02-24 00:32:03,179: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:32:03.195004072Z [2024-02-24 00:32:03,194: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:32:03.196280449Z [2024-02-24 00:32:03,196: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:32:03.196408016Z [2024-02-24 00:32:03,196: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:32:03.196600886Z [2024-02-24 00:32:03,196: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:32:03.196661449Z [2024-02-24 00:32:03,196: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:32:03.196959617Z [2024-02-24 00:32:03,196: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:32:03.197456893Z [2024-02-24 00:32:03,197: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:32:03.270876702Z [2024-02-24 00:32:03,270: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:32:04.798893367Z [2024-02-24 00:32:04,798: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cc0706f5-7517-462c-9e81-927aa6145342] succeeded in 3.477949100999467s: None
2024-02-24T00:32:04.917744444Z [2024-02-24 00:32:04,917: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80584f81-1c05-45a5-a3e3-146bf0e685d1] succeeded in 3.6616704670004765s: None
2024-02-24T00:33:00.886046466Z [2024-02-24 00:33:00,885: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3904cacc-9ecd-4089-be4a-95fcbddfcc41] received
2024-02-24T00:33:00.903841082Z [2024-02-24 00:33:00,902: INFO/ForkPoolWorker-15] [3904cacc-9ecd-4089-be4a-95fcbddfcc41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:33:00.908054012Z [2024-02-24 00:33:00,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6426af48-ced8-4411-b732-a8088023b79d] received
2024-02-24T00:33:00.918837985Z [2024-02-24 00:33:00,918: INFO/ForkPoolWorker-16] [6426af48-ced8-4411-b732-a8088023b79d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:33:00.923749410Z [2024-02-24 00:33:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[259ff07f-9198-450a-9a00-4b5151a03cf5] received
2024-02-24T00:33:00.933829832Z [2024-02-24 00:33:00,933: INFO/ForkPoolWorker-1] [259ff07f-9198-450a-9a00-4b5151a03cf5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:33:01.276733925Z [2024-02-24 00:33:01,272: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:33:01.326469325Z [2024-02-24 00:33:01,323: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:33:01.465375395Z [2024-02-24 00:33:01,461: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:33:01.546488051Z [2024-02-24 00:33:01,545: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:33:01.550628324Z [2024-02-24 00:33:01,550: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:33:01.581340545Z [2024-02-24 00:33:01,580: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:33:01.583044143Z [2024-02-24 00:33:01,582: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:33:01.583080213Z [2024-02-24 00:33:01,582: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:33:01.583192747Z [2024-02-24 00:33:01,583: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:33:01.583605002Z [2024-02-24 00:33:01,583: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:33:01.734637958Z [2024-02-24 00:33:01,734: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:33:02.326986797Z [2024-02-24 00:33:02,326: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[259ff07f-9198-450a-9a00-4b5151a03cf5] succeeded in 1.4010731719999967s: None
2024-02-24T00:33:02.644934483Z [2024-02-24 00:33:02,644: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:33:02.648669266Z [2024-02-24 00:33:02,648: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:33:02.710256216Z [2024-02-24 00:33:02,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:33:02.710283631Z [2024-02-24 00:33:02,703: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:33:02.710289589Z [2024-02-24 00:33:02,703: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:33:02.710294910Z [2024-02-24 00:33:02,703: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:33:02.710320221Z [2024-02-24 00:33:02,703: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:33:02.710325138Z [2024-02-24 00:33:02,704: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:33:02.710329863Z [2024-02-24 00:33:02,704: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:33:02.853467699Z [2024-02-24 00:33:02,853: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:33:02.958536923Z [2024-02-24 00:33:02,958: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:33:02.962403077Z [2024-02-24 00:33:02,961: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:33:02.983201402Z [2024-02-24 00:33:02,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:33:02.984997815Z [2024-02-24 00:33:02,984: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:33:02.985238612Z [2024-02-24 00:33:02,984: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:33:02.985973368Z [2024-02-24 00:33:02,985: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:33:02.985998830Z [2024-02-24 00:33:02,985: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:33:02.986004440Z [2024-02-24 00:33:02,985: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:33:02.986210571Z [2024-02-24 00:33:02,986: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:33:03.092440484Z [2024-02-24 00:33:03,092: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:33:04.874304480Z [2024-02-24 00:33:04,873: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3904cacc-9ecd-4089-be4a-95fcbddfcc41] succeeded in 3.984426816999985s: None
2024-02-24T00:33:05.285213242Z [2024-02-24 00:33:05,284: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6426af48-ced8-4411-b732-a8088023b79d] succeeded in 4.37503991199992s: None
2024-02-24T00:34:00.356270461Z [2024-02-24 00:34:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff3f9560-f283-40a3-bd41-a80e354eb9dd] received
2024-02-24T00:34:00.360648527Z [2024-02-24 00:34:00,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cd956b3-3dc0-4ea4-a51a-244725b2cd9b] received
2024-02-24T00:34:00.363677867Z [2024-02-24 00:34:00,363: INFO/ForkPoolWorker-15] [ff3f9560-f283-40a3-bd41-a80e354eb9dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:34:00.363794211Z [2024-02-24 00:34:00,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36cc824e-87d6-4ee5-9a51-08ec474cf9ac] received
2024-02-24T00:34:00.370842186Z [2024-02-24 00:34:00,370: INFO/ForkPoolWorker-16] [7cd956b3-3dc0-4ea4-a51a-244725b2cd9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:34:00.379267183Z [2024-02-24 00:34:00,378: INFO/ForkPoolWorker-1] [36cc824e-87d6-4ee5-9a51-08ec474cf9ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:34:00.385587687Z [2024-02-24 00:34:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5586a83a-b96e-41a9-a776-80474d0be9e1] received
2024-02-24T00:34:00.396727209Z [2024-02-24 00:34:00,396: INFO/ForkPoolWorker-2] [5586a83a-b96e-41a9-a776-80474d0be9e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:34:00.730705951Z [2024-02-24 00:34:00,727: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:34:00.736108555Z [2024-02-24 00:34:00,732: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:34:00.754274808Z [2024-02-24 00:34:00,744: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:34:00.755353932Z [2024-02-24 00:34:00,751: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:34:01.017400075Z [2024-02-24 00:34:01,017: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:34:01.021210478Z [2024-02-24 00:34:01,020: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:34:01.025852487Z [2024-02-24 00:34:01,025: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:34:01.056341019Z [2024-02-24 00:34:01,055: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:34:01.060027042Z [2024-02-24 00:34:01,059: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:34:01.060243494Z [2024-02-24 00:34:01,059: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:34:01.060354475Z [2024-02-24 00:34:01,060: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:34:01.060887415Z [2024-02-24 00:34:01,060: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:34:01.253252116Z [2024-02-24 00:34:01,251: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:34:01.760586711Z [2024-02-24 00:34:01,760: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff3f9560-f283-40a3-bd41-a80e354eb9dd] succeeded in 1.4017239909999262s: None
2024-02-24T00:34:01.974692847Z [2024-02-24 00:34:01,974: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7cd956b3-3dc0-4ea4-a51a-244725b2cd9b] succeeded in 1.6118063690000781s: None
2024-02-24T00:34:02.064111846Z [2024-02-24 00:34:02,063: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:34:02.067601083Z [2024-02-24 00:34:02,066: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:34:02.090862726Z [2024-02-24 00:34:02,090: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:34:02.092313618Z [2024-02-24 00:34:02,092: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:34:02.092325793Z [2024-02-24 00:34:02,092: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:34:02.092476418Z [2024-02-24 00:34:02,092: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:34:02.092546209Z [2024-02-24 00:34:02,092: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:34:02.093071107Z [2024-02-24 00:34:02,092: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:34:02.093077131Z [2024-02-24 00:34:02,093: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:34:02.198597665Z [2024-02-24 00:34:02,198: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:34:02.233559722Z [2024-02-24 00:34:02,233: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:34:02.236823308Z [2024-02-24 00:34:02,236: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:34:02.260803263Z [2024-02-24 00:34:02,260: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:34:02.262896989Z [2024-02-24 00:34:02,262: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:34:02.262920717Z [2024-02-24 00:34:02,262: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:34:02.263160432Z [2024-02-24 00:34:02,262: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:34:02.263257772Z [2024-02-24 00:34:02,263: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:34:02.263632439Z [2024-02-24 00:34:02,263: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:34:02.263780534Z [2024-02-24 00:34:02,263: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:34:02.345396284Z [2024-02-24 00:34:02,345: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:34:04.151983276Z [2024-02-24 00:34:04,151: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[36cc824e-87d6-4ee5-9a51-08ec474cf9ac] succeeded in 3.7824526110007355s: None
2024-02-24T00:34:04.302011771Z [2024-02-24 00:34:04,301: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5586a83a-b96e-41a9-a776-80474d0be9e1] succeeded in 3.914004117999866s: None
2024-02-24T00:35:00.868209800Z [2024-02-24 00:35:00,867: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f23b78f7-9909-41d8-bbb7-1251abdb8c02] received
2024-02-24T00:35:00.873274486Z [2024-02-24 00:35:00,872: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83fcfb18-436c-4741-93cf-3bbed281945e] received
2024-02-24T00:35:00.875444881Z [2024-02-24 00:35:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aebef7ca-9e4d-451f-bcce-3db8d2479917] received
2024-02-24T00:35:00.877453841Z [2024-02-24 00:35:00,877: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[966ea85a-b889-4c85-b8b4-0e8e0fc506d2] received
2024-02-24T00:35:00.883378199Z [2024-02-24 00:35:00,881: INFO/ForkPoolWorker-15] [f23b78f7-9909-41d8-bbb7-1251abdb8c02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:35:00.889438501Z [2024-02-24 00:35:00,889: INFO/ForkPoolWorker-2] [966ea85a-b889-4c85-b8b4-0e8e0fc506d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:35:00.893455859Z [2024-02-24 00:35:00,893: INFO/ForkPoolWorker-1] [aebef7ca-9e4d-451f-bcce-3db8d2479917] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:35:00.896693300Z [2024-02-24 00:35:00,896: INFO/ForkPoolWorker-16] [83fcfb18-436c-4741-93cf-3bbed281945e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:35:01.210182694Z [2024-02-24 00:35:01,203: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:35:01.291698685Z [2024-02-24 00:35:01,279: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:35:01.379212644Z [2024-02-24 00:35:01,374: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:35:01.471979433Z [2024-02-24 00:35:01,471: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T00:35:01.476226574Z [2024-02-24 00:35:01,475: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:01.516376993Z [2024-02-24 00:35:01,516: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:35:01.518113364Z [2024-02-24 00:35:01,517: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:35:01.518498358Z [2024-02-24 00:35:01,518: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:35:01.518824438Z [2024-02-24 00:35:01,518: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T00:35:01.519208921Z [2024-02-24 00:35:01,519: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:35:01.564929076Z [2024-02-24 00:35:01,561: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:35:01.711038658Z [2024-02-24 00:35:01,710: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:02.588438304Z [2024-02-24 00:35:02,587: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[966ea85a-b889-4c85-b8b4-0e8e0fc506d2] succeeded in 1.7089937399996415s: None
2024-02-24T00:35:03.218581201Z [2024-02-24 00:35:03,218: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:35:03.224829988Z [2024-02-24 00:35:03,224: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:03.274856549Z [2024-02-24 00:35:03,274: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:35:03.281884332Z [2024-02-24 00:35:03,281: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:03.281946512Z [2024-02-24 00:35:03,281: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:03.282101528Z [2024-02-24 00:35:03,281: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:03.282150770Z [2024-02-24 00:35:03,282: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:35:03.282547462Z [2024-02-24 00:35:03,282: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:35:03.282600954Z [2024-02-24 00:35:03,282: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:03.361893862Z [2024-02-24 00:35:03,361: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:35:03.365666912Z [2024-02-24 00:35:03,365: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:03.383814731Z [2024-02-24 00:35:03,383: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:03.387229218Z [2024-02-24 00:35:03,386: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:35:03.388637603Z [2024-02-24 00:35:03,388: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:03.388707181Z [2024-02-24 00:35:03,388: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:03.388863732Z [2024-02-24 00:35:03,388: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:03.388996185Z [2024-02-24 00:35:03,388: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:35:03.389590429Z [2024-02-24 00:35:03,389: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:35:03.389621911Z [2024-02-24 00:35:03,389: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:03.546042743Z [2024-02-24 00:35:03,543: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:03.853852251Z [2024-02-24 00:35:03,853: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:35:03.865883690Z [2024-02-24 00:35:03,864: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:03.914795321Z [2024-02-24 00:35:03,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:35:03.916268953Z [2024-02-24 00:35:03,915: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:03.916285046Z [2024-02-24 00:35:03,916: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:03.916528463Z [2024-02-24 00:35:03,916: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:03.916651563Z [2024-02-24 00:35:03,916: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:35:03.916996624Z [2024-02-24 00:35:03,916: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:35:03.917570177Z [2024-02-24 00:35:03,916: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:04.075350005Z [2024-02-24 00:35:04,075: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:04.277304487Z [2024-02-24 00:35:04,276: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83fcfb18-436c-4741-93cf-3bbed281945e] succeeded in 3.4000759840000683s: None
2024-02-24T00:35:05.086688377Z [2024-02-24 00:35:05,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[399e0c34-ab8a-4649-924a-3bf1ff355f45] received
2024-02-24T00:35:05.094228190Z [2024-02-24 00:35:05,093: INFO/ForkPoolWorker-16] [399e0c34-ab8a-4649-924a-3bf1ff355f45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:35:05.261383783Z [2024-02-24 00:35:05,260: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f23b78f7-9909-41d8-bbb7-1251abdb8c02] succeeded in 4.3902714289997675s: None
2024-02-24T00:35:05.383821261Z [2024-02-24 00:35:05,380: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:35:05.888754000Z [2024-02-24 00:35:05,888: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aebef7ca-9e4d-451f-bcce-3db8d2479917] succeeded in 5.009926417000315s: None
2024-02-24T00:35:06.555819346Z [2024-02-24 00:35:06,555: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:35:06.559296917Z [2024-02-24 00:35:06,558: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:06.581617334Z [2024-02-24 00:35:06,581: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:35:06.583793439Z [2024-02-24 00:35:06,583: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:06.583815516Z [2024-02-24 00:35:06,583: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:06.584094188Z [2024-02-24 00:35:06,583: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:06.584139035Z [2024-02-24 00:35:06,584: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:35:06.584552698Z [2024-02-24 00:35:06,584: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:35:06.584723289Z [2024-02-24 00:35:06,584: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:06.681845811Z [2024-02-24 00:35:06,681: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:07.324140749Z [2024-02-24 00:35:07,323: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[399e0c34-ab8a-4649-924a-3bf1ff355f45] succeeded in 2.234312677000162s: None
2024-02-24T00:35:07.569823886Z [2024-02-24 00:35:07,569: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03011895-89ba-4674-b1af-4287424d0f9e] received
2024-02-24T00:35:07.584397026Z [2024-02-24 00:35:07,584: INFO/ForkPoolWorker-15] [03011895-89ba-4674-b1af-4287424d0f9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:35:07.866631600Z [2024-02-24 00:35:07,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:35:08.940188172Z [2024-02-24 00:35:08,939: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:35:08.943466399Z [2024-02-24 00:35:08,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:08.964026984Z [2024-02-24 00:35:08,963: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:35:08.965765483Z [2024-02-24 00:35:08,965: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:08.965882636Z [2024-02-24 00:35:08,965: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:08.966159566Z [2024-02-24 00:35:08,965: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:08.966285459Z [2024-02-24 00:35:08,966: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:35:08.966643234Z [2024-02-24 00:35:08,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:35:08.966739450Z [2024-02-24 00:35:08,966: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:09.062104377Z [2024-02-24 00:35:09,061: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:09.670508124Z [2024-02-24 00:35:09,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03011895-89ba-4674-b1af-4287424d0f9e] succeeded in 2.0970688970000992s: None
2024-02-24T00:35:10.733357669Z [2024-02-24 00:35:10,733: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dc5f884-9789-4396-b63d-88d53b71e1de] received
2024-02-24T00:35:10.747959092Z [2024-02-24 00:35:10,747: INFO/ForkPoolWorker-15] [5dc5f884-9789-4396-b63d-88d53b71e1de] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:35:11.039165007Z [2024-02-24 00:35:11,035: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:35:12.148786396Z [2024-02-24 00:35:12,148: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:35:12.152176677Z [2024-02-24 00:35:12,151: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:35:12.175839484Z [2024-02-24 00:35:12,175: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:35:12.177759944Z [2024-02-24 00:35:12,177: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:35:12.177965853Z [2024-02-24 00:35:12,177: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:35:12.178198456Z [2024-02-24 00:35:12,177: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:35:12.178287975Z [2024-02-24 00:35:12,178: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:35:12.178680201Z [2024-02-24 00:35:12,178: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:35:12.178739652Z [2024-02-24 00:35:12,178: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:35:12.270582109Z [2024-02-24 00:35:12,270: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:35:12.944327396Z [2024-02-24 00:35:12,943: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5dc5f884-9789-4396-b63d-88d53b71e1de] succeeded in 2.2060425620002206s: None
2024-02-24T00:36:01.308504879Z [2024-02-24 00:36:01,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41f77b84-997f-49ad-b0af-8b56670153bf] received
2024-02-24T00:36:01.311122939Z [2024-02-24 00:36:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[100fe654-059b-423b-8abb-42b5e74073a0] received
2024-02-24T00:36:01.321249210Z [2024-02-24 00:36:01,320: INFO/ForkPoolWorker-15] [41f77b84-997f-49ad-b0af-8b56670153bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:36:01.326157887Z [2024-02-24 00:36:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[261c759e-ee54-46c9-b829-f8e5ff691f0b] received
2024-02-24T00:36:01.330797273Z [2024-02-24 00:36:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f77624a-f18e-4a15-96bb-1eab405b0f3d] received
2024-02-24T00:36:01.336072862Z [2024-02-24 00:36:01,335: INFO/ForkPoolWorker-16] [100fe654-059b-423b-8abb-42b5e74073a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:36:01.338502582Z [2024-02-24 00:36:01,338: INFO/ForkPoolWorker-1] [261c759e-ee54-46c9-b829-f8e5ff691f0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:36:01.343359713Z [2024-02-24 00:36:01,343: INFO/ForkPoolWorker-2] [3f77624a-f18e-4a15-96bb-1eab405b0f3d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:36:01.708348612Z [2024-02-24 00:36:01,704: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:36:01.728261600Z [2024-02-24 00:36:01,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:36:01.802299904Z [2024-02-24 00:36:01,798: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:36:01.807886925Z [2024-02-24 00:36:01,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:36:01.920249983Z [2024-02-24 00:36:01,919: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:36:01.924398954Z [2024-02-24 00:36:01,923: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:36:01.962470004Z [2024-02-24 00:36:01,962: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:36:01.964060500Z [2024-02-24 00:36:01,963: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:36:01.964557632Z [2024-02-24 00:36:01,964: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:36:01.964684261Z [2024-02-24 00:36:01,964: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:36:01.965286346Z [2024-02-24 00:36:01,965: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:36:02.061911828Z [2024-02-24 00:36:02,061: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:36:02.114801332Z [2024-02-24 00:36:02,114: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:36:02.868646529Z [2024-02-24 00:36:02,868: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[261c759e-ee54-46c9-b829-f8e5ff691f0b] succeeded in 1.5378526229997078s: None
2024-02-24T00:36:02.881092288Z [2024-02-24 00:36:02,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[41f77b84-997f-49ad-b0af-8b56670153bf] succeeded in 1.56834953499947s: None
2024-02-24T00:36:03.234989774Z [2024-02-24 00:36:03,234: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:36:03.238925857Z [2024-02-24 00:36:03,238: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:36:03.244133687Z [2024-02-24 00:36:03,243: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:36:03.247528128Z [2024-02-24 00:36:03,247: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:36:03.267636570Z [2024-02-24 00:36:03,267: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:36:03.269235177Z [2024-02-24 00:36:03,268: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:36:03.269255423Z [2024-02-24 00:36:03,269: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:36:03.269440098Z [2024-02-24 00:36:03,269: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:36:03.269667136Z [2024-02-24 00:36:03,269: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:36:03.270036556Z [2024-02-24 00:36:03,269: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:36:03.270309222Z [2024-02-24 00:36:03,269: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:36:03.271317781Z [2024-02-24 00:36:03,271: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:36:03.272491215Z [2024-02-24 00:36:03,272: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:36:03.272591856Z [2024-02-24 00:36:03,272: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:36:03.272767739Z [2024-02-24 00:36:03,272: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:36:03.272846665Z [2024-02-24 00:36:03,272: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:36:03.273127881Z [2024-02-24 00:36:03,272: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:36:03.273176083Z [2024-02-24 00:36:03,273: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:36:03.350390900Z [2024-02-24 00:36:03,350: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:36:03.362322776Z [2024-02-24 00:36:03,361: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:36:05.904867307Z [2024-02-24 00:36:05,904: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[100fe654-059b-423b-8abb-42b5e74073a0] succeeded in 4.582447405000494s: None
2024-02-24T00:36:06.606474482Z [2024-02-24 00:36:06,605: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3f77624a-f18e-4a15-96bb-1eab405b0f3d] succeeded in 5.271708520000175s: None
2024-02-24T00:37:00.541523067Z [2024-02-24 00:37:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79056a6b-f8f6-4cf3-927a-6ec80713b667] received
2024-02-24T00:37:00.546455930Z [2024-02-24 00:37:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c04ad19a-baba-47a6-9a1d-6834fb15a3d9] received
2024-02-24T00:37:00.552620851Z [2024-02-24 00:37:00,552: INFO/ForkPoolWorker-15] [79056a6b-f8f6-4cf3-927a-6ec80713b667] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:37:00.557015106Z [2024-02-24 00:37:00,556: INFO/ForkPoolWorker-16] [c04ad19a-baba-47a6-9a1d-6834fb15a3d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:37:00.557115444Z [2024-02-24 00:37:00,556: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14264fc5-caf4-4c23-b349-1dee783df54e] received
2024-02-24T00:37:00.567294647Z [2024-02-24 00:37:00,567: INFO/ForkPoolWorker-1] [14264fc5-caf4-4c23-b349-1dee783df54e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:37:00.842400994Z [2024-02-24 00:37:00,839: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:37:00.892651960Z [2024-02-24 00:37:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:37:00.930944503Z [2024-02-24 00:37:00,927: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:37:01.043331162Z [2024-02-24 00:37:01,042: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:37:01.049064265Z [2024-02-24 00:37:01,048: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:37:01.072312971Z [2024-02-24 00:37:01,072: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:37:01.073569142Z [2024-02-24 00:37:01,073: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:37:01.073940083Z [2024-02-24 00:37:01,073: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:37:01.074065271Z [2024-02-24 00:37:01,073: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:37:01.074275783Z [2024-02-24 00:37:01,074: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:37:01.161817909Z [2024-02-24 00:37:01,161: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:37:01.803944981Z [2024-02-24 00:37:01,803: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c04ad19a-baba-47a6-9a1d-6834fb15a3d9] succeeded in 1.2556437929997628s: None
2024-02-24T00:37:02.073666924Z [2024-02-24 00:37:02,073: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:37:02.077141987Z [2024-02-24 00:37:02,076: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:37:02.104437555Z [2024-02-24 00:37:02,104: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:37:02.105889819Z [2024-02-24 00:37:02,105: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:37:02.106045185Z [2024-02-24 00:37:02,105: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:37:02.106239722Z [2024-02-24 00:37:02,105: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:37:02.106347167Z [2024-02-24 00:37:02,106: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:37:02.106692653Z [2024-02-24 00:37:02,106: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:37:02.106738886Z [2024-02-24 00:37:02,106: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:37:02.190363221Z [2024-02-24 00:37:02,190: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:37:02.193923485Z [2024-02-24 00:37:02,193: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:37:02.197101454Z [2024-02-24 00:37:02,196: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:37:02.216693973Z [2024-02-24 00:37:02,216: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:37:02.218893864Z [2024-02-24 00:37:02,218: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:37:02.218908190Z [2024-02-24 00:37:02,218: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:37:02.219087410Z [2024-02-24 00:37:02,218: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:37:02.219104508Z [2024-02-24 00:37:02,218: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:37:02.219316656Z [2024-02-24 00:37:02,219: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:37:02.219325600Z [2024-02-24 00:37:02,219: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:37:02.316344207Z [2024-02-24 00:37:02,316: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:37:04.112032204Z [2024-02-24 00:37:04,111: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[79056a6b-f8f6-4cf3-927a-6ec80713b667] succeeded in 3.563936024999748s: None
2024-02-24T00:37:04.952861638Z [2024-02-24 00:37:04,952: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[14264fc5-caf4-4c23-b349-1dee783df54e] succeeded in 4.391733890000069s: None
2024-02-24T00:38:01.025898602Z [2024-02-24 00:38:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b2fcc23-f96a-43fa-a369-ae3a83c06664] received
2024-02-24T00:38:01.042751419Z [2024-02-24 00:38:01,042: INFO/ForkPoolWorker-15] [2b2fcc23-f96a-43fa-a369-ae3a83c06664] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:38:01.042782391Z [2024-02-24 00:38:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae2a734b-f967-4ae9-9c82-a8cd63d4eb10] received
2024-02-24T00:38:01.054287907Z [2024-02-24 00:38:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ef2883e-a791-4ec9-be21-a49cbd6d9430] received
2024-02-24T00:38:01.057688295Z [2024-02-24 00:38:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[40702f8d-713e-4d36-b4ab-2b20880aa1a8] received
2024-02-24T00:38:01.058733355Z [2024-02-24 00:38:01,058: INFO/ForkPoolWorker-16] [ae2a734b-f967-4ae9-9c82-a8cd63d4eb10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:38:01.078819382Z [2024-02-24 00:38:01,078: INFO/ForkPoolWorker-1] [6ef2883e-a791-4ec9-be21-a49cbd6d9430] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:38:01.109833958Z [2024-02-24 00:38:01,109: INFO/ForkPoolWorker-2] [40702f8d-713e-4d36-b4ab-2b20880aa1a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:38:01.434281017Z [2024-02-24 00:38:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:38:01.469824732Z [2024-02-24 00:38:01,466: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:38:01.555452685Z [2024-02-24 00:38:01,551: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:38:01.578487222Z [2024-02-24 00:38:01,574: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:38:01.733480895Z [2024-02-24 00:38:01,733: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:38:01.739838457Z [2024-02-24 00:38:01,739: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:38:01.766784505Z [2024-02-24 00:38:01,766: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:38:01.770930929Z [2024-02-24 00:38:01,770: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:38:01.771017654Z [2024-02-24 00:38:01,770: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:38:01.771128593Z [2024-02-24 00:38:01,770: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:38:01.771386590Z [2024-02-24 00:38:01,771: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:38:01.870702336Z [2024-02-24 00:38:01,870: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:38:01.899087238Z [2024-02-24 00:38:01,898: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:38:02.538747055Z [2024-02-24 00:38:02,538: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2b2fcc23-f96a-43fa-a369-ae3a83c06664] succeeded in 1.509138202000031s: None
2024-02-24T00:38:02.543411431Z [2024-02-24 00:38:02,543: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ef2883e-a791-4ec9-be21-a49cbd6d9430] succeeded in 1.4878806169999734s: None
2024-02-24T00:38:03.040102201Z [2024-02-24 00:38:03,038: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:38:03.044418178Z [2024-02-24 00:38:03,043: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:38:03.072220962Z [2024-02-24 00:38:03,071: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:38:03.074726601Z [2024-02-24 00:38:03,074: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:38:03.075122837Z [2024-02-24 00:38:03,074: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:38:03.075668586Z [2024-02-24 00:38:03,075: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:38:03.076128671Z [2024-02-24 00:38:03,075: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:38:03.076944547Z [2024-02-24 00:38:03,076: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:38:03.077272737Z [2024-02-24 00:38:03,077: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:38:03.169446893Z [2024-02-24 00:38:03,168: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:38:03.177440363Z [2024-02-24 00:38:03,177: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:38:03.181145447Z [2024-02-24 00:38:03,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:38:03.205658366Z [2024-02-24 00:38:03,205: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:38:03.207234417Z [2024-02-24 00:38:03,207: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:38:03.207365227Z [2024-02-24 00:38:03,207: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:38:03.207513425Z [2024-02-24 00:38:03,207: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:38:03.209041986Z [2024-02-24 00:38:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:38:03.209306605Z [2024-02-24 00:38:03,209: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:38:03.209750200Z [2024-02-24 00:38:03,209: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:38:03.297928616Z [2024-02-24 00:38:03,297: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:38:05.120797529Z [2024-02-24 00:38:05,120: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[40702f8d-713e-4d36-b4ab-2b20880aa1a8] succeeded in 4.056677220999518s: None
2024-02-24T00:38:05.880588590Z [2024-02-24 00:38:05,879: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ae2a734b-f967-4ae9-9c82-a8cd63d4eb10] succeeded in 4.836028365999482s: None
2024-02-24T00:39:00.626564794Z [2024-02-24 00:39:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bcb68817-9582-4d8e-8e96-47833bfd10c0] received
2024-02-24T00:39:00.629338309Z [2024-02-24 00:39:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85e2fc53-28b5-4dab-83b7-2700566c9820] received
2024-02-24T00:39:00.643765109Z [2024-02-24 00:39:00,643: INFO/ForkPoolWorker-15] [bcb68817-9582-4d8e-8e96-47833bfd10c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:39:00.645638241Z [2024-02-24 00:39:00,645: INFO/ForkPoolWorker-16] [85e2fc53-28b5-4dab-83b7-2700566c9820] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:39:00.654719223Z [2024-02-24 00:39:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc5e16eb-bb8a-45d3-85e6-855cafc08a8a] received
2024-02-24T00:39:00.669065128Z [2024-02-24 00:39:00,668: INFO/ForkPoolWorker-1] [dc5e16eb-bb8a-45d3-85e6-855cafc08a8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:39:01.017573636Z [2024-02-24 00:39:01,014: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:39:01.021170819Z [2024-02-24 00:39:01,017: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:39:01.053604682Z [2024-02-24 00:39:01,049: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:39:01.233201966Z [2024-02-24 00:39:01,232: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:39:01.241136197Z [2024-02-24 00:39:01,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:39:01.304505665Z [2024-02-24 00:39:01,304: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:39:01.305267232Z [2024-02-24 00:39:01,305: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:39:01.305339381Z [2024-02-24 00:39:01,305: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:39:01.305377387Z [2024-02-24 00:39:01,305: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:39:01.305471727Z [2024-02-24 00:39:01,305: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:39:01.451788447Z [2024-02-24 00:39:01,451: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:39:02.138188347Z [2024-02-24 00:39:02,137: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc5e16eb-bb8a-45d3-85e6-855cafc08a8a] succeeded in 1.4796604720004325s: None
2024-02-24T00:39:02.316230622Z [2024-02-24 00:39:02,315: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:39:02.319868281Z [2024-02-24 00:39:02,319: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:39:02.359115596Z [2024-02-24 00:39:02,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:39:02.362754654Z [2024-02-24 00:39:02,361: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:39:02.362771601Z [2024-02-24 00:39:02,361: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:39:02.362775740Z [2024-02-24 00:39:02,361: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:39:02.362779920Z [2024-02-24 00:39:02,361: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:39:02.362792298Z [2024-02-24 00:39:02,361: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:39:02.368117999Z [2024-02-24 00:39:02,362: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:39:02.459384058Z [2024-02-24 00:39:02,458: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:39:02.463212609Z [2024-02-24 00:39:02,462: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:39:02.482158981Z [2024-02-24 00:39:02,481: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:39:02.486447298Z [2024-02-24 00:39:02,486: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:39:02.486663232Z [2024-02-24 00:39:02,486: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:39:02.486902377Z [2024-02-24 00:39:02,486: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:39:02.487065064Z [2024-02-24 00:39:02,486: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:39:02.487570213Z [2024-02-24 00:39:02,487: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:39:02.487727110Z [2024-02-24 00:39:02,487: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:39:02.495047571Z [2024-02-24 00:39:02,494: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:39:02.600708980Z [2024-02-24 00:39:02,600: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:39:04.329472754Z [2024-02-24 00:39:04,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bcb68817-9582-4d8e-8e96-47833bfd10c0] succeeded in 3.6986023260005823s: None
2024-02-24T00:39:04.778245600Z [2024-02-24 00:39:04,777: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[85e2fc53-28b5-4dab-83b7-2700566c9820] succeeded in 4.144666802000756s: None
2024-02-24T00:40:00.759698431Z [2024-02-24 00:40:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af69f735-8475-4b9e-bb2c-c14d76e93d30] received
2024-02-24T00:40:00.762267201Z [2024-02-24 00:40:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0240e735-c5c9-4927-b545-54769d60163b] received
2024-02-24T00:40:00.769749361Z [2024-02-24 00:40:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41ee5c45-8f58-46cf-b76a-73e872c16e6b] received
2024-02-24T00:40:00.772111460Z [2024-02-24 00:40:00,771: INFO/ForkPoolWorker-15] [af69f735-8475-4b9e-bb2c-c14d76e93d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:40:00.779993252Z [2024-02-24 00:40:00,779: INFO/ForkPoolWorker-16] [0240e735-c5c9-4927-b545-54769d60163b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:40:00.782738817Z [2024-02-24 00:40:00,782: INFO/ForkPoolWorker-1] [41ee5c45-8f58-46cf-b76a-73e872c16e6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:40:00.788423143Z [2024-02-24 00:40:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f1b1508-daec-440e-ae25-783a8f601c6f] received
2024-02-24T00:40:00.800919937Z [2024-02-24 00:40:00,800: INFO/ForkPoolWorker-2] [2f1b1508-daec-440e-ae25-783a8f601c6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:40:00.800981199Z [2024-02-24 00:40:00,799: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94d331d4-36ef-4a56-9523-3cef739534c7] received
2024-02-24T00:40:00.822088874Z [2024-02-24 00:40:00,821: INFO/ForkPoolWorker-3] [94d331d4-36ef-4a56-9523-3cef739534c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:40:01.116774699Z [2024-02-24 00:40:01,113: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:40:01.395792348Z [2024-02-24 00:40:01,392: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:40:01.469239818Z [2024-02-24 00:40:01,468: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:01.594961931Z [2024-02-24 00:40:01,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:40:01.628931869Z [2024-02-24 00:40:01,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:40:01.637925717Z [2024-02-24 00:40:01,616: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:40:02.065127380Z [2024-02-24 00:40:02,064: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T00:40:02.072929666Z [2024-02-24 00:40:02,072: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:02.113165640Z [2024-02-24 00:40:02,112: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0240e735-c5c9-4927-b545-54769d60163b] succeeded in 1.346067542000128s: None
2024-02-24T00:40:02.129040635Z [2024-02-24 00:40:02,128: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:40:02.130664131Z [2024-02-24 00:40:02,130: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:40:02.130847608Z [2024-02-24 00:40:02,130: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:40:02.131023308Z [2024-02-24 00:40:02,130: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T00:40:02.131335694Z [2024-02-24 00:40:02,131: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:40:02.294878560Z [2024-02-24 00:40:02,294: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:03.055509998Z [2024-02-24 00:40:03,055: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[94d331d4-36ef-4a56-9523-3cef739534c7] succeeded in 2.251404493999871s: None
2024-02-24T00:40:03.059397007Z [2024-02-24 00:40:03,059: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:40:03.062743246Z [2024-02-24 00:40:03,062: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:03.080583587Z [2024-02-24 00:40:03,080: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:40:03.081883737Z [2024-02-24 00:40:03,081: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:03.082066027Z [2024-02-24 00:40:03,081: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:03.082227214Z [2024-02-24 00:40:03,082: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:03.082289310Z [2024-02-24 00:40:03,082: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:40:03.082594986Z [2024-02-24 00:40:03,082: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:40:03.082639336Z [2024-02-24 00:40:03,082: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:03.160367421Z [2024-02-24 00:40:03,160: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:03.260803823Z [2024-02-24 00:40:03,260: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:40:03.264300832Z [2024-02-24 00:40:03,263: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:03.284544206Z [2024-02-24 00:40:03,284: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:40:03.285857845Z [2024-02-24 00:40:03,285: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:03.285993275Z [2024-02-24 00:40:03,285: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:03.286177790Z [2024-02-24 00:40:03,285: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:03.286276059Z [2024-02-24 00:40:03,286: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:40:03.286625862Z [2024-02-24 00:40:03,286: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:40:03.286763447Z [2024-02-24 00:40:03,286: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:03.302714026Z [2024-02-24 00:40:03,302: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:40:03.306809522Z [2024-02-24 00:40:03,306: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:03.332535451Z [2024-02-24 00:40:03,331: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:40:03.334667788Z [2024-02-24 00:40:03,334: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:03.335176559Z [2024-02-24 00:40:03,334: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:03.335479190Z [2024-02-24 00:40:03,335: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:03.335669600Z [2024-02-24 00:40:03,335: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:40:03.336019981Z [2024-02-24 00:40:03,335: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:40:03.336205466Z [2024-02-24 00:40:03,336: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:03.379924099Z [2024-02-24 00:40:03,379: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:03.444688005Z [2024-02-24 00:40:03,444: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:04.189134830Z [2024-02-24 00:40:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af69f735-8475-4b9e-bb2c-c14d76e93d30] succeeded in 3.425747517999298s: None
2024-02-24T00:40:04.721537014Z [2024-02-24 00:40:04,721: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bab5de6a-bb27-45e3-b60d-ad5d53786e7a] received
2024-02-24T00:40:04.732168219Z [2024-02-24 00:40:04,731: INFO/ForkPoolWorker-15] [bab5de6a-bb27-45e3-b60d-ad5d53786e7a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:40:04.867101224Z [2024-02-24 00:40:04,866: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2f1b1508-daec-440e-ae25-783a8f601c6f] succeeded in 4.073350847999791s: None
2024-02-24T00:40:05.016753905Z [2024-02-24 00:40:05,013: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:40:05.271542324Z [2024-02-24 00:40:05,270: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41ee5c45-8f58-46cf-b76a-73e872c16e6b] succeeded in 4.500170393999724s: None
2024-02-24T00:40:06.194662798Z [2024-02-24 00:40:06,194: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:40:06.198050580Z [2024-02-24 00:40:06,197: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:06.216299664Z [2024-02-24 00:40:06,216: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:40:06.217658217Z [2024-02-24 00:40:06,217: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:06.217672922Z [2024-02-24 00:40:06,217: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:06.217888157Z [2024-02-24 00:40:06,217: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:06.218023221Z [2024-02-24 00:40:06,217: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:40:06.218181658Z [2024-02-24 00:40:06,217: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:40:06.218354150Z [2024-02-24 00:40:06,218: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:06.311066658Z [2024-02-24 00:40:06,310: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:06.911318251Z [2024-02-24 00:40:06,910: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bab5de6a-bb27-45e3-b60d-ad5d53786e7a] succeeded in 2.187404990999312s: None
2024-02-24T00:40:07.624410444Z [2024-02-24 00:40:07,624: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75f73205-403f-4cb6-91ab-cc325332da24] received
2024-02-24T00:40:07.630790163Z [2024-02-24 00:40:07,630: INFO/ForkPoolWorker-15] [75f73205-403f-4cb6-91ab-cc325332da24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:40:07.912951933Z [2024-02-24 00:40:07,909: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:40:09.063582729Z [2024-02-24 00:40:09,063: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:40:09.067067717Z [2024-02-24 00:40:09,066: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:09.087311626Z [2024-02-24 00:40:09,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:40:09.088684699Z [2024-02-24 00:40:09,088: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:09.088700328Z [2024-02-24 00:40:09,088: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:09.088796912Z [2024-02-24 00:40:09,088: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:09.088846580Z [2024-02-24 00:40:09,088: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:40:09.089185131Z [2024-02-24 00:40:09,088: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:40:09.089196599Z [2024-02-24 00:40:09,089: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:09.188421849Z [2024-02-24 00:40:09,187: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:09.802199747Z [2024-02-24 00:40:09,801: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75f73205-403f-4cb6-91ab-cc325332da24] succeeded in 2.175937164000061s: None
2024-02-24T00:40:09.835795245Z [2024-02-24 00:40:09,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[273ab6c8-ae71-45a4-acc0-afb8fa788ca4] received
2024-02-24T00:40:09.843317001Z [2024-02-24 00:40:09,842: INFO/ForkPoolWorker-15] [273ab6c8-ae71-45a4-acc0-afb8fa788ca4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:40:10.146552684Z [2024-02-24 00:40:10,143: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:40:11.268622116Z [2024-02-24 00:40:11,268: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:40:11.285083365Z [2024-02-24 00:40:11,283: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:40:11.304626131Z [2024-02-24 00:40:11,304: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:40:11.306047698Z [2024-02-24 00:40:11,305: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:40:11.306148440Z [2024-02-24 00:40:11,305: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:40:11.306273804Z [2024-02-24 00:40:11,306: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:40:11.306342740Z [2024-02-24 00:40:11,306: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:40:11.306589696Z [2024-02-24 00:40:11,306: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:40:11.306680231Z [2024-02-24 00:40:11,306: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:40:11.385737156Z [2024-02-24 00:40:11,385: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:40:11.946239807Z [2024-02-24 00:40:11,945: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[273ab6c8-ae71-45a4-acc0-afb8fa788ca4] succeeded in 2.1087517910000315s: None
2024-02-24T00:41:00.811793014Z [2024-02-24 00:41:00,811: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5092713-ed74-467b-a1fd-0def882e5bc8] received
2024-02-24T00:41:00.814310914Z [2024-02-24 00:41:00,814: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dad37fe5-98cf-45be-9b8c-791141ddd3ac] received
2024-02-24T00:41:00.823763725Z [2024-02-24 00:41:00,823: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21bf8e85-35e6-4534-af6f-6778996cf0b1] received
2024-02-24T00:41:00.824382685Z [2024-02-24 00:41:00,824: INFO/ForkPoolWorker-16] [dad37fe5-98cf-45be-9b8c-791141ddd3ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:41:00.832091548Z [2024-02-24 00:41:00,831: INFO/ForkPoolWorker-15] [e5092713-ed74-467b-a1fd-0def882e5bc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:41:00.832840918Z [2024-02-24 00:41:00,832: INFO/ForkPoolWorker-1] [21bf8e85-35e6-4534-af6f-6778996cf0b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:41:01.180329625Z [2024-02-24 00:41:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:41:01.349419186Z [2024-02-24 00:41:01,345: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:41:01.428155766Z [2024-02-24 00:41:01,425: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:41:01.439329164Z [2024-02-24 00:41:01,438: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:41:01.443342765Z [2024-02-24 00:41:01,442: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:41:01.471196587Z [2024-02-24 00:41:01,470: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:41:01.472238922Z [2024-02-24 00:41:01,472: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:41:01.472376062Z [2024-02-24 00:41:01,472: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:41:01.472425632Z [2024-02-24 00:41:01,472: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:41:01.472642215Z [2024-02-24 00:41:01,472: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:41:01.591919610Z [2024-02-24 00:41:01,591: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:41:02.320172953Z [2024-02-24 00:41:02,319: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5092713-ed74-467b-a1fd-0def882e5bc8] succeeded in 1.5049435460005043s: None
2024-02-24T00:41:02.611089803Z [2024-02-24 00:41:02,610: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:41:02.614559523Z [2024-02-24 00:41:02,614: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:41:02.623521213Z [2024-02-24 00:41:02,622: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:41:02.634547606Z [2024-02-24 00:41:02,633: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:41:02.651641731Z [2024-02-24 00:41:02,651: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:41:02.652798806Z [2024-02-24 00:41:02,652: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:41:02.652832031Z [2024-02-24 00:41:02,652: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:41:02.652928178Z [2024-02-24 00:41:02,652: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:41:02.652959287Z [2024-02-24 00:41:02,652: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:41:02.653179391Z [2024-02-24 00:41:02,653: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:41:02.653213948Z [2024-02-24 00:41:02,653: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:41:02.716296370Z [2024-02-24 00:41:02,716: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:41:02.718448076Z [2024-02-24 00:41:02,718: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:41:02.718762098Z [2024-02-24 00:41:02,718: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:41:02.719025012Z [2024-02-24 00:41:02,718: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:41:02.719195044Z [2024-02-24 00:41:02,718: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:41:02.719623952Z [2024-02-24 00:41:02,719: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:41:02.719958714Z [2024-02-24 00:41:02,719: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:41:02.807956107Z [2024-02-24 00:41:02,807: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:41:02.822550324Z [2024-02-24 00:41:02,822: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:41:04.297180387Z [2024-02-24 00:41:04,296: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dad37fe5-98cf-45be-9b8c-791141ddd3ac] succeeded in 3.480038937000245s: None
2024-02-24T00:41:04.761047535Z [2024-02-24 00:41:04,760: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[21bf8e85-35e6-4534-af6f-6778996cf0b1] succeeded in 3.93496466400029s: None
2024-02-24T00:42:00.272810076Z [2024-02-24 00:42:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3495e815-3cea-49f6-979c-a76c378a92bc] received
2024-02-24T00:42:00.277791172Z [2024-02-24 00:42:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5dbcbbad-fdee-4a84-a785-759de7bb8c44] received
2024-02-24T00:42:00.280714658Z [2024-02-24 00:42:00,280: INFO/ForkPoolWorker-15] [3495e815-3cea-49f6-979c-a76c378a92bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:42:00.281848544Z [2024-02-24 00:42:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ace5121-adc9-454a-926e-d724ac54f9b3] received
2024-02-24T00:42:00.285672221Z [2024-02-24 00:42:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[746858d2-b454-426c-9a92-812df06ff87d] received
2024-02-24T00:42:00.296188393Z [2024-02-24 00:42:00,295: INFO/ForkPoolWorker-2] [746858d2-b454-426c-9a92-812df06ff87d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:42:00.296770641Z [2024-02-24 00:42:00,296: INFO/ForkPoolWorker-1] [1ace5121-adc9-454a-926e-d724ac54f9b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:42:00.297281627Z [2024-02-24 00:42:00,297: INFO/ForkPoolWorker-16] [5dbcbbad-fdee-4a84-a785-759de7bb8c44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:42:00.588464799Z [2024-02-24 00:42:00,582: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:42:00.588484796Z [2024-02-24 00:42:00,583: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:42:00.705039853Z [2024-02-24 00:42:00,701: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:42:00.751552595Z [2024-02-24 00:42:00,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:42:00.871746793Z [2024-02-24 00:42:00,871: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:42:00.875986402Z [2024-02-24 00:42:00,875: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:42:00.949373036Z [2024-02-24 00:42:00,949: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:42:00.955616234Z [2024-02-24 00:42:00,955: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:42:00.962184485Z [2024-02-24 00:42:00,961: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:42:00.962418486Z [2024-02-24 00:42:00,962: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:42:00.962770754Z [2024-02-24 00:42:00,962: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:42:01.072251084Z [2024-02-24 00:42:01,071: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:42:01.288357329Z [2024-02-24 00:42:01,288: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:42:01.965683938Z [2024-02-24 00:42:01,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3495e815-3cea-49f6-979c-a76c378a92bc] succeeded in 1.6902411109995228s: None
2024-02-24T00:42:02.053002100Z [2024-02-24 00:42:02,052: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1ace5121-adc9-454a-926e-d724ac54f9b3] succeeded in 1.7664578730000358s: None
2024-02-24T00:42:02.308135219Z [2024-02-24 00:42:02,307: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:42:02.311999093Z [2024-02-24 00:42:02,311: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:42:02.333156029Z [2024-02-24 00:42:02,332: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:42:02.334765316Z [2024-02-24 00:42:02,334: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:42:02.334963504Z [2024-02-24 00:42:02,334: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:42:02.335253576Z [2024-02-24 00:42:02,334: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:42:02.335458325Z [2024-02-24 00:42:02,335: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:42:02.335789355Z [2024-02-24 00:42:02,335: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:42:02.335948193Z [2024-02-24 00:42:02,335: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:42:02.381887096Z [2024-02-24 00:42:02,376: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:42:02.390193340Z [2024-02-24 00:42:02,381: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:42:02.421058963Z [2024-02-24 00:42:02,420: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:42:02.422481773Z [2024-02-24 00:42:02,422: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:42:02.422525831Z [2024-02-24 00:42:02,422: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:42:02.422734701Z [2024-02-24 00:42:02,422: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:42:02.422832001Z [2024-02-24 00:42:02,422: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:42:02.423104332Z [2024-02-24 00:42:02,422: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:42:02.423232324Z [2024-02-24 00:42:02,423: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:42:02.449481560Z [2024-02-24 00:42:02,449: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:42:02.507062937Z [2024-02-24 00:42:02,506: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:42:04.090414930Z [2024-02-24 00:42:04,089: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5dbcbbad-fdee-4a84-a785-759de7bb8c44] succeeded in 3.8091258730000845s: None
2024-02-24T00:42:05.428701925Z [2024-02-24 00:42:05,428: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[746858d2-b454-426c-9a92-812df06ff87d] succeeded in 5.138983576000101s: None
2024-02-24T00:43:01.000856184Z [2024-02-24 00:43:01,000: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e5c88fc-9bce-403d-bbbe-57c75d6c6079] received
2024-02-24T00:43:01.007932368Z [2024-02-24 00:43:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a241ca53-f035-49a5-9d33-0f6efb6f0d30] received
2024-02-24T00:43:01.009978847Z [2024-02-24 00:43:01,009: INFO/ForkPoolWorker-15] [3e5c88fc-9bce-403d-bbbe-57c75d6c6079] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:43:01.017159868Z [2024-02-24 00:43:01,016: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e936ff9-634e-4bce-9504-29b685497d0d] received
2024-02-24T00:43:01.017331773Z [2024-02-24 00:43:01,016: INFO/ForkPoolWorker-16] [a241ca53-f035-49a5-9d33-0f6efb6f0d30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:43:01.042623506Z [2024-02-24 00:43:01,042: INFO/ForkPoolWorker-1] [0e936ff9-634e-4bce-9504-29b685497d0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:43:01.482236428Z [2024-02-24 00:43:01,478: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:43:01.486343255Z [2024-02-24 00:43:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:43:01.704973401Z [2024-02-24 00:43:01,701: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:43:01.717900618Z [2024-02-24 00:43:01,717: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:43:01.722170259Z [2024-02-24 00:43:01,721: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:43:01.759857871Z [2024-02-24 00:43:01,759: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:43:01.761514188Z [2024-02-24 00:43:01,761: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:43:01.761594954Z [2024-02-24 00:43:01,761: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:43:01.761745252Z [2024-02-24 00:43:01,761: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:43:01.762103775Z [2024-02-24 00:43:01,761: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:43:01.860307288Z [2024-02-24 00:43:01,860: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:43:02.558344025Z [2024-02-24 00:43:02,557: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e5c88fc-9bce-403d-bbbe-57c75d6c6079] succeeded in 1.555057990000023s: None
2024-02-24T00:43:02.841410180Z [2024-02-24 00:43:02,841: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:43:02.847605433Z [2024-02-24 00:43:02,847: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:43:02.882556251Z [2024-02-24 00:43:02,882: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:43:02.884291742Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:43:02.884322436Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:43:02.884490693Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:43:02.884566652Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:43:02.884873382Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:43:02.884927092Z [2024-02-24 00:43:02,884: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:43:02.994309599Z [2024-02-24 00:43:02,993: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:43:03.119020974Z [2024-02-24 00:43:03,118: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:43:03.122612232Z [2024-02-24 00:43:03,122: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:43:03.149542591Z [2024-02-24 00:43:03,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:43:03.151584961Z [2024-02-24 00:43:03,151: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:43:03.151886689Z [2024-02-24 00:43:03,151: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:43:03.152159402Z [2024-02-24 00:43:03,151: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:43:03.152330539Z [2024-02-24 00:43:03,152: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:43:03.152951537Z [2024-02-24 00:43:03,152: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:43:03.153141329Z [2024-02-24 00:43:03,152: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:43:03.250162446Z [2024-02-24 00:43:03,249: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:43:04.835031542Z [2024-02-24 00:43:04,834: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a241ca53-f035-49a5-9d33-0f6efb6f0d30] succeeded in 3.8239502480000738s: None
2024-02-24T00:43:05.229503771Z [2024-02-24 00:43:05,228: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0e936ff9-634e-4bce-9504-29b685497d0d] succeeded in 4.208938243000375s: None
2024-02-24T00:44:00.926429465Z [2024-02-24 00:44:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d14bb5a-8a16-4b63-b969-adc90b4ada7b] received
2024-02-24T00:44:00.929365597Z [2024-02-24 00:44:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61841a9f-9258-4d11-b3eb-74ce8d74dec1] received
2024-02-24T00:44:00.936831503Z [2024-02-24 00:44:00,936: INFO/ForkPoolWorker-16] [61841a9f-9258-4d11-b3eb-74ce8d74dec1] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:44:00.936870431Z [2024-02-24 00:44:00,936: INFO/ForkPoolWorker-15] [0d14bb5a-8a16-4b63-b969-adc90b4ada7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:44:00.941642479Z [2024-02-24 00:44:00,941: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5127e29-4c60-4004-89d0-58286913103f] received
2024-02-24T00:44:00.946949218Z [2024-02-24 00:44:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01e59077-81a1-495b-92c0-6f566035d1e2] received
2024-02-24T00:44:00.952008023Z [2024-02-24 00:44:00,951: INFO/ForkPoolWorker-1] [d5127e29-4c60-4004-89d0-58286913103f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:44:00.979525911Z [2024-02-24 00:44:00,979: INFO/ForkPoolWorker-2] [01e59077-81a1-495b-92c0-6f566035d1e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:44:01.329715212Z [2024-02-24 00:44:01,326: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:44:01.357193002Z [2024-02-24 00:44:01,353: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:44:01.396432509Z [2024-02-24 00:44:01,392: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:44:01.469744384Z [2024-02-24 00:44:01,465: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:44:01.616290521Z [2024-02-24 00:44:01,616: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:44:01.928880901Z [2024-02-24 00:44:01,928: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:44:01.937855066Z [2024-02-24 00:44:01,937: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:44:01.984967232Z [2024-02-24 00:44:01,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:44:01.989286993Z [2024-02-24 00:44:01,989: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:44:01.989469636Z [2024-02-24 00:44:01,989: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:44:01.989550990Z [2024-02-24 00:44:01,989: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:44:01.990161323Z [2024-02-24 00:44:01,989: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:44:02.109102642Z [2024-02-24 00:44:02,108: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:44:02.206948542Z [2024-02-24 00:44:02,206: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61841a9f-9258-4d11-b3eb-74ce8d74dec1] succeeded in 1.2765170969996689s: None
2024-02-24T00:44:02.928138262Z [2024-02-24 00:44:02,927: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d14bb5a-8a16-4b63-b969-adc90b4ada7b] succeeded in 1.9977321269998356s: None
2024-02-24T00:44:03.121678709Z [2024-02-24 00:44:03,121: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:44:03.125490187Z [2024-02-24 00:44:03,124: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:44:03.146928936Z [2024-02-24 00:44:03,146: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:44:03.148202698Z [2024-02-24 00:44:03,147: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:44:03.148229912Z [2024-02-24 00:44:03,148: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:44:03.148252447Z [2024-02-24 00:44:03,148: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:44:03.148342250Z [2024-02-24 00:44:03,148: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:44:03.148736381Z [2024-02-24 00:44:03,148: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:44:03.148751009Z [2024-02-24 00:44:03,148: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:44:03.175267605Z [2024-02-24 00:44:03,174: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:44:03.178572152Z [2024-02-24 00:44:03,178: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:44:03.205858925Z [2024-02-24 00:44:03,205: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:44:03.207506983Z [2024-02-24 00:44:03,207: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:44:03.207523343Z [2024-02-24 00:44:03,207: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:44:03.207716302Z [2024-02-24 00:44:03,207: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:44:03.207770289Z [2024-02-24 00:44:03,207: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:44:03.208112658Z [2024-02-24 00:44:03,207: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:44:03.208153661Z [2024-02-24 00:44:03,208: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:44:03.232999067Z [2024-02-24 00:44:03,232: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:44:03.305598839Z [2024-02-24 00:44:03,305: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:44:06.097246710Z [2024-02-24 00:44:06,096: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01e59077-81a1-495b-92c0-6f566035d1e2] succeeded in 5.146504590000404s: None
2024-02-24T00:44:06.371336450Z [2024-02-24 00:44:06,370: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d5127e29-4c60-4004-89d0-58286913103f] succeeded in 5.4244564159998845s: None
2024-02-24T00:45:01.064373884Z [2024-02-24 00:45:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02342830-24f4-475f-a9d0-6b235a389ab7] received
2024-02-24T00:45:01.069450341Z [2024-02-24 00:45:01,069: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24e9c14d-1c34-4e7f-9570-d1865408227b] received
2024-02-24T00:45:01.075794647Z [2024-02-24 00:45:01,075: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4221795a-9334-4b8d-abd2-860e87da9927] received
2024-02-24T00:45:01.078165575Z [2024-02-24 00:45:01,077: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aba452db-dc6d-41ea-b768-5050082f554a] received
2024-02-24T00:45:01.084498559Z [2024-02-24 00:45:01,084: INFO/ForkPoolWorker-1] [4221795a-9334-4b8d-abd2-860e87da9927] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:45:01.087731559Z [2024-02-24 00:45:01,087: INFO/ForkPoolWorker-2] [aba452db-dc6d-41ea-b768-5050082f554a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:45:01.088531541Z [2024-02-24 00:45:01,088: INFO/ForkPoolWorker-15] [02342830-24f4-475f-a9d0-6b235a389ab7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:45:01.089755998Z [2024-02-24 00:45:01,089: INFO/ForkPoolWorker-16] [24e9c14d-1c34-4e7f-9570-d1865408227b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:45:01.510158542Z [2024-02-24 00:45:01,506: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:45:01.511199261Z [2024-02-24 00:45:01,507: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:45:01.524504708Z [2024-02-24 00:45:01,521: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:45:01.628155391Z [2024-02-24 00:45:01,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:45:01.920228504Z [2024-02-24 00:45:01,915: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:45:01.929416051Z [2024-02-24 00:45:01,928: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:01.980637004Z [2024-02-24 00:45:01,980: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:45:01.982051837Z [2024-02-24 00:45:01,981: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:45:01.982144922Z [2024-02-24 00:45:01,982: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:45:01.982175820Z [2024-02-24 00:45:01,982: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:45:01.982640327Z [2024-02-24 00:45:01,982: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:45:02.121625649Z [2024-02-24 00:45:02,121: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:03.094077229Z [2024-02-24 00:45:03,093: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:45:03.095140105Z [2024-02-24 00:45:03,094: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4221795a-9334-4b8d-abd2-860e87da9927] succeeded in 2.017789749000258s: None
2024-02-24T00:45:03.099010697Z [2024-02-24 00:45:03,098: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:03.149172481Z [2024-02-24 00:45:03,148: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:45:03.151009138Z [2024-02-24 00:45:03,150: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:03.151060391Z [2024-02-24 00:45:03,150: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:03.151292060Z [2024-02-24 00:45:03,151: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:03.151330004Z [2024-02-24 00:45:03,151: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:45:03.151679159Z [2024-02-24 00:45:03,151: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:45:03.151769194Z [2024-02-24 00:45:03,151: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:03.164233666Z [2024-02-24 00:45:03,163: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:45:03.172396884Z [2024-02-24 00:45:03,171: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:03.221949963Z [2024-02-24 00:45:03,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:45:03.223637127Z [2024-02-24 00:45:03,223: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:03.223700489Z [2024-02-24 00:45:03,223: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:03.223735192Z [2024-02-24 00:45:03,223: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:03.223788749Z [2024-02-24 00:45:03,223: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:45:03.224992240Z [2024-02-24 00:45:03,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:45:03.225031686Z [2024-02-24 00:45:03,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:03.265846372Z [2024-02-24 00:45:03,265: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:03.314794144Z [2024-02-24 00:45:03,314: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:03.340067492Z [2024-02-24 00:45:03,339: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:45:03.343664504Z [2024-02-24 00:45:03,343: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:03.379010832Z [2024-02-24 00:45:03,378: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:45:03.382914636Z [2024-02-24 00:45:03,382: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:03.383206423Z [2024-02-24 00:45:03,383: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:03.383549931Z [2024-02-24 00:45:03,383: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:03.383851204Z [2024-02-24 00:45:03,383: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:45:03.384242551Z [2024-02-24 00:45:03,384: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:45:03.384445651Z [2024-02-24 00:45:03,384: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:03.522889403Z [2024-02-24 00:45:03,522: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:04.044666997Z [2024-02-24 00:45:04,044: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[02342830-24f4-475f-a9d0-6b235a389ab7] succeeded in 2.9726466479996816s: None
2024-02-24T00:45:04.913623859Z [2024-02-24 00:45:04,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92e9a810-f0e9-40ec-8513-130bf5830349] received
2024-02-24T00:45:04.923525316Z [2024-02-24 00:45:04,923: INFO/ForkPoolWorker-15] [92e9a810-f0e9-40ec-8513-130bf5830349] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:45:05.272381651Z [2024-02-24 00:45:05,271: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[aba452db-dc6d-41ea-b768-5050082f554a] succeeded in 4.192325951999919s: None
2024-02-24T00:45:05.330949885Z [2024-02-24 00:45:05,327: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:45:05.525181036Z [2024-02-24 00:45:05,524: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24e9c14d-1c34-4e7f-9570-d1865408227b] succeeded in 4.445168502000342s: None
2024-02-24T00:45:06.565413065Z [2024-02-24 00:45:06,564: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:45:06.569322683Z [2024-02-24 00:45:06,568: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:06.592485640Z [2024-02-24 00:45:06,592: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:45:06.594052266Z [2024-02-24 00:45:06,593: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:06.594115708Z [2024-02-24 00:45:06,593: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:06.594339707Z [2024-02-24 00:45:06,594: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:06.594394378Z [2024-02-24 00:45:06,594: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:45:06.595115325Z [2024-02-24 00:45:06,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:45:06.595204840Z [2024-02-24 00:45:06,595: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:06.681086018Z [2024-02-24 00:45:06,680: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:07.289020384Z [2024-02-24 00:45:07,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[92e9a810-f0e9-40ec-8513-130bf5830349] succeeded in 2.3732998509995014s: None
2024-02-24T00:45:07.985854777Z [2024-02-24 00:45:07,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70945ffe-0f80-40b2-a937-9d6827195e83] received
2024-02-24T00:45:07.993902185Z [2024-02-24 00:45:07,993: INFO/ForkPoolWorker-15] [70945ffe-0f80-40b2-a937-9d6827195e83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:45:08.279751797Z [2024-02-24 00:45:08,276: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:45:09.387440539Z [2024-02-24 00:45:09,387: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:45:09.390882746Z [2024-02-24 00:45:09,390: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:09.415090330Z [2024-02-24 00:45:09,414: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:45:09.416608731Z [2024-02-24 00:45:09,416: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:09.416736603Z [2024-02-24 00:45:09,416: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:09.417005224Z [2024-02-24 00:45:09,416: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:09.417135696Z [2024-02-24 00:45:09,416: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:45:09.417585773Z [2024-02-24 00:45:09,417: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:45:09.417864133Z [2024-02-24 00:45:09,417: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:09.500271264Z [2024-02-24 00:45:09,499: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:10.101888103Z [2024-02-24 00:45:10,101: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70945ffe-0f80-40b2-a937-9d6827195e83] succeeded in 2.1132615599999554s: None
2024-02-24T00:45:10.149697401Z [2024-02-24 00:45:10,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4fc08345-e6f3-47b2-81c9-7774157266cf] received
2024-02-24T00:45:10.158175017Z [2024-02-24 00:45:10,157: INFO/ForkPoolWorker-15] [4fc08345-e6f3-47b2-81c9-7774157266cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:45:10.452816470Z [2024-02-24 00:45:10,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:45:11.711486843Z [2024-02-24 00:45:11,711: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:45:11.715794393Z [2024-02-24 00:45:11,715: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:45:11.738284109Z [2024-02-24 00:45:11,738: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:45:11.739460435Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:45:11.739469915Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:45:11.739612680Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:45:11.739620921Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:45:11.739845373Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:45:11.739874148Z [2024-02-24 00:45:11,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:45:11.823900964Z [2024-02-24 00:45:11,823: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:45:12.447032501Z [2024-02-24 00:45:12,446: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4fc08345-e6f3-47b2-81c9-7774157266cf] succeeded in 2.2946012059992427s: None
2024-02-24T00:46:00.970059295Z [2024-02-24 00:46:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6833c8e-dd51-4cf7-98a1-0324c3d68deb] received
2024-02-24T00:46:00.975222139Z [2024-02-24 00:46:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b82390cc-9227-42ea-904d-ab19178174cf] received
2024-02-24T00:46:00.985124785Z [2024-02-24 00:46:00,984: INFO/ForkPoolWorker-15] [b6833c8e-dd51-4cf7-98a1-0324c3d68deb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:46:00.990588577Z [2024-02-24 00:46:00,990: INFO/ForkPoolWorker-16] [b82390cc-9227-42ea-904d-ab19178174cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:46:00.990706460Z [2024-02-24 00:46:00,990: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22e71bbc-176d-439f-8867-8bad3a32ece1] received
2024-02-24T00:46:00.995307261Z [2024-02-24 00:46:00,995: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[451c6535-f4a8-4ca8-a2bf-193b9de53783] received
2024-02-24T00:46:01.010513703Z [2024-02-24 00:46:01,010: INFO/ForkPoolWorker-2] [451c6535-f4a8-4ca8-a2bf-193b9de53783] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:46:01.012688791Z [2024-02-24 00:46:01,012: INFO/ForkPoolWorker-1] [22e71bbc-176d-439f-8867-8bad3a32ece1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:46:01.453083148Z [2024-02-24 00:46:01,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:46:01.479655487Z [2024-02-24 00:46:01,471: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:46:01.536354492Z [2024-02-24 00:46:01,531: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:46:01.536617986Z [2024-02-24 00:46:01,533: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:46:01.711966649Z [2024-02-24 00:46:01,711: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:46:01.780030268Z [2024-02-24 00:46:01,779: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:46:01.784953564Z [2024-02-24 00:46:01,784: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:46:01.811311684Z [2024-02-24 00:46:01,811: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:46:01.813998056Z [2024-02-24 00:46:01,813: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:46:01.814491237Z [2024-02-24 00:46:01,814: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:46:01.814518737Z [2024-02-24 00:46:01,814: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:46:01.814775034Z [2024-02-24 00:46:01,814: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:46:01.946830427Z [2024-02-24 00:46:01,946: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:46:02.471691181Z [2024-02-24 00:46:02,471: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b6833c8e-dd51-4cf7-98a1-0324c3d68deb] succeeded in 1.4951875220003785s: None
2024-02-24T00:46:02.816077109Z [2024-02-24 00:46:02,815: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b82390cc-9227-42ea-904d-ab19178174cf] succeeded in 1.8381290279994573s: None
2024-02-24T00:46:03.044555763Z [2024-02-24 00:46:03,044: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:46:03.048307207Z [2024-02-24 00:46:03,047: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:46:03.074151534Z [2024-02-24 00:46:03,073: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:46:03.075998305Z [2024-02-24 00:46:03,075: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:46:03.076189583Z [2024-02-24 00:46:03,075: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:46:03.076446104Z [2024-02-24 00:46:03,076: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:46:03.076628725Z [2024-02-24 00:46:03,076: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:46:03.077011285Z [2024-02-24 00:46:03,076: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:46:03.077275140Z [2024-02-24 00:46:03,076: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:46:03.154217504Z [2024-02-24 00:46:03,153: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:46:03.157663663Z [2024-02-24 00:46:03,157: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:46:03.161499354Z [2024-02-24 00:46:03,161: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:46:03.182961655Z [2024-02-24 00:46:03,182: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:46:03.184405212Z [2024-02-24 00:46:03,184: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:46:03.184602114Z [2024-02-24 00:46:03,184: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:46:03.184896516Z [2024-02-24 00:46:03,184: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:46:03.185064342Z [2024-02-24 00:46:03,184: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:46:03.185565939Z [2024-02-24 00:46:03,185: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:46:03.185732672Z [2024-02-24 00:46:03,185: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:46:03.287463634Z [2024-02-24 00:46:03,287: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:46:04.849387109Z [2024-02-24 00:46:04,848: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[451c6535-f4a8-4ca8-a2bf-193b9de53783] succeeded in 3.852115345999664s: None
2024-02-24T00:46:05.316066023Z [2024-02-24 00:46:05,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[22e71bbc-176d-439f-8867-8bad3a32ece1] succeeded in 4.323248091000096s: None
2024-02-24T00:47:00.691988558Z [2024-02-24 00:47:00,691: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39fc4286-4660-43d2-a7d2-6f92116eca0f] received
2024-02-24T00:47:00.696249752Z [2024-02-24 00:47:00,695: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94a5a555-4ed4-46ed-b5b1-ef10e88dd815] received
2024-02-24T00:47:00.698121900Z [2024-02-24 00:47:00,697: INFO/ForkPoolWorker-15] [39fc4286-4660-43d2-a7d2-6f92116eca0f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:47:00.701033379Z [2024-02-24 00:47:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a2af803-a12d-4237-8f16-bbc4e800e4e5] received
2024-02-24T00:47:00.705837827Z [2024-02-24 00:47:00,705: INFO/ForkPoolWorker-16] [94a5a555-4ed4-46ed-b5b1-ef10e88dd815] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:47:00.714490758Z [2024-02-24 00:47:00,714: INFO/ForkPoolWorker-1] [0a2af803-a12d-4237-8f16-bbc4e800e4e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:47:01.018421031Z [2024-02-24 00:47:01,015: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:47:01.034144435Z [2024-02-24 00:47:01,030: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:47:01.047072926Z [2024-02-24 00:47:01,043: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:47:01.175271297Z [2024-02-24 00:47:01,174: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:47:01.179484435Z [2024-02-24 00:47:01,179: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:47:01.202707889Z [2024-02-24 00:47:01,202: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:47:01.203744935Z [2024-02-24 00:47:01,203: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:47:01.212222742Z [2024-02-24 00:47:01,203: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:47:01.212289575Z [2024-02-24 00:47:01,212: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:47:01.217892697Z [2024-02-24 00:47:01,217: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:47:01.331646643Z [2024-02-24 00:47:01,331: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:47:01.910069596Z [2024-02-24 00:47:01,909: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39fc4286-4660-43d2-a7d2-6f92116eca0f] succeeded in 1.2161324979997516s: None
2024-02-24T00:47:02.240541572Z [2024-02-24 00:47:02,240: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:47:02.244279681Z [2024-02-24 00:47:02,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:47:02.263103322Z [2024-02-24 00:47:02,262: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:47:02.264573155Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:47:02.264587767Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:47:02.264716344Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:47:02.264745790Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:47:02.265003457Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:47:02.265063585Z [2024-02-24 00:47:02,264: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:47:02.277633066Z [2024-02-24 00:47:02,277: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:47:02.281227190Z [2024-02-24 00:47:02,280: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:47:02.312589205Z [2024-02-24 00:47:02,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:47:02.314240584Z [2024-02-24 00:47:02,313: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:47:02.314655655Z [2024-02-24 00:47:02,314: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:47:02.314842891Z [2024-02-24 00:47:02,314: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:47:02.314951101Z [2024-02-24 00:47:02,314: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:47:02.315309518Z [2024-02-24 00:47:02,315: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:47:02.315432901Z [2024-02-24 00:47:02,315: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:47:02.377924874Z [2024-02-24 00:47:02,374: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:47:02.426978771Z [2024-02-24 00:47:02,426: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:47:04.003733682Z [2024-02-24 00:47:04,003: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a2af803-a12d-4237-8f16-bbc4e800e4e5] succeeded in 3.300399650000145s: None
2024-02-24T00:47:04.465555684Z [2024-02-24 00:47:04,465: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[94a5a555-4ed4-46ed-b5b1-ef10e88dd815] succeeded in 3.766283953999846s: None
2024-02-24T00:48:01.167263889Z [2024-02-24 00:48:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78ca8d24-d1b4-4186-8ce3-119c11d843ba] received
2024-02-24T00:48:01.172119446Z [2024-02-24 00:48:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[004b50ec-c688-4f57-9d55-5a62ea67d14a] received
2024-02-24T00:48:01.174541894Z [2024-02-24 00:48:01,174: INFO/ForkPoolWorker-15] [78ca8d24-d1b4-4186-8ce3-119c11d843ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:48:01.178829473Z [2024-02-24 00:48:01,176: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ac8c009-5aa8-478d-a6e3-868a6a4b30e5] received
2024-02-24T00:48:01.181034067Z [2024-02-24 00:48:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f30eed31-f0c5-4765-98c7-47f007377536] received
2024-02-24T00:48:01.181480215Z [2024-02-24 00:48:01,181: INFO/ForkPoolWorker-16] [004b50ec-c688-4f57-9d55-5a62ea67d14a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:48:01.195858339Z [2024-02-24 00:48:01,195: INFO/ForkPoolWorker-2] [f30eed31-f0c5-4765-98c7-47f007377536] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:48:01.262388971Z [2024-02-24 00:48:01,242: INFO/ForkPoolWorker-1] [6ac8c009-5aa8-478d-a6e3-868a6a4b30e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:48:01.590738043Z [2024-02-24 00:48:01,587: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:48:01.659139784Z [2024-02-24 00:48:01,655: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:48:01.690006705Z [2024-02-24 00:48:01,686: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:48:01.719758609Z [2024-02-24 00:48:01,715: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:48:01.766829530Z [2024-02-24 00:48:01,766: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:48:01.771756624Z [2024-02-24 00:48:01,771: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:48:01.801662547Z [2024-02-24 00:48:01,801: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:48:01.803056336Z [2024-02-24 00:48:01,802: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:48:01.803242930Z [2024-02-24 00:48:01,803: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:48:01.803339456Z [2024-02-24 00:48:01,803: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:48:01.803600674Z [2024-02-24 00:48:01,803: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:48:01.908002725Z [2024-02-24 00:48:01,907: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:48:01.952228160Z [2024-02-24 00:48:01,951: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:48:02.720726486Z [2024-02-24 00:48:02,716: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ac8c009-5aa8-478d-a6e3-868a6a4b30e5] succeeded in 1.535290697000164s: None
2024-02-24T00:48:02.808171942Z [2024-02-24 00:48:02,807: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[78ca8d24-d1b4-4186-8ce3-119c11d843ba] succeeded in 1.6392993780000324s: None
2024-02-24T00:48:03.118485626Z [2024-02-24 00:48:03,118: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:48:03.122129603Z [2024-02-24 00:48:03,121: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:48:03.143500504Z [2024-02-24 00:48:03,143: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:48:03.144731230Z [2024-02-24 00:48:03,144: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:48:03.144811181Z [2024-02-24 00:48:03,144: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:48:03.144963981Z [2024-02-24 00:48:03,144: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:48:03.145040434Z [2024-02-24 00:48:03,144: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:48:03.145312021Z [2024-02-24 00:48:03,145: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:48:03.145408405Z [2024-02-24 00:48:03,145: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:48:03.241740816Z [2024-02-24 00:48:03,241: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:48:03.280336554Z [2024-02-24 00:48:03,279: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:48:03.283917844Z [2024-02-24 00:48:03,283: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:48:03.311334752Z [2024-02-24 00:48:03,310: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:48:03.312922500Z [2024-02-24 00:48:03,312: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:48:03.312956703Z [2024-02-24 00:48:03,312: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:48:03.313102030Z [2024-02-24 00:48:03,312: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:48:03.313322444Z [2024-02-24 00:48:03,313: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:48:03.313709818Z [2024-02-24 00:48:03,313: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:48:03.313929805Z [2024-02-24 00:48:03,313: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:48:03.402128577Z [2024-02-24 00:48:03,401: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:48:05.153560004Z [2024-02-24 00:48:05,152: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[004b50ec-c688-4f57-9d55-5a62ea67d14a] succeeded in 3.9789360520007904s: None
2024-02-24T00:48:05.172754888Z [2024-02-24 00:48:05,172: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f30eed31-f0c5-4765-98c7-47f007377536] succeeded in 3.9897070800006986s: None
2024-02-24T00:49:01.208449560Z [2024-02-24 00:49:01,208: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5432cae3-6d28-4624-87c0-cd46b03b61c7] received
2024-02-24T00:49:01.214951026Z [2024-02-24 00:49:01,214: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ccb3606f-a68e-4d05-b169-0f841ca5a738] received
2024-02-24T00:49:01.222410451Z [2024-02-24 00:49:01,221: INFO/ForkPoolWorker-16] [ccb3606f-a68e-4d05-b169-0f841ca5a738] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:49:01.225422209Z [2024-02-24 00:49:01,224: INFO/ForkPoolWorker-15] [5432cae3-6d28-4624-87c0-cd46b03b61c7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:49:01.230402687Z [2024-02-24 00:49:01,228: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30a69216-a976-43e3-8330-2bcc9c299ce7] received
2024-02-24T00:49:01.237858596Z [2024-02-24 00:49:01,234: INFO/ForkPoolWorker-1] [30a69216-a976-43e3-8330-2bcc9c299ce7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:49:01.566552576Z [2024-02-24 00:49:01,563: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:49:01.611024595Z [2024-02-24 00:49:01,607: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:49:01.631876143Z [2024-02-24 00:49:01,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:49:01.790786342Z [2024-02-24 00:49:01,790: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:49:01.794704878Z [2024-02-24 00:49:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:49:01.817462184Z [2024-02-24 00:49:01,817: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:49:01.818572169Z [2024-02-24 00:49:01,818: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:49:01.818749703Z [2024-02-24 00:49:01,818: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:49:01.818885624Z [2024-02-24 00:49:01,818: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:49:01.819199612Z [2024-02-24 00:49:01,819: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:49:01.914002725Z [2024-02-24 00:49:01,913: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:49:02.557202712Z [2024-02-24 00:49:02,556: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5432cae3-6d28-4624-87c0-cd46b03b61c7] succeeded in 1.3439031009993414s: None
2024-02-24T00:49:02.842568131Z [2024-02-24 00:49:02,842: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:49:02.850239951Z [2024-02-24 00:49:02,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:49:02.870800296Z [2024-02-24 00:49:02,870: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:49:02.872183020Z [2024-02-24 00:49:02,871: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:49:02.872398154Z [2024-02-24 00:49:02,872: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:49:02.872638116Z [2024-02-24 00:49:02,872: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:49:02.872809125Z [2024-02-24 00:49:02,872: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:49:02.873154971Z [2024-02-24 00:49:02,873: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:49:02.873393370Z [2024-02-24 00:49:02,873: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:49:02.982384433Z [2024-02-24 00:49:02,982: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:49:02.991179619Z [2024-02-24 00:49:02,990: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:49:02.995064167Z [2024-02-24 00:49:02,994: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:49:03.017386645Z [2024-02-24 00:49:03,017: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:49:03.018877287Z [2024-02-24 00:49:03,018: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:49:03.018890149Z [2024-02-24 00:49:03,018: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:49:03.018976557Z [2024-02-24 00:49:03,018: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:49:03.019080578Z [2024-02-24 00:49:03,018: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:49:03.019308549Z [2024-02-24 00:49:03,019: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:49:03.019340223Z [2024-02-24 00:49:03,019: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:49:03.107996198Z [2024-02-24 00:49:03,107: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:49:05.159253456Z [2024-02-24 00:49:05,158: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ccb3606f-a68e-4d05-b169-0f841ca5a738] succeeded in 3.942213707000519s: None
2024-02-24T00:49:05.840036235Z [2024-02-24 00:49:05,839: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30a69216-a976-43e3-8330-2bcc9c299ce7] succeeded in 4.610110143000384s: None
2024-02-24T00:50:01.163890736Z [2024-02-24 00:50:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c8c8c79-5c9b-40a0-af71-7a580ad0a9c6] received
2024-02-24T00:50:01.165810884Z [2024-02-24 00:50:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[177bf368-55bb-4802-a3c3-647dbc566a49] received
2024-02-24T00:50:01.167333944Z [2024-02-24 00:50:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[340662af-a42b-4108-bfe7-13db97e100e5] received
2024-02-24T00:50:01.170438499Z [2024-02-24 00:50:01,170: INFO/ForkPoolWorker-15] [6c8c8c79-5c9b-40a0-af71-7a580ad0a9c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:50:01.175591137Z [2024-02-24 00:50:01,175: INFO/ForkPoolWorker-1] [340662af-a42b-4108-bfe7-13db97e100e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:50:01.182964808Z [2024-02-24 00:50:01,182: INFO/ForkPoolWorker-16] [177bf368-55bb-4802-a3c3-647dbc566a49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:50:01.184641551Z [2024-02-24 00:50:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a9a2324-88cd-4b11-86bb-3b38dd3f2ec6] received
2024-02-24T00:50:01.188626342Z [2024-02-24 00:50:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da6d58a9-fb47-45c0-895a-7c5f502028a4] received
2024-02-24T00:50:01.191348623Z [2024-02-24 00:50:01,191: INFO/ForkPoolWorker-2] [1a9a2324-88cd-4b11-86bb-3b38dd3f2ec6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:50:01.227360198Z [2024-02-24 00:50:01,217: INFO/ForkPoolWorker-3] [da6d58a9-fb47-45c0-895a-7c5f502028a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:50:01.517476766Z [2024-02-24 00:50:01,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:50:01.587031741Z [2024-02-24 00:50:01,577: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:50:01.709718133Z [2024-02-24 00:50:01,706: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:50:01.733698794Z [2024-02-24 00:50:01,729: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:50:01.767495371Z [2024-02-24 00:50:01,763: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:50:01.993424802Z [2024-02-24 00:50:01,992: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:50:02.000080174Z [2024-02-24 00:50:01,999: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:02.041553890Z [2024-02-24 00:50:02,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:50:02.043414762Z [2024-02-24 00:50:02,043: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:50:02.043435158Z [2024-02-24 00:50:02,043: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:50:02.043516449Z [2024-02-24 00:50:02,043: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:50:02.043738871Z [2024-02-24 00:50:02,043: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:50:02.190349454Z [2024-02-24 00:50:02,190: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:02.230185005Z [2024-02-24 00:50:02,229: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:03.034256573Z [2024-02-24 00:50:03,033: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[340662af-a42b-4108-bfe7-13db97e100e5] succeeded in 1.8656780499995875s: None
2024-02-24T00:50:03.056066544Z [2024-02-24 00:50:03,055: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:50:03.060207933Z [2024-02-24 00:50:03,059: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:03.097579556Z [2024-02-24 00:50:03,097: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:50:03.104777589Z [2024-02-24 00:50:03,104: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:03.105544255Z [2024-02-24 00:50:03,105: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:03.105702388Z [2024-02-24 00:50:03,105: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:03.105743318Z [2024-02-24 00:50:03,105: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:50:03.106071826Z [2024-02-24 00:50:03,105: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:50:03.106914537Z [2024-02-24 00:50:03,106: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1a9a2324-88cd-4b11-86bb-3b38dd3f2ec6] succeeded in 1.920917795000605s: None
2024-02-24T00:50:03.107370673Z [2024-02-24 00:50:03,106: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:03.186953095Z [2024-02-24 00:50:03,186: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:03.225624672Z [2024-02-24 00:50:03,225: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:50:03.229555294Z [2024-02-24 00:50:03,229: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:03.270081207Z [2024-02-24 00:50:03,269: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:50:03.277315905Z [2024-02-24 00:50:03,276: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:03.277541211Z [2024-02-24 00:50:03,277: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:03.278091869Z [2024-02-24 00:50:03,277: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:03.278346922Z [2024-02-24 00:50:03,278: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:50:03.278723363Z [2024-02-24 00:50:03,278: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:50:03.278895570Z [2024-02-24 00:50:03,278: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:03.372684062Z [2024-02-24 00:50:03,372: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:03.741928306Z [2024-02-24 00:50:03,741: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T00:50:03.745818427Z [2024-02-24 00:50:03,745: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:03.772480845Z [2024-02-24 00:50:03,772: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T00:50:03.773866061Z [2024-02-24 00:50:03,773: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:03.774109292Z [2024-02-24 00:50:03,773: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:03.774331945Z [2024-02-24 00:50:03,774: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:03.774472409Z [2024-02-24 00:50:03,774: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T00:50:03.777039674Z [2024-02-24 00:50:03,774: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:50:03.777210127Z [2024-02-24 00:50:03,777: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:03.906339559Z [2024-02-24 00:50:03,904: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:03.948877294Z [2024-02-24 00:50:03,948: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c8c8c79-5c9b-40a0-af71-7a580ad0a9c6] succeeded in 2.783177393999722s: None
2024-02-24T00:50:03.951393258Z [2024-02-24 00:50:03,951: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9631e48a-d81f-4f1d-9c8e-8ab8c56882f0] received
2024-02-24T00:50:03.962477298Z [2024-02-24 00:50:03,962: INFO/ForkPoolWorker-15] [9631e48a-d81f-4f1d-9c8e-8ab8c56882f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:50:04.268675890Z [2024-02-24 00:50:04,265: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:50:05.454907914Z [2024-02-24 00:50:05,454: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:50:05.459305207Z [2024-02-24 00:50:05,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:05.480519872Z [2024-02-24 00:50:05,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:50:05.482343924Z [2024-02-24 00:50:05,482: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:05.482523237Z [2024-02-24 00:50:05,482: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:05.482755742Z [2024-02-24 00:50:05,482: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:05.482866279Z [2024-02-24 00:50:05,482: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:50:05.483183651Z [2024-02-24 00:50:05,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:50:05.483331354Z [2024-02-24 00:50:05,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:05.579946971Z [2024-02-24 00:50:05,579: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:05.711928373Z [2024-02-24 00:50:05,711: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[da6d58a9-fb47-45c0-895a-7c5f502028a4] succeeded in 4.516492570000082s: None
2024-02-24T00:50:06.082834013Z [2024-02-24 00:50:06,082: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[177bf368-55bb-4802-a3c3-647dbc566a49] succeeded in 4.913958293000178s: None
2024-02-24T00:50:06.302302493Z [2024-02-24 00:50:06,301: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9631e48a-d81f-4f1d-9c8e-8ab8c56882f0] succeeded in 2.34874635199958s: None
2024-02-24T00:50:06.470541866Z [2024-02-24 00:50:06,470: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7e8b880-08c0-47e7-84e1-6400b504fb9f] received
2024-02-24T00:50:06.480351084Z [2024-02-24 00:50:06,479: INFO/ForkPoolWorker-15] [e7e8b880-08c0-47e7-84e1-6400b504fb9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:50:06.759299324Z [2024-02-24 00:50:06,756: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:50:07.878213892Z [2024-02-24 00:50:07,877: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:50:07.881420949Z [2024-02-24 00:50:07,880: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:07.904507023Z [2024-02-24 00:50:07,904: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:50:07.906300051Z [2024-02-24 00:50:07,906: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:07.906487854Z [2024-02-24 00:50:07,906: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:07.906710927Z [2024-02-24 00:50:07,906: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:07.906867420Z [2024-02-24 00:50:07,906: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:50:07.907226985Z [2024-02-24 00:50:07,907: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:50:07.907410037Z [2024-02-24 00:50:07,907: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:07.999090012Z [2024-02-24 00:50:07,998: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:08.631564628Z [2024-02-24 00:50:08,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e7e8b880-08c0-47e7-84e1-6400b504fb9f] succeeded in 2.15795006999997s: None
2024-02-24T00:50:08.761720279Z [2024-02-24 00:50:08,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91b73480-3e61-4f90-bde6-83afdd9d81a6] received
2024-02-24T00:50:08.771851715Z [2024-02-24 00:50:08,771: INFO/ForkPoolWorker-15] [91b73480-3e61-4f90-bde6-83afdd9d81a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:50:09.062785689Z [2024-02-24 00:50:09,059: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:50:10.165327044Z [2024-02-24 00:50:10,164: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:50:10.168536399Z [2024-02-24 00:50:10,167: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:50:10.196928503Z [2024-02-24 00:50:10,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:50:10.198746529Z [2024-02-24 00:50:10,198: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:50:10.198792788Z [2024-02-24 00:50:10,198: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:50:10.198977610Z [2024-02-24 00:50:10,198: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:50:10.199139005Z [2024-02-24 00:50:10,198: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:50:10.199576214Z [2024-02-24 00:50:10,199: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:50:10.199763392Z [2024-02-24 00:50:10,199: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:50:10.300717108Z [2024-02-24 00:50:10,300: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:50:11.004983522Z [2024-02-24 00:50:11,004: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91b73480-3e61-4f90-bde6-83afdd9d81a6] succeeded in 2.2407582020005066s: None
2024-02-24T00:51:01.309654591Z [2024-02-24 00:51:01,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[913bbbc3-a890-4db8-b243-f582c91cdc2c] received
2024-02-24T00:51:01.312390227Z [2024-02-24 00:51:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b83099ed-68ee-44f3-bf86-3c6671ee8c81] received
2024-02-24T00:51:01.318836573Z [2024-02-24 00:51:01,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2acc364-055b-4deb-96c5-2c50f17f84d8] received
2024-02-24T00:51:01.319555440Z [2024-02-24 00:51:01,319: INFO/ForkPoolWorker-15] [913bbbc3-a890-4db8-b243-f582c91cdc2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:51:01.322120709Z [2024-02-24 00:51:01,321: INFO/ForkPoolWorker-16] [b83099ed-68ee-44f3-bf86-3c6671ee8c81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:51:01.326130186Z [2024-02-24 00:51:01,325: INFO/ForkPoolWorker-1] [b2acc364-055b-4deb-96c5-2c50f17f84d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:51:01.616282501Z [2024-02-24 00:51:01,613: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:51:01.631857816Z [2024-02-24 00:51:01,628: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:51:01.650286150Z [2024-02-24 00:51:01,646: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:51:01.787127307Z [2024-02-24 00:51:01,786: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:51:01.795251084Z [2024-02-24 00:51:01,794: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:51:01.825164460Z [2024-02-24 00:51:01,824: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:51:01.826657098Z [2024-02-24 00:51:01,826: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:51:01.826798002Z [2024-02-24 00:51:01,826: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:51:01.826832432Z [2024-02-24 00:51:01,826: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:51:01.827023272Z [2024-02-24 00:51:01,826: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:51:01.919660470Z [2024-02-24 00:51:01,919: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:51:02.525393571Z [2024-02-24 00:51:02,525: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[913bbbc3-a890-4db8-b243-f582c91cdc2c] succeeded in 1.211962143999699s: None
2024-02-24T00:51:02.893901645Z [2024-02-24 00:51:02,893: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:51:02.897358379Z [2024-02-24 00:51:02,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:51:02.917950738Z [2024-02-24 00:51:02,917: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:51:02.919368402Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:51:02.919395672Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:51:02.919458391Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:51:02.919478520Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:51:02.919655721Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:51:02.919713370Z [2024-02-24 00:51:02,919: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:51:03.002123255Z [2024-02-24 00:51:03,001: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:51:03.018908269Z [2024-02-24 00:51:03,018: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:51:03.022367044Z [2024-02-24 00:51:03,021: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:51:03.047038933Z [2024-02-24 00:51:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:51:03.048476356Z [2024-02-24 00:51:03,048: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:51:03.048617281Z [2024-02-24 00:51:03,048: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:51:03.048814534Z [2024-02-24 00:51:03,048: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:51:03.048865565Z [2024-02-24 00:51:03,048: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:51:03.049164936Z [2024-02-24 00:51:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:51:03.049341328Z [2024-02-24 00:51:03,049: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:51:03.153413608Z [2024-02-24 00:51:03,152: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:51:05.035721902Z [2024-02-24 00:51:05,035: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b2acc364-055b-4deb-96c5-2c50f17f84d8] succeeded in 3.7153224789999513s: None
2024-02-24T00:51:05.595808570Z [2024-02-24 00:51:05,595: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b83099ed-68ee-44f3-bf86-3c6671ee8c81] succeeded in 4.2822077330001775s: None
2024-02-24T00:52:01.188577210Z [2024-02-24 00:52:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1042acf2-87dd-4775-ac02-a6ffaab2359a] received
2024-02-24T00:52:01.192118906Z [2024-02-24 00:52:01,191: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c123589-2021-4c2d-b3ce-aa70f4b2d1ce] received
2024-02-24T00:52:01.194483532Z [2024-02-24 00:52:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ae41681-fa4a-4fa9-94bd-c466155b0c5b] received
2024-02-24T00:52:01.200424768Z [2024-02-24 00:52:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7324be49-a8e9-4405-bd34-e46cbe835dd4] received
2024-02-24T00:52:01.203992868Z [2024-02-24 00:52:01,203: INFO/ForkPoolWorker-15] [1042acf2-87dd-4775-ac02-a6ffaab2359a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:52:01.204372537Z [2024-02-24 00:52:01,204: INFO/ForkPoolWorker-16] [9c123589-2021-4c2d-b3ce-aa70f4b2d1ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:52:01.204530492Z [2024-02-24 00:52:01,204: INFO/ForkPoolWorker-1] [5ae41681-fa4a-4fa9-94bd-c466155b0c5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:52:01.220282837Z [2024-02-24 00:52:01,220: INFO/ForkPoolWorker-2] [7324be49-a8e9-4405-bd34-e46cbe835dd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:52:01.575243245Z [2024-02-24 00:52:01,571: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:52:01.732586444Z [2024-02-24 00:52:01,728: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:52:01.831482597Z [2024-02-24 00:52:01,827: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:52:01.851595194Z [2024-02-24 00:52:01,848: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:52:02.046234391Z [2024-02-24 00:52:02,045: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:52:02.050525138Z [2024-02-24 00:52:02,050: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:52:02.069642463Z [2024-02-24 00:52:02,069: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:52:02.079628879Z [2024-02-24 00:52:02,079: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:52:02.081119870Z [2024-02-24 00:52:02,080: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:52:02.081443957Z [2024-02-24 00:52:02,080: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:52:02.081651644Z [2024-02-24 00:52:02,081: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:52:02.082010953Z [2024-02-24 00:52:02,081: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:52:02.171781139Z [2024-02-24 00:52:02,171: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:52:02.838722203Z [2024-02-24 00:52:02,838: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c123589-2021-4c2d-b3ce-aa70f4b2d1ce] succeeded in 1.6447836520001147s: None
2024-02-24T00:52:03.086584626Z [2024-02-24 00:52:03,086: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ae41681-fa4a-4fa9-94bd-c466155b0c5b] succeeded in 1.890650287000426s: None
2024-02-24T00:52:03.114671238Z [2024-02-24 00:52:03,114: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:52:03.117699723Z [2024-02-24 00:52:03,117: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:52:03.138636513Z [2024-02-24 00:52:03,138: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:52:03.139912403Z [2024-02-24 00:52:03,139: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:52:03.139921277Z [2024-02-24 00:52:03,139: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:52:03.140065025Z [2024-02-24 00:52:03,139: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:52:03.140073121Z [2024-02-24 00:52:03,140: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:52:03.140315773Z [2024-02-24 00:52:03,140: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:52:03.140323310Z [2024-02-24 00:52:03,140: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:52:03.237909443Z [2024-02-24 00:52:03,237: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:52:03.357197459Z [2024-02-24 00:52:03,356: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:52:03.360659307Z [2024-02-24 00:52:03,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:52:03.407973219Z [2024-02-24 00:52:03,407: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:52:03.409215978Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:52:03.409292246Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:52:03.409442176Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:52:03.409563495Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:52:03.409837798Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:52:03.409942447Z [2024-02-24 00:52:03,409: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:52:03.503203015Z [2024-02-24 00:52:03,502: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:52:05.930142270Z [2024-02-24 00:52:05,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1042acf2-87dd-4775-ac02-a6ffaab2359a] succeeded in 4.739177435999409s: None
2024-02-24T00:52:05.999950425Z [2024-02-24 00:52:05,999: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7324be49-a8e9-4405-bd34-e46cbe835dd4] succeeded in 4.798018946999946s: None
2024-02-24T00:53:00.629595622Z [2024-02-24 00:53:00,629: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03d557f8-a233-4843-a95c-6e0da45ce244] received
2024-02-24T00:53:00.656003454Z [2024-02-24 00:53:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[74d76ba1-80d9-4a98-bf1a-5f7bfc779744] received
2024-02-24T00:53:00.657763916Z [2024-02-24 00:53:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9005f6c0-db18-4b71-8ddd-f768fa9b5c5d] received
2024-02-24T00:53:00.660701876Z [2024-02-24 00:53:00,660: INFO/ForkPoolWorker-15] [03d557f8-a233-4843-a95c-6e0da45ce244] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:53:00.756708648Z [2024-02-24 00:53:00,756: INFO/ForkPoolWorker-1] [9005f6c0-db18-4b71-8ddd-f768fa9b5c5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:53:00.757553141Z [2024-02-24 00:53:00,757: INFO/ForkPoolWorker-16] [74d76ba1-80d9-4a98-bf1a-5f7bfc779744] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:53:01.116300024Z [2024-02-24 00:53:01,110: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:53:01.393828224Z [2024-02-24 00:53:01,322: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:53:02.017578897Z [2024-02-24 00:53:02,013: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:53:02.839859691Z [2024-02-24 00:53:02,839: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:53:02.869850366Z [2024-02-24 00:53:02,866: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:53:02.964333618Z [2024-02-24 00:53:02,963: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:53:02.978477749Z [2024-02-24 00:53:02,978: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:53:02.978510356Z [2024-02-24 00:53:02,978: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:53:02.978656753Z [2024-02-24 00:53:02,978: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:53:02.979040180Z [2024-02-24 00:53:02,978: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:53:03.389757678Z [2024-02-24 00:53:03,389: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:53:04.329570323Z [2024-02-24 00:53:04,329: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:53:04.333306112Z [2024-02-24 00:53:04,332: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:53:04.366453292Z [2024-02-24 00:53:04,366: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:53:04.369991152Z [2024-02-24 00:53:04,369: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:53:04.370013494Z [2024-02-24 00:53:04,369: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:53:04.370273925Z [2024-02-24 00:53:04,369: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:53:04.370407892Z [2024-02-24 00:53:04,370: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:53:04.370706176Z [2024-02-24 00:53:04,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:53:04.371192548Z [2024-02-24 00:53:04,370: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:53:04.647557625Z [2024-02-24 00:53:04,647: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:53:04.855570487Z [2024-02-24 00:53:04,855: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9005f6c0-db18-4b71-8ddd-f768fa9b5c5d] succeeded in 4.147827355999652s: None
2024-02-24T00:53:05.137336434Z [2024-02-24 00:53:05,136: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:53:05.143639296Z [2024-02-24 00:53:05,143: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:53:05.184505089Z [2024-02-24 00:53:05,184: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:53:05.191077667Z [2024-02-24 00:53:05,190: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:53:05.191093707Z [2024-02-24 00:53:05,190: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:53:05.191212849Z [2024-02-24 00:53:05,191: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:53:05.191244967Z [2024-02-24 00:53:05,191: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:53:05.191504504Z [2024-02-24 00:53:05,191: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:53:05.191545494Z [2024-02-24 00:53:05,191: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:53:05.335654318Z [2024-02-24 00:53:05,335: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:53:07.016921653Z [2024-02-24 00:53:07,016: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[03d557f8-a233-4843-a95c-6e0da45ce244] succeeded in 6.375054120000641s: None
2024-02-24T00:53:09.307415120Z [2024-02-24 00:53:09,306: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[74d76ba1-80d9-4a98-bf1a-5f7bfc779744] succeeded in 8.609540732000823s: None
2024-02-24T00:54:01.022862279Z [2024-02-24 00:54:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66a8095b-4426-4ada-82ca-83fb8a98f701] received
2024-02-24T00:54:01.026998414Z [2024-02-24 00:54:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56d67561-6336-4830-a0fb-a39967c3545d] received
2024-02-24T00:54:01.035286214Z [2024-02-24 00:54:01,035: INFO/ForkPoolWorker-16] [56d67561-6336-4830-a0fb-a39967c3545d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:54:01.037381519Z [2024-02-24 00:54:01,037: INFO/ForkPoolWorker-15] [66a8095b-4426-4ada-82ca-83fb8a98f701] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:54:01.044001434Z [2024-02-24 00:54:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2fa3aead-f6b4-49fe-8346-7430b849f3fd] received
2024-02-24T00:54:01.046911607Z [2024-02-24 00:54:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[980be89d-55e6-4bf7-8fbd-aef5e1b80954] received
2024-02-24T00:54:01.062214083Z [2024-02-24 00:54:01,061: INFO/ForkPoolWorker-2] [980be89d-55e6-4bf7-8fbd-aef5e1b80954] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:54:01.065235587Z [2024-02-24 00:54:01,064: INFO/ForkPoolWorker-1] [2fa3aead-f6b4-49fe-8346-7430b849f3fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:54:01.420977663Z [2024-02-24 00:54:01,417: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:54:01.475566268Z [2024-02-24 00:54:01,470: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:54:01.700439010Z [2024-02-24 00:54:01,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:54:01.768303951Z [2024-02-24 00:54:01,764: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:54:01.774049493Z [2024-02-24 00:54:01,773: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:54:01.873905582Z [2024-02-24 00:54:01,873: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:54:01.877928958Z [2024-02-24 00:54:01,877: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:54:01.909506628Z [2024-02-24 00:54:01,909: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:54:01.910675144Z [2024-02-24 00:54:01,910: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:54:01.910984216Z [2024-02-24 00:54:01,910: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:54:01.911160250Z [2024-02-24 00:54:01,911: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:54:01.911654313Z [2024-02-24 00:54:01,911: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:54:02.039445675Z [2024-02-24 00:54:02,039: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:54:02.533748721Z [2024-02-24 00:54:02,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66a8095b-4426-4ada-82ca-83fb8a98f701] succeeded in 1.505935784999565s: None
2024-02-24T00:54:02.925392302Z [2024-02-24 00:54:02,925: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[56d67561-6336-4830-a0fb-a39967c3545d] succeeded in 1.896185327999774s: None
2024-02-24T00:54:03.372918407Z [2024-02-24 00:54:03,372: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:54:03.376592331Z [2024-02-24 00:54:03,376: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:54:03.402165888Z [2024-02-24 00:54:03,401: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:54:03.403966653Z [2024-02-24 00:54:03,403: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:54:03.404138556Z [2024-02-24 00:54:03,403: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:54:03.404405282Z [2024-02-24 00:54:03,404: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:54:03.404583787Z [2024-02-24 00:54:03,404: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:54:03.405024240Z [2024-02-24 00:54:03,404: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:54:03.405184002Z [2024-02-24 00:54:03,405: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:54:03.437429553Z [2024-02-24 00:54:03,437: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:54:03.441289425Z [2024-02-24 00:54:03,440: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:54:03.474644306Z [2024-02-24 00:54:03,474: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:54:03.491660094Z [2024-02-24 00:54:03,491: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:54:03.495170991Z [2024-02-24 00:54:03,494: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:54:03.495251156Z [2024-02-24 00:54:03,495: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:54:03.495414439Z [2024-02-24 00:54:03,495: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:54:03.495478581Z [2024-02-24 00:54:03,495: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:54:03.495883991Z [2024-02-24 00:54:03,495: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:54:03.495903270Z [2024-02-24 00:54:03,495: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:54:03.609674508Z [2024-02-24 00:54:03,609: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:54:06.343008904Z [2024-02-24 00:54:06,342: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[980be89d-55e6-4bf7-8fbd-aef5e1b80954] succeeded in 5.293183400000089s: None
2024-02-24T00:54:06.847090046Z [2024-02-24 00:54:06,846: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2fa3aead-f6b4-49fe-8346-7430b849f3fd] succeeded in 5.797643820999838s: None
2024-02-24T00:55:00.781540488Z [2024-02-24 00:55:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1e0483f-8741-4cec-9ec2-7d6cdaf57243] received
2024-02-24T00:55:00.785099284Z [2024-02-24 00:55:00,784: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d13770f-e4ee-4fb4-adec-9a88addc1d2c] received
2024-02-24T00:55:00.792383272Z [2024-02-24 00:55:00,792: INFO/ForkPoolWorker-16] [6d13770f-e4ee-4fb4-adec-9a88addc1d2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:55:00.792785921Z [2024-02-24 00:55:00,792: INFO/ForkPoolWorker-15] [b1e0483f-8741-4cec-9ec2-7d6cdaf57243] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:55:00.798330613Z [2024-02-24 00:55:00,798: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbad9a7c-d890-4dcc-a42a-cca177993286] received
2024-02-24T00:55:00.804373591Z [2024-02-24 00:55:00,804: INFO/ForkPoolWorker-1] [bbad9a7c-d890-4dcc-a42a-cca177993286] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:55:00.807067442Z [2024-02-24 00:55:00,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60d717d2-a997-40e3-905b-977376b1c4c0] received
2024-02-24T00:55:00.813227056Z [2024-02-24 00:55:00,812: INFO/ForkPoolWorker-2] [60d717d2-a997-40e3-905b-977376b1c4c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:55:01.200420141Z [2024-02-24 00:55:01,197: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:55:01.281880320Z [2024-02-24 00:55:01,271: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:55:01.368172934Z [2024-02-24 00:55:01,362: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:55:01.597473530Z [2024-02-24 00:55:01,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:55:01.838054369Z [2024-02-24 00:55:01,837: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T00:55:01.846062091Z [2024-02-24 00:55:01,845: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:01.906079939Z [2024-02-24 00:55:01,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:55:01.908118182Z [2024-02-24 00:55:01,907: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:55:01.908289711Z [2024-02-24 00:55:01,908: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:55:01.908362490Z [2024-02-24 00:55:01,908: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T00:55:01.908598149Z [2024-02-24 00:55:01,908: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:55:02.019220803Z [2024-02-24 00:55:02,018: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:02.693869545Z [2024-02-24 00:55:02,689: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:55:02.701855926Z [2024-02-24 00:55:02,693: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:02.842974405Z [2024-02-24 00:55:02,842: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:55:02.848079740Z [2024-02-24 00:55:02,847: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:02.848446200Z [2024-02-24 00:55:02,847: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:02.848514720Z [2024-02-24 00:55:02,848: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:02.848536248Z [2024-02-24 00:55:02,848: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:55:02.848738514Z [2024-02-24 00:55:02,848: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:55:02.848842045Z [2024-02-24 00:55:02,848: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:02.887866940Z [2024-02-24 00:55:02,885: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bbad9a7c-d890-4dcc-a42a-cca177993286] succeeded in 2.0862932240006558s: None
2024-02-24T00:55:02.944003061Z [2024-02-24 00:55:02,943: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:03.011252981Z [2024-02-24 00:55:03,010: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:55:03.014965467Z [2024-02-24 00:55:03,014: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:03.048687979Z [2024-02-24 00:55:03,048: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:55:03.055129173Z [2024-02-24 00:55:03,054: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:03.055156059Z [2024-02-24 00:55:03,054: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:03.055220072Z [2024-02-24 00:55:03,054: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:03.055226378Z [2024-02-24 00:55:03,055: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:55:03.055410886Z [2024-02-24 00:55:03,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:55:03.055458138Z [2024-02-24 00:55:03,055: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:03.165236024Z [2024-02-24 00:55:03,164: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:03.252746079Z [2024-02-24 00:55:03,252: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:55:03.256327557Z [2024-02-24 00:55:03,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:03.281050891Z [2024-02-24 00:55:03,280: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:55:03.282823286Z [2024-02-24 00:55:03,282: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:03.283013169Z [2024-02-24 00:55:03,282: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:03.283240392Z [2024-02-24 00:55:03,283: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:03.283427749Z [2024-02-24 00:55:03,283: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:55:03.283759744Z [2024-02-24 00:55:03,283: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:55:03.283922257Z [2024-02-24 00:55:03,283: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:03.416433026Z [2024-02-24 00:55:03,416: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:04.183122471Z [2024-02-24 00:55:04,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1e0483f-8741-4cec-9ec2-7d6cdaf57243] succeeded in 3.395206313000017s: None
2024-02-24T00:55:04.663970869Z [2024-02-24 00:55:04,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22a2d17a-b90f-43fb-95aa-575f227caf53] received
2024-02-24T00:55:04.679628359Z [2024-02-24 00:55:04,679: INFO/ForkPoolWorker-15] [22a2d17a-b90f-43fb-95aa-575f227caf53] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:55:04.822909360Z [2024-02-24 00:55:04,822: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60d717d2-a997-40e3-905b-977376b1c4c0] succeeded in 4.014453363999564s: None
2024-02-24T00:55:04.823686760Z [2024-02-24 00:55:04,823: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6d13770f-e4ee-4fb4-adec-9a88addc1d2c] succeeded in 4.036582263000128s: None
2024-02-24T00:55:05.004598867Z [2024-02-24 00:55:05,001: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:55:06.195642922Z [2024-02-24 00:55:06,195: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:55:06.198920957Z [2024-02-24 00:55:06,198: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:06.225070035Z [2024-02-24 00:55:06,224: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:55:06.227827175Z [2024-02-24 00:55:06,227: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:06.227869288Z [2024-02-24 00:55:06,227: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:06.228025353Z [2024-02-24 00:55:06,227: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:06.228148691Z [2024-02-24 00:55:06,227: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:55:06.228759023Z [2024-02-24 00:55:06,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:55:06.228965066Z [2024-02-24 00:55:06,228: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:06.329667578Z [2024-02-24 00:55:06,329: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:07.087290423Z [2024-02-24 00:55:07,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22a2d17a-b90f-43fb-95aa-575f227caf53] succeeded in 2.4204113570003756s: None
2024-02-24T00:55:07.201854840Z [2024-02-24 00:55:07,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a39f3687-5016-4206-95d2-d5b2496c0d9b] received
2024-02-24T00:55:07.213318108Z [2024-02-24 00:55:07,212: INFO/ForkPoolWorker-15] [a39f3687-5016-4206-95d2-d5b2496c0d9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T00:55:07.519692003Z [2024-02-24 00:55:07,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:55:08.614716060Z [2024-02-24 00:55:08,614: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:55:08.618121030Z [2024-02-24 00:55:08,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:08.645023537Z [2024-02-24 00:55:08,644: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:55:08.647457882Z [2024-02-24 00:55:08,647: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:08.647752493Z [2024-02-24 00:55:08,647: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:08.648177796Z [2024-02-24 00:55:08,647: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:08.648422551Z [2024-02-24 00:55:08,648: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:55:08.649897717Z [2024-02-24 00:55:08,649: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:55:08.650126169Z [2024-02-24 00:55:08,649: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:08.754894703Z [2024-02-24 00:55:08,754: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:09.359231932Z [2024-02-24 00:55:09,358: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a39f3687-5016-4206-95d2-d5b2496c0d9b] succeeded in 2.1547708039997815s: None
2024-02-24T00:55:09.399071223Z [2024-02-24 00:55:09,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dd3a1f5-d606-4686-92ec-03ed89727cbd] received
2024-02-24T00:55:09.406976663Z [2024-02-24 00:55:09,406: INFO/ForkPoolWorker-15] [3dd3a1f5-d606-4686-92ec-03ed89727cbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T00:55:09.726533659Z [2024-02-24 00:55:09,723: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T00:55:10.858502505Z [2024-02-24 00:55:10,858: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:55:10.862028081Z [2024-02-24 00:55:10,861: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:55:10.889406575Z [2024-02-24 00:55:10,889: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:55:10.891297938Z [2024-02-24 00:55:10,891: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:55:10.891538222Z [2024-02-24 00:55:10,891: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:55:10.891823296Z [2024-02-24 00:55:10,891: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:55:10.892013053Z [2024-02-24 00:55:10,891: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:55:10.892595968Z [2024-02-24 00:55:10,892: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T00:55:10.892779401Z [2024-02-24 00:55:10,892: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:55:11.050330382Z [2024-02-24 00:55:11,049: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:55:11.642878354Z [2024-02-24 00:55:11,642: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dd3a1f5-d606-4686-92ec-03ed89727cbd] succeeded in 2.2417640359999496s: None
2024-02-24T00:56:00.787303924Z [2024-02-24 00:56:00,786: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4518e5b3-7b51-47a2-95c0-005316fd652a] received
2024-02-24T00:56:00.790796425Z [2024-02-24 00:56:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3cebdb23-1e2e-4cfa-b48d-778ed4fc0849] received
2024-02-24T00:56:00.799877180Z [2024-02-24 00:56:00,799: INFO/ForkPoolWorker-15] [4518e5b3-7b51-47a2-95c0-005316fd652a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:56:00.800817422Z [2024-02-24 00:56:00,800: INFO/ForkPoolWorker-16] [3cebdb23-1e2e-4cfa-b48d-778ed4fc0849] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:56:00.807483963Z [2024-02-24 00:56:00,807: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b629c10-882f-416e-8262-be645b6a1bc1] received
2024-02-24T00:56:00.813973021Z [2024-02-24 00:56:00,813: INFO/ForkPoolWorker-1] [8b629c10-882f-416e-8262-be645b6a1bc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:56:00.822516023Z [2024-02-24 00:56:00,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23e5bc6f-296f-40ad-bcf7-02fd7f974ce8] received
2024-02-24T00:56:00.828045613Z [2024-02-24 00:56:00,827: INFO/ForkPoolWorker-2] [23e5bc6f-296f-40ad-bcf7-02fd7f974ce8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:56:01.163993251Z [2024-02-24 00:56:01,159: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:56:01.234363867Z [2024-02-24 00:56:01,217: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:56:01.270321278Z [2024-02-24 00:56:01,265: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:56:01.354214975Z [2024-02-24 00:56:01,342: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:56:01.505791314Z [2024-02-24 00:56:01,505: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T00:56:01.509602488Z [2024-02-24 00:56:01,509: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:56:01.538670534Z [2024-02-24 00:56:01,538: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:56:01.539540856Z [2024-02-24 00:56:01,539: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:56:01.539583431Z [2024-02-24 00:56:01,539: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:56:01.539646722Z [2024-02-24 00:56:01,539: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T00:56:01.539861034Z [2024-02-24 00:56:01,539: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:56:01.610645193Z [2024-02-24 00:56:01,610: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:56:01.627211595Z [2024-02-24 00:56:01,626: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:56:02.322078122Z [2024-02-24 00:56:02,321: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4518e5b3-7b51-47a2-95c0-005316fd652a] succeeded in 1.5317789570008244s: None
2024-02-24T00:56:02.346304273Z [2024-02-24 00:56:02,345: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[23e5bc6f-296f-40ad-bcf7-02fd7f974ce8] succeeded in 1.5222637990000294s: None
2024-02-24T00:56:02.942738758Z [2024-02-24 00:56:02,942: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:56:02.946565152Z [2024-02-24 00:56:02,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:56:02.969196742Z [2024-02-24 00:56:02,968: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:56:02.970737126Z [2024-02-24 00:56:02,970: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:56:02.970905528Z [2024-02-24 00:56:02,970: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:56:02.971035677Z [2024-02-24 00:56:02,970: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:56:02.971131424Z [2024-02-24 00:56:02,971: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:56:02.971417925Z [2024-02-24 00:56:02,971: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:56:02.971529996Z [2024-02-24 00:56:02,971: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:56:03.057188305Z [2024-02-24 00:56:03,056: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:56:03.060522662Z [2024-02-24 00:56:03,060: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:56:03.063883395Z [2024-02-24 00:56:03,063: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:56:03.113696175Z [2024-02-24 00:56:03,113: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:56:03.115511712Z [2024-02-24 00:56:03,115: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:56:03.115567679Z [2024-02-24 00:56:03,115: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:56:03.115873275Z [2024-02-24 00:56:03,115: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:56:03.116034884Z [2024-02-24 00:56:03,115: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:56:03.116517708Z [2024-02-24 00:56:03,116: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:56:03.117115346Z [2024-02-24 00:56:03,116: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:56:03.255747908Z [2024-02-24 00:56:03,255: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:56:05.302538902Z [2024-02-24 00:56:05,302: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3cebdb23-1e2e-4cfa-b48d-778ed4fc0849] succeeded in 4.509636679000323s: None
2024-02-24T00:56:05.573551711Z [2024-02-24 00:56:05,573: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b629c10-882f-416e-8262-be645b6a1bc1] succeeded in 4.764583786000003s: None
2024-02-24T00:57:01.302582666Z [2024-02-24 00:57:01,300: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71445e38-2243-4dfc-8c28-ba485b44e997] received
2024-02-24T00:57:01.321943564Z [2024-02-24 00:57:01,320: INFO/ForkPoolWorker-15] [71445e38-2243-4dfc-8c28-ba485b44e997] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:57:01.352121541Z [2024-02-24 00:57:01,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[afd637c6-7efa-4391-bb4b-78d546ede0ae] received
2024-02-24T00:57:01.363291573Z [2024-02-24 00:57:01,363: INFO/ForkPoolWorker-16] [afd637c6-7efa-4391-bb4b-78d546ede0ae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:57:01.378820353Z [2024-02-24 00:57:01,378: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8639a819-c673-4e24-a84e-33704119cd7d] received
2024-02-24T00:57:01.403584767Z [2024-02-24 00:57:01,403: INFO/ForkPoolWorker-1] [8639a819-c673-4e24-a84e-33704119cd7d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:57:01.814822859Z [2024-02-24 00:57:01,811: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:57:01.817147744Z [2024-02-24 00:57:01,812: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:57:01.875019999Z [2024-02-24 00:57:01,871: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:57:01.999703100Z [2024-02-24 00:57:01,999: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T00:57:02.003734582Z [2024-02-24 00:57:02,003: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:57:02.026990556Z [2024-02-24 00:57:02,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:57:02.028291961Z [2024-02-24 00:57:02,028: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:57:02.028515929Z [2024-02-24 00:57:02,028: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:57:02.028637059Z [2024-02-24 00:57:02,028: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T00:57:02.028980298Z [2024-02-24 00:57:02,028: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:57:02.131513619Z [2024-02-24 00:57:02,131: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:57:03.108841926Z [2024-02-24 00:57:03,108: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71445e38-2243-4dfc-8c28-ba485b44e997] succeeded in 1.8053746679997857s: None
2024-02-24T00:57:03.376685427Z [2024-02-24 00:57:03,376: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T00:57:03.380872065Z [2024-02-24 00:57:03,380: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:57:03.398473364Z [2024-02-24 00:57:03,398: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:57:03.400286016Z [2024-02-24 00:57:03,400: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:57:03.400454082Z [2024-02-24 00:57:03,400: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:57:03.404501448Z [2024-02-24 00:57:03,404: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:57:03.404663829Z [2024-02-24 00:57:03,404: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T00:57:03.405124680Z [2024-02-24 00:57:03,404: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:57:03.405268317Z [2024-02-24 00:57:03,405: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:57:03.483667715Z [2024-02-24 00:57:03,483: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:57:03.710019831Z [2024-02-24 00:57:03,709: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:57:03.714493373Z [2024-02-24 00:57:03,714: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:57:03.786237227Z [2024-02-24 00:57:03,785: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:57:03.798718853Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:57:03.798732799Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:57:03.798742600Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:57:03.798751421Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:57:03.798757417Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:57:03.798763730Z [2024-02-24 00:57:03,790: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:57:03.921330408Z [2024-02-24 00:57:03,921: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:57:06.485142580Z [2024-02-24 00:57:06,484: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8639a819-c673-4e24-a84e-33704119cd7d] succeeded in 5.102082426999914s: None
2024-02-24T00:57:07.211382178Z [2024-02-24 00:57:07,210: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[afd637c6-7efa-4391-bb4b-78d546ede0ae] succeeded in 5.855578245999823s: None
2024-02-24T00:58:00.465390524Z [2024-02-24 00:58:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57505e63-bc8a-4feb-b523-b381f5482b1a] received
2024-02-24T00:58:00.467785432Z [2024-02-24 00:58:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[073a4adb-8557-4082-814a-05493fdd261a] received
2024-02-24T00:58:00.472373704Z [2024-02-24 00:58:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4a87029-937f-4849-b748-134a6ac0fd5a] received
2024-02-24T00:58:00.474686995Z [2024-02-24 00:58:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87f09e28-a8b9-46dc-8686-d909a81a6a6f] received
2024-02-24T00:58:00.476397207Z [2024-02-24 00:58:00,476: INFO/ForkPoolWorker-16] [073a4adb-8557-4082-814a-05493fdd261a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:58:00.482002619Z [2024-02-24 00:58:00,481: INFO/ForkPoolWorker-15] [57505e63-bc8a-4feb-b523-b381f5482b1a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T00:58:00.488579772Z [2024-02-24 00:58:00,488: INFO/ForkPoolWorker-1] [f4a87029-937f-4849-b748-134a6ac0fd5a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:58:00.498576321Z [2024-02-24 00:58:00,498: INFO/ForkPoolWorker-2] [87f09e28-a8b9-46dc-8686-d909a81a6a6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:58:00.846524321Z [2024-02-24 00:58:00,843: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:58:00.850561226Z [2024-02-24 00:58:00,846: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T00:58:00.860247132Z [2024-02-24 00:58:00,856: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:58:00.988128677Z [2024-02-24 00:58:00,984: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:58:01.012953819Z [2024-02-24 00:58:01,012: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:58:01.016792707Z [2024-02-24 00:58:01,016: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:58:01.080467927Z [2024-02-24 00:58:01,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:58:01.086676442Z [2024-02-24 00:58:01,086: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:58:01.086869953Z [2024-02-24 00:58:01,086: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:58:01.086934509Z [2024-02-24 00:58:01,086: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:58:01.087211023Z [2024-02-24 00:58:01,087: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:58:01.198706658Z [2024-02-24 00:58:01,198: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:58:01.316811417Z [2024-02-24 00:58:01,316: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:58:01.968489289Z [2024-02-24 00:58:01,968: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57505e63-bc8a-4feb-b523-b381f5482b1a] succeeded in 1.4994702340000003s: None
2024-02-24T00:58:01.980905883Z [2024-02-24 00:58:01,980: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[073a4adb-8557-4082-814a-05493fdd261a] succeeded in 1.5120033659995897s: None
2024-02-24T00:58:02.365852018Z [2024-02-24 00:58:02,362: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:58:02.369849775Z [2024-02-24 00:58:02,365: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:58:02.424822998Z [2024-02-24 00:58:02,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:58:02.426191362Z [2024-02-24 00:58:02,425: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:58:02.426209410Z [2024-02-24 00:58:02,426: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:58:02.426322753Z [2024-02-24 00:58:02,426: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:58:02.426337282Z [2024-02-24 00:58:02,426: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:58:02.426628448Z [2024-02-24 00:58:02,426: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:58:02.426676050Z [2024-02-24 00:58:02,426: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:58:02.507214558Z [2024-02-24 00:58:02,506: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:58:02.631230900Z [2024-02-24 00:58:02,630: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T00:58:02.637289584Z [2024-02-24 00:58:02,635: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:58:02.714848736Z [2024-02-24 00:58:02,714: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T00:58:02.718605732Z [2024-02-24 00:58:02,718: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:58:02.718791799Z [2024-02-24 00:58:02,718: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:58:02.719150410Z [2024-02-24 00:58:02,718: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:58:02.719818594Z [2024-02-24 00:58:02,719: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T00:58:02.720365077Z [2024-02-24 00:58:02,720: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:58:02.721094144Z [2024-02-24 00:58:02,720: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:58:02.854374116Z [2024-02-24 00:58:02,854: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:58:04.504038860Z [2024-02-24 00:58:04,503: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4a87029-937f-4849-b748-134a6ac0fd5a] succeeded in 4.025302893999651s: None
2024-02-24T00:58:04.513754979Z [2024-02-24 00:58:04,513: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[87f09e28-a8b9-46dc-8686-d909a81a6a6f] succeeded in 4.037276627999745s: None
2024-02-24T00:59:00.385974151Z [2024-02-24 00:59:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc8e6c75-7efe-4129-b9d6-c76fe640e7ee] received
2024-02-24T00:59:00.394904524Z [2024-02-24 00:59:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62587390-cd42-4a1a-841a-eefb78a1e361] received
2024-02-24T00:59:00.396190725Z [2024-02-24 00:59:00,395: INFO/ForkPoolWorker-15] [bc8e6c75-7efe-4129-b9d6-c76fe640e7ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T00:59:00.397432643Z [2024-02-24 00:59:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b7b0f02-0b6f-4301-ae9d-c476ea11035f] received
2024-02-24T00:59:00.404980065Z [2024-02-24 00:59:00,404: INFO/ForkPoolWorker-16] [62587390-cd42-4a1a-841a-eefb78a1e361] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T00:59:00.409754012Z [2024-02-24 00:59:00,408: INFO/ForkPoolWorker-1] [6b7b0f02-0b6f-4301-ae9d-c476ea11035f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T00:59:00.813847427Z [2024-02-24 00:59:00,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T00:59:00.862276650Z [2024-02-24 00:59:00,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T00:59:00.918645959Z [2024-02-24 00:59:00,915: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T00:59:01.094949139Z [2024-02-24 00:59:01,094: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T00:59:01.102209190Z [2024-02-24 00:59:01,101: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:59:01.173562241Z [2024-02-24 00:59:01,173: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T00:59:01.175308451Z [2024-02-24 00:59:01,175: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T00:59:01.175346142Z [2024-02-24 00:59:01,175: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T00:59:01.175574920Z [2024-02-24 00:59:01,175: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T00:59:01.175786302Z [2024-02-24 00:59:01,175: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T00:59:01.353313284Z [2024-02-24 00:59:01,348: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:59:02.122810843Z [2024-02-24 00:59:02,122: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[62587390-cd42-4a1a-841a-eefb78a1e361] succeeded in 1.7258549149992177s: None
2024-02-24T00:59:02.231294856Z [2024-02-24 00:59:02,230: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T00:59:02.234935150Z [2024-02-24 00:59:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:59:02.276528446Z [2024-02-24 00:59:02,276: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T00:59:02.279829763Z [2024-02-24 00:59:02,279: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:59:02.279967782Z [2024-02-24 00:59:02,279: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:59:02.280321126Z [2024-02-24 00:59:02,280: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:59:02.280493230Z [2024-02-24 00:59:02,280: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T00:59:02.280964981Z [2024-02-24 00:59:02,280: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T00:59:02.281134689Z [2024-02-24 00:59:02,281: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:59:02.367304349Z [2024-02-24 00:59:02,366: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T00:59:02.371139965Z [2024-02-24 00:59:02,370: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T00:59:02.420183518Z [2024-02-24 00:59:02,419: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:59:02.445547571Z [2024-02-24 00:59:02,443: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T00:59:02.445586553Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T00:59:02.445593263Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T00:59:02.445601335Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T00:59:02.445609377Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T00:59:02.445616890Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T00:59:02.445623793Z [2024-02-24 00:59:02,444: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T00:59:02.531227416Z [2024-02-24 00:59:02,530: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T00:59:04.832288809Z [2024-02-24 00:59:04,831: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6b7b0f02-0b6f-4301-ae9d-c476ea11035f] succeeded in 4.432267447000413s: None
2024-02-24T00:59:05.266572936Z [2024-02-24 00:59:05,265: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc8e6c75-7efe-4129-b9d6-c76fe640e7ee] succeeded in 4.877210376999756s: None
2024-02-24T01:00:01.267396119Z [2024-02-24 01:00:01,266: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b448737e-dcb5-4484-968d-38744856fc25] received
2024-02-24T01:00:01.269126603Z [2024-02-24 01:00:01,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d8d728da-66a8-4543-8c79-770db61be6aa] received
2024-02-24T01:00:01.274264185Z [2024-02-24 01:00:01,273: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0066a550-369b-4050-bead-bc7e4b7b1c2e] received
2024-02-24T01:00:01.283100560Z [2024-02-24 01:00:01,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b344da3-9ea5-4e84-a471-7321ebbbc355] received
2024-02-24T01:00:01.283704070Z [2024-02-24 01:00:01,283: INFO/ForkPoolWorker-15] [b448737e-dcb5-4484-968d-38744856fc25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:00:01.288921010Z [2024-02-24 01:00:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75b9e3a7-3760-40f2-b06e-6f8be3a5e0f8] received
2024-02-24T01:00:01.289405430Z [2024-02-24 01:00:01,289: INFO/ForkPoolWorker-16] [d8d728da-66a8-4543-8c79-770db61be6aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T00:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:00:01.294838866Z [2024-02-24 01:00:01,294: INFO/ForkPoolWorker-1] [0066a550-369b-4050-bead-bc7e4b7b1c2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:00:01.300192974Z [2024-02-24 01:00:01,299: INFO/ForkPoolWorker-2] [6b344da3-9ea5-4e84-a471-7321ebbbc355] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:00:01.304544209Z [2024-02-24 01:00:01,304: INFO/ForkPoolWorker-3] [75b9e3a7-3760-40f2-b06e-6f8be3a5e0f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T00:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:00:01.711175805Z [2024-02-24 01:00:01,706: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:00:01.738358083Z [2024-02-24 01:00:01,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:00:01.809389064Z [2024-02-24 01:00:01,806: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:00:01.834774799Z [2024-02-24 01:00:01,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:00:01.918425563Z [2024-02-24 01:00:01,913: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:00:01.940686977Z [2024-02-24 01:00:01,940: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:00:01.945624981Z [2024-02-24 01:00:01,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:01.980455979Z [2024-02-24 01:00:01,980: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:00:01.982611570Z [2024-02-24 01:00:01,982: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:00:01.982632925Z [2024-02-24 01:00:01,982: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:00:01.982699616Z [2024-02-24 01:00:01,982: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:00:01.982894238Z [2024-02-24 01:00:01,982: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:00:02.085044621Z [2024-02-24 01:00:02,084: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T00:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:02.085618517Z [2024-02-24 01:00:02,085: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:02.779045459Z [2024-02-24 01:00:02,778: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d8d728da-66a8-4543-8c79-770db61be6aa] succeeded in 1.5001195479999296s: None
2024-02-24T01:00:02.799342553Z [2024-02-24 01:00:02,798: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6b344da3-9ea5-4e84-a471-7321ebbbc355] succeeded in 1.5141100279997772s: None
2024-02-24T01:00:03.408610862Z [2024-02-24 01:00:03,408: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:00:03.412408494Z [2024-02-24 01:00:03,411: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:03.433479553Z [2024-02-24 01:00:03,433: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:00:03.434881518Z [2024-02-24 01:00:03,434: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:03.434894669Z [2024-02-24 01:00:03,434: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:03.435267916Z [2024-02-24 01:00:03,434: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:03.435367249Z [2024-02-24 01:00:03,435: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:00:03.436094346Z [2024-02-24 01:00:03,435: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:00:03.436131796Z [2024-02-24 01:00:03,436: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:03.514486729Z [2024-02-24 01:00:03,513: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:03.615613270Z [2024-02-24 01:00:03,615: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T01:00:03.619190539Z [2024-02-24 01:00:03,618: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:03.656310310Z [2024-02-24 01:00:03,656: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:00:03.658116893Z [2024-02-24 01:00:03,657: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:03.658175726Z [2024-02-24 01:00:03,658: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:03.658336217Z [2024-02-24 01:00:03,658: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:03.658412566Z [2024-02-24 01:00:03,658: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T01:00:03.658701108Z [2024-02-24 01:00:03,658: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:00:03.658772351Z [2024-02-24 01:00:03,658: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:03.713298417Z [2024-02-24 01:00:03,712: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:00:03.716929299Z [2024-02-24 01:00:03,716: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:03.752011597Z [2024-02-24 01:00:03,751: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:00:03.754694596Z [2024-02-24 01:00:03,754: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:03.755428851Z [2024-02-24 01:00:03,755: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:03.755610321Z [2024-02-24 01:00:03,755: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:03.755821598Z [2024-02-24 01:00:03,755: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:03.755948332Z [2024-02-24 01:00:03,755: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:00:03.756297137Z [2024-02-24 01:00:03,756: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:00:03.756434154Z [2024-02-24 01:00:03,756: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:03.888887925Z [2024-02-24 01:00:03,887: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T00:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:04.189225912Z [2024-02-24 01:00:04,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4234531a-f4bc-4c64-a776-0f25afc97669] received
2024-02-24T01:00:04.199713307Z [2024-02-24 01:00:04,199: INFO/ForkPoolWorker-16] [4234531a-f4bc-4c64-a776-0f25afc97669] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:00:04.207181148Z [2024-02-24 01:00:04,206: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b448737e-dcb5-4484-968d-38744856fc25] succeeded in 2.939401640000142s: None
2024-02-24T01:00:04.500198842Z [2024-02-24 01:00:04,497: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:00:05.393728547Z [2024-02-24 01:00:05,393: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[75b9e3a7-3760-40f2-b06e-6f8be3a5e0f8] succeeded in 4.10162779699931s: None
2024-02-24T01:00:05.645874435Z [2024-02-24 01:00:05,645: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:00:05.649516809Z [2024-02-24 01:00:05,649: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:05.682265773Z [2024-02-24 01:00:05,682: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:00:05.683508156Z [2024-02-24 01:00:05,683: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:05.683595186Z [2024-02-24 01:00:05,683: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:05.683841419Z [2024-02-24 01:00:05,683: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:05.683859907Z [2024-02-24 01:00:05,683: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:00:05.684195144Z [2024-02-24 01:00:05,684: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:00:05.684307502Z [2024-02-24 01:00:05,684: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:05.784289692Z [2024-02-24 01:00:05,783: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:05.787212191Z [2024-02-24 01:00:05,786: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0066a550-369b-4050-bead-bc7e4b7b1c2e] succeeded in 4.510090116000356s: None
2024-02-24T01:00:06.288725923Z [2024-02-24 01:00:06,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16969339-b15a-4f44-a2ec-1cc08a4d8107] received
2024-02-24T01:00:06.301860059Z [2024-02-24 01:00:06,300: INFO/ForkPoolWorker-15] [16969339-b15a-4f44-a2ec-1cc08a4d8107] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:00:06.331938213Z [2024-02-24 01:00:06,331: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4234531a-f4bc-4c64-a776-0f25afc97669] succeeded in 2.1371664899997995s: None
2024-02-24T01:00:06.584506121Z [2024-02-24 01:00:06,581: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:00:07.802553000Z [2024-02-24 01:00:07,802: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:00:07.806061340Z [2024-02-24 01:00:07,805: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:07.833975233Z [2024-02-24 01:00:07,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:00:07.835453057Z [2024-02-24 01:00:07,835: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:07.835516512Z [2024-02-24 01:00:07,835: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:07.835756351Z [2024-02-24 01:00:07,835: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:07.835811582Z [2024-02-24 01:00:07,835: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:00:07.836214976Z [2024-02-24 01:00:07,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:00:07.836251483Z [2024-02-24 01:00:07,836: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:07.928768047Z [2024-02-24 01:00:07,928: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T00:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:08.509237447Z [2024-02-24 01:00:08,508: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16969339-b15a-4f44-a2ec-1cc08a4d8107] succeeded in 2.2182010629994693s: None
2024-02-24T01:00:08.666760549Z [2024-02-24 01:00:08,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3049934-a26b-45db-8c0a-3dc204402f1b] received
2024-02-24T01:00:08.676113920Z [2024-02-24 01:00:08,674: INFO/ForkPoolWorker-15] [c3049934-a26b-45db-8c0a-3dc204402f1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T00:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:00:08.976101618Z [2024-02-24 01:00:08,972: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:00:10.160262989Z [2024-02-24 01:00:10,159: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:00:10.164438727Z [2024-02-24 01:00:10,163: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:00:10.184777761Z [2024-02-24 01:00:10,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:00:10.186312702Z [2024-02-24 01:00:10,186: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:00:10.186467124Z [2024-02-24 01:00:10,186: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:00:10.186671450Z [2024-02-24 01:00:10,186: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:00:10.186816621Z [2024-02-24 01:00:10,186: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:00:10.187126283Z [2024-02-24 01:00:10,186: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:00:10.187268737Z [2024-02-24 01:00:10,187: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:00:10.288032909Z [2024-02-24 01:00:10,287: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T00:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:00:10.848374356Z [2024-02-24 01:00:10,847: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3049934-a26b-45db-8c0a-3dc204402f1b] succeeded in 2.179575274000854s: None
2024-02-24T01:01:00.387103839Z [2024-02-24 01:01:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbaca769-303b-4598-99cc-a243667be742] received
2024-02-24T01:01:00.390668146Z [2024-02-24 01:01:00,390: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f46f598-f840-4000-94e3-f24598917342] received
2024-02-24T01:01:00.395342153Z [2024-02-24 01:01:00,395: INFO/ForkPoolWorker-15] [dbaca769-303b-4598-99cc-a243667be742] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:01:00.398118210Z [2024-02-24 01:01:00,397: INFO/ForkPoolWorker-16] [4f46f598-f840-4000-94e3-f24598917342] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:01:00.404667624Z [2024-02-24 01:01:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35b1a507-a8ed-4389-8b35-e004725b9712] received
2024-02-24T01:01:00.413295391Z [2024-02-24 01:01:00,412: INFO/ForkPoolWorker-1] [35b1a507-a8ed-4389-8b35-e004725b9712] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:01:00.692314986Z [2024-02-24 01:01:00,688: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:01:00.700381849Z [2024-02-24 01:01:00,697: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:01:00.777956093Z [2024-02-24 01:01:00,774: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:01:00.854213987Z [2024-02-24 01:01:00,853: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:01:00.858102847Z [2024-02-24 01:01:00,857: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:01:00.880226450Z [2024-02-24 01:01:00,880: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:01:00.881739943Z [2024-02-24 01:01:00,881: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:01:00.881948293Z [2024-02-24 01:01:00,881: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:01:00.882012793Z [2024-02-24 01:01:00,881: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:01:00.882279781Z [2024-02-24 01:01:00,882: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:01:00.994184549Z [2024-02-24 01:01:00,993: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:01:01.552200259Z [2024-02-24 01:01:01,551: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4f46f598-f840-4000-94e3-f24598917342] succeeded in 1.1600575090005805s: None
2024-02-24T01:01:02.010643575Z [2024-02-24 01:01:02,010: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:01:02.014124069Z [2024-02-24 01:01:02,013: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:01:02.053299944Z [2024-02-24 01:01:02,053: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:01:02.055351123Z [2024-02-24 01:01:02,055: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:01:02.055559196Z [2024-02-24 01:01:02,055: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:01:02.055933623Z [2024-02-24 01:01:02,055: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:01:02.056115751Z [2024-02-24 01:01:02,055: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:01:02.056605466Z [2024-02-24 01:01:02,056: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:01:02.057379217Z [2024-02-24 01:01:02,056: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:01:02.100562485Z [2024-02-24 01:01:02,100: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:01:02.104094054Z [2024-02-24 01:01:02,103: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:01:02.154788119Z [2024-02-24 01:01:02,154: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:01:02.156352475Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:01:02.156421449Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:01:02.156579055Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:01:02.156636600Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:01:02.156938092Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:01:02.157009048Z [2024-02-24 01:01:02,156: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:01:02.173314145Z [2024-02-24 01:01:02,172: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:01:02.274774564Z [2024-02-24 01:01:02,274: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:01:04.044846158Z [2024-02-24 01:01:04,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[35b1a507-a8ed-4389-8b35-e004725b9712] succeeded in 3.634327482000117s: None
2024-02-24T01:01:04.084345668Z [2024-02-24 01:01:04,083: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbaca769-303b-4598-99cc-a243667be742] succeeded in 3.6943594889999076s: None
2024-02-24T01:02:01.278061005Z [2024-02-24 01:02:01,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8d3691-a067-4e65-830d-133f961c9238] received
2024-02-24T01:02:01.281893699Z [2024-02-24 01:02:01,280: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0f0c60ea-f590-4920-8c04-ce76621092d2] received
2024-02-24T01:02:01.290868774Z [2024-02-24 01:02:01,290: INFO/ForkPoolWorker-16] [0f0c60ea-f590-4920-8c04-ce76621092d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:02:01.308366491Z [2024-02-24 01:02:01,308: INFO/ForkPoolWorker-15] [9d8d3691-a067-4e65-830d-133f961c9238] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:02:01.313171641Z [2024-02-24 01:02:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c2d5712-7bf5-40b9-bc63-e85bbc83d56f] received
2024-02-24T01:02:01.319488231Z [2024-02-24 01:02:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[45e19e73-5664-458b-8cdd-1293ca677f4b] received
2024-02-24T01:02:01.321295301Z [2024-02-24 01:02:01,321: INFO/ForkPoolWorker-1] [8c2d5712-7bf5-40b9-bc63-e85bbc83d56f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:02:01.329106619Z [2024-02-24 01:02:01,328: INFO/ForkPoolWorker-2] [45e19e73-5664-458b-8cdd-1293ca677f4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:02:01.622785933Z [2024-02-24 01:02:01,618: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:02:01.674892066Z [2024-02-24 01:02:01,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:02:01.711116672Z [2024-02-24 01:02:01,706: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:02:01.741561612Z [2024-02-24 01:02:01,738: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:02:02.017260149Z [2024-02-24 01:02:02,016: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:02:02.021363877Z [2024-02-24 01:02:02,020: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:02:02.089234093Z [2024-02-24 01:02:02,089: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:02:02.090259530Z [2024-02-24 01:02:02,090: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:02:02.090402009Z [2024-02-24 01:02:02,090: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:02:02.090467430Z [2024-02-24 01:02:02,090: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:02:02.090715609Z [2024-02-24 01:02:02,090: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:02:02.122492149Z [2024-02-24 01:02:02,122: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:02:02.187378585Z [2024-02-24 01:02:02,187: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:02:02.884671607Z [2024-02-24 01:02:02,884: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9d8d3691-a067-4e65-830d-133f961c9238] succeeded in 1.604958978000468s: None
2024-02-24T01:02:02.992111685Z [2024-02-24 01:02:02,991: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c2d5712-7bf5-40b9-bc63-e85bbc83d56f] succeeded in 1.6772610029993302s: None
2024-02-24T01:02:03.139646409Z [2024-02-24 01:02:03,138: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:02:03.143309357Z [2024-02-24 01:02:03,142: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:02:03.171222541Z [2024-02-24 01:02:03,170: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:02:03.172621700Z [2024-02-24 01:02:03,172: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:02:03.172713439Z [2024-02-24 01:02:03,172: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:02:03.172797954Z [2024-02-24 01:02:03,172: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:02:03.172854271Z [2024-02-24 01:02:03,172: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:02:03.173302324Z [2024-02-24 01:02:03,173: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:02:03.173318337Z [2024-02-24 01:02:03,173: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:02:03.261624611Z [2024-02-24 01:02:03,261: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:02:03.274637336Z [2024-02-24 01:02:03,274: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:02:03.277939260Z [2024-02-24 01:02:03,277: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:02:03.297225685Z [2024-02-24 01:02:03,296: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:02:03.299507121Z [2024-02-24 01:02:03,299: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:02:03.299546017Z [2024-02-24 01:02:03,299: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:02:03.301014101Z [2024-02-24 01:02:03,299: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:02:03.301708251Z [2024-02-24 01:02:03,300: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:02:03.302199354Z [2024-02-24 01:02:03,301: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:02:03.302232200Z [2024-02-24 01:02:03,302: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:02:03.391249572Z [2024-02-24 01:02:03,390: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:02:04.993066871Z [2024-02-24 01:02:04,992: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[45e19e73-5664-458b-8cdd-1293ca677f4b] succeeded in 3.6708845780003685s: None
2024-02-24T01:02:05.188857040Z [2024-02-24 01:02:05,188: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0f0c60ea-f590-4920-8c04-ce76621092d2] succeeded in 3.905943519000175s: None
2024-02-24T01:03:00.962376717Z [2024-02-24 01:03:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38f25de5-ff08-42a0-aefb-b5e117a7087f] received
2024-02-24T01:03:00.976967887Z [2024-02-24 01:03:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a58833c3-3f3e-453b-9f70-aeadb86910e7] received
2024-02-24T01:03:00.978160072Z [2024-02-24 01:03:00,977: INFO/ForkPoolWorker-15] [38f25de5-ff08-42a0-aefb-b5e117a7087f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:03:00.985559222Z [2024-02-24 01:03:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81a632a9-dbe6-4630-b7fc-734d5e9a9d65] received
2024-02-24T01:03:00.998463776Z [2024-02-24 01:03:00,998: INFO/ForkPoolWorker-16] [a58833c3-3f3e-453b-9f70-aeadb86910e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:03:01.010083697Z [2024-02-24 01:03:01,008: INFO/ForkPoolWorker-1] [81a632a9-dbe6-4630-b7fc-734d5e9a9d65] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:03:01.445217687Z [2024-02-24 01:03:01,439: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:03:01.832501487Z [2024-02-24 01:03:01,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:03:02.127405291Z [2024-02-24 01:03:02,109: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:03:02.199758761Z [2024-02-24 01:03:02,199: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:03:02.215032453Z [2024-02-24 01:03:02,214: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:03:02.388783004Z [2024-02-24 01:03:02,387: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:03:02.393132809Z [2024-02-24 01:03:02,391: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:03:02.393158133Z [2024-02-24 01:03:02,391: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:03:02.393162734Z [2024-02-24 01:03:02,391: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:03:02.393166197Z [2024-02-24 01:03:02,391: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:03:02.987506909Z [2024-02-24 01:03:02,987: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:03:04.101935086Z [2024-02-24 01:03:04,097: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a58833c3-3f3e-453b-9f70-aeadb86910e7] succeeded in 3.1181447440003467s: None
2024-02-24T01:03:04.375110867Z [2024-02-24 01:03:04,374: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:03:04.378505341Z [2024-02-24 01:03:04,378: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:03:04.400119221Z [2024-02-24 01:03:04,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:03:04.401316146Z [2024-02-24 01:03:04,401: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:03:04.401443244Z [2024-02-24 01:03:04,401: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:03:04.402061299Z [2024-02-24 01:03:04,401: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:03:04.402322528Z [2024-02-24 01:03:04,402: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:03:04.402645224Z [2024-02-24 01:03:04,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:03:04.402989157Z [2024-02-24 01:03:04,402: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:03:04.480252710Z [2024-02-24 01:03:04,479: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:03:04.878959839Z [2024-02-24 01:03:04,878: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:03:04.882459554Z [2024-02-24 01:03:04,882: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:03:04.903289744Z [2024-02-24 01:03:04,903: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:03:04.904694282Z [2024-02-24 01:03:04,904: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:03:04.904842873Z [2024-02-24 01:03:04,904: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:03:04.905066635Z [2024-02-24 01:03:04,904: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:03:04.905266041Z [2024-02-24 01:03:04,905: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:03:04.905654769Z [2024-02-24 01:03:04,905: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:03:04.905878032Z [2024-02-24 01:03:04,905: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:03:04.987932644Z [2024-02-24 01:03:04,987: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:03:06.531492293Z [2024-02-24 01:03:06,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38f25de5-ff08-42a0-aefb-b5e117a7087f] succeeded in 5.566526405000332s: None
2024-02-24T01:03:07.804236201Z [2024-02-24 01:03:07,803: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81a632a9-dbe6-4630-b7fc-734d5e9a9d65] succeeded in 6.809411395000097s: None
2024-02-24T01:04:00.424824709Z [2024-02-24 01:04:00,424: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbcc05f4-d7c5-4303-99a8-62f2e1e88529] received
2024-02-24T01:04:00.427488488Z [2024-02-24 01:04:00,427: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[048a081a-011d-4bfb-b3b9-52b6abdaa443] received
2024-02-24T01:04:00.436218993Z [2024-02-24 01:04:00,435: INFO/ForkPoolWorker-15] [cbcc05f4-d7c5-4303-99a8-62f2e1e88529] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:04:00.436593382Z [2024-02-24 01:04:00,436: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae3cee21-fd1c-45d9-aed2-458d2717cda4] received
2024-02-24T01:04:00.444043488Z [2024-02-24 01:04:00,443: INFO/ForkPoolWorker-1] [ae3cee21-fd1c-45d9-aed2-458d2717cda4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:04:00.444549225Z [2024-02-24 01:04:00,444: INFO/ForkPoolWorker-16] [048a081a-011d-4bfb-b3b9-52b6abdaa443] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:04:00.452585861Z [2024-02-24 01:04:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c12018f-a66c-4907-bcbf-f6ee060cd1f8] received
2024-02-24T01:04:00.475625920Z [2024-02-24 01:04:00,475: INFO/ForkPoolWorker-2] [6c12018f-a66c-4907-bcbf-f6ee060cd1f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:04:00.807789999Z [2024-02-24 01:04:00,803: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:04:00.914310679Z [2024-02-24 01:04:00,910: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:04:00.924155424Z [2024-02-24 01:04:00,920: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:04:01.066835886Z [2024-02-24 01:04:01,066: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:04:01.071268781Z [2024-02-24 01:04:01,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:04:01.100596821Z [2024-02-24 01:04:01,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:04:01.102632620Z [2024-02-24 01:04:01,102: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:04:01.102828902Z [2024-02-24 01:04:01,102: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:04:01.102884702Z [2024-02-24 01:04:01,102: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:04:01.103146217Z [2024-02-24 01:04:01,103: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:04:01.123798289Z [2024-02-24 01:04:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:04:01.321008337Z [2024-02-24 01:04:01,319: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:04:01.434370546Z [2024-02-24 01:04:01,434: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:04:02.006590671Z [2024-02-24 01:04:02,006: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbcc05f4-d7c5-4303-99a8-62f2e1e88529] succeeded in 1.5775226570003724s: None
2024-02-24T01:04:02.322262702Z [2024-02-24 01:04:02,321: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[048a081a-011d-4bfb-b3b9-52b6abdaa443] succeeded in 1.8903813659999287s: None
2024-02-24T01:04:02.902877197Z [2024-02-24 01:04:02,902: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:04:02.906298457Z [2024-02-24 01:04:02,905: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:04:02.930501285Z [2024-02-24 01:04:02,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:04:02.932246570Z [2024-02-24 01:04:02,931: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:04:02.932427966Z [2024-02-24 01:04:02,932: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:04:02.932664737Z [2024-02-24 01:04:02,932: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:04:02.932840501Z [2024-02-24 01:04:02,932: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:04:02.933203085Z [2024-02-24 01:04:02,933: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:04:02.933367408Z [2024-02-24 01:04:02,933: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:04:03.049502871Z [2024-02-24 01:04:03,049: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:04:03.055276551Z [2024-02-24 01:04:03,054: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:04:03.058921261Z [2024-02-24 01:04:03,058: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:04:03.083304656Z [2024-02-24 01:04:03,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:04:03.084553947Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:04:03.084597003Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:04:03.084745617Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:04:03.084755100Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:04:03.085049734Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:04:03.085088861Z [2024-02-24 01:04:03,084: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:04:03.184863559Z [2024-02-24 01:04:03,184: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:04:05.171635878Z [2024-02-24 01:04:05,170: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6c12018f-a66c-4907-bcbf-f6ee060cd1f8] succeeded in 4.716128650999963s: None
2024-02-24T01:04:05.189580621Z [2024-02-24 01:04:05,189: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae3cee21-fd1c-45d9-aed2-458d2717cda4] succeeded in 4.750707412999873s: None
2024-02-24T01:05:00.336609546Z [2024-02-24 01:05:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26aeea30-6ade-46c5-9f78-59b8aebeee56] received
2024-02-24T01:05:00.339353632Z [2024-02-24 01:05:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23821bbf-7fe4-4f6d-ab80-6e61f494c525] received
2024-02-24T01:05:00.342816689Z [2024-02-24 01:05:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41775535-3f49-4e61-911e-2a2edd1621b4] received
2024-02-24T01:05:00.343509544Z [2024-02-24 01:05:00,343: INFO/ForkPoolWorker-15] [26aeea30-6ade-46c5-9f78-59b8aebeee56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:05:00.345935566Z [2024-02-24 01:05:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b7212e9-f3ad-4765-bb70-9867364c6631] received
2024-02-24T01:05:00.346932085Z [2024-02-24 01:05:00,346: INFO/ForkPoolWorker-16] [23821bbf-7fe4-4f6d-ab80-6e61f494c525] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:05:00.351647476Z [2024-02-24 01:05:00,351: INFO/ForkPoolWorker-1] [41775535-3f49-4e61-911e-2a2edd1621b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:05:00.352952365Z [2024-02-24 01:05:00,352: INFO/ForkPoolWorker-2] [4b7212e9-f3ad-4765-bb70-9867364c6631] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:05:00.671229672Z [2024-02-24 01:05:00,667: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:05:00.691796247Z [2024-02-24 01:05:00,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:05:00.724678029Z [2024-02-24 01:05:00,721: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:05:00.826373501Z [2024-02-24 01:05:00,822: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:05:00.913080043Z [2024-02-24 01:05:00,912: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:05:00.917316893Z [2024-02-24 01:05:00,916: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:00.946597015Z [2024-02-24 01:05:00,946: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:05:00.948300257Z [2024-02-24 01:05:00,947: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:05:00.948471219Z [2024-02-24 01:05:00,948: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:05:00.948592811Z [2024-02-24 01:05:00,948: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:05:00.948880841Z [2024-02-24 01:05:00,948: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:05:01.044256420Z [2024-02-24 01:05:01,043: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:01.725643307Z [2024-02-24 01:05:01,725: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[41775535-3f49-4e61-911e-2a2edd1621b4] succeeded in 1.381128128000455s: None
2024-02-24T01:05:02.081705194Z [2024-02-24 01:05:02,081: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:05:02.084939091Z [2024-02-24 01:05:02,084: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:02.114772713Z [2024-02-24 01:05:02,114: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:05:02.116285789Z [2024-02-24 01:05:02,116: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:02.116425395Z [2024-02-24 01:05:02,116: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:02.116599592Z [2024-02-24 01:05:02,116: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:02.116743772Z [2024-02-24 01:05:02,116: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:05:02.117225665Z [2024-02-24 01:05:02,116: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:05:02.117423464Z [2024-02-24 01:05:02,117: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:02.117450666Z [2024-02-24 01:05:02,117: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:05:02.120929601Z [2024-02-24 01:05:02,120: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:02.160707540Z [2024-02-24 01:05:02,160: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:05:02.166698442Z [2024-02-24 01:05:02,166: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:02.166985964Z [2024-02-24 01:05:02,166: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:02.167514048Z [2024-02-24 01:05:02,166: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:02.167750104Z [2024-02-24 01:05:02,167: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:05:02.169235214Z [2024-02-24 01:05:02,168: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:05:02.169532837Z [2024-02-24 01:05:02,169: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:02.189846600Z [2024-02-24 01:05:02,189: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:05:02.193869103Z [2024-02-24 01:05:02,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:02.206636412Z [2024-02-24 01:05:02,206: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:02.221483081Z [2024-02-24 01:05:02,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:05:02.223294228Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:02.223390398Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:02.223570288Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:02.223661507Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:05:02.223980695Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:05:02.224052210Z [2024-02-24 01:05:02,223: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:02.265161015Z [2024-02-24 01:05:02,264: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:02.342726564Z [2024-02-24 01:05:02,342: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:03.282725418Z [2024-02-24 01:05:03,282: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[26aeea30-6ade-46c5-9f78-59b8aebeee56] succeeded in 2.9440467670001453s: None
2024-02-24T01:05:04.090444158Z [2024-02-24 01:05:04,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[617fac58-9780-410b-b67f-d150af97b569] received
2024-02-24T01:05:04.102416779Z [2024-02-24 01:05:04,102: INFO/ForkPoolWorker-15] [617fac58-9780-410b-b67f-d150af97b569] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:05:04.186426270Z [2024-02-24 01:05:04,185: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[23821bbf-7fe4-4f6d-ab80-6e61f494c525] succeeded in 3.844899398999587s: None
2024-02-24T01:05:04.410489894Z [2024-02-24 01:05:04,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:05:04.500916595Z [2024-02-24 01:05:04,500: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4b7212e9-f3ad-4765-bb70-9867364c6631] succeeded in 4.153186311999889s: None
2024-02-24T01:05:05.598739750Z [2024-02-24 01:05:05,598: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:05:05.606518220Z [2024-02-24 01:05:05,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:05.641319611Z [2024-02-24 01:05:05,640: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:05:05.642571755Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:05.642663594Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:05.642714288Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:05.642728815Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:05:05.642933376Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:05:05.643055488Z [2024-02-24 01:05:05,642: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:05.721521551Z [2024-02-24 01:05:05,721: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:06.406194056Z [2024-02-24 01:05:06,404: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[617fac58-9780-410b-b67f-d150af97b569] succeeded in 2.3133265929991467s: None
2024-02-24T01:05:06.875798341Z [2024-02-24 01:05:06,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dfc7a48-42f6-4ac0-b248-6b6a1d49b2a0] received
2024-02-24T01:05:06.885373141Z [2024-02-24 01:05:06,884: INFO/ForkPoolWorker-15] [4dfc7a48-42f6-4ac0-b248-6b6a1d49b2a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:05:07.204254239Z [2024-02-24 01:05:07,200: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:05:08.366448607Z [2024-02-24 01:05:08,366: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:05:08.370094993Z [2024-02-24 01:05:08,369: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:08.390697659Z [2024-02-24 01:05:08,390: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:05:08.392033697Z [2024-02-24 01:05:08,391: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:08.392202191Z [2024-02-24 01:05:08,392: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:08.392411401Z [2024-02-24 01:05:08,392: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:08.392544912Z [2024-02-24 01:05:08,392: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:05:08.392900260Z [2024-02-24 01:05:08,392: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:05:08.393073405Z [2024-02-24 01:05:08,392: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:08.487821993Z [2024-02-24 01:05:08,487: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:09.132202233Z [2024-02-24 01:05:09,129: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4dfc7a48-42f6-4ac0-b248-6b6a1d49b2a0] succeeded in 2.250592842000515s: None
2024-02-24T01:05:09.242367285Z [2024-02-24 01:05:09,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42b0dd03-e5ad-46ea-87ae-426526eb24b7] received
2024-02-24T01:05:09.250689840Z [2024-02-24 01:05:09,250: INFO/ForkPoolWorker-15] [42b0dd03-e5ad-46ea-87ae-426526eb24b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:05:09.586105185Z [2024-02-24 01:05:09,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:05:10.751546975Z [2024-02-24 01:05:10,751: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:05:10.755161809Z [2024-02-24 01:05:10,754: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:05:10.777426069Z [2024-02-24 01:05:10,777: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:05:10.779056472Z [2024-02-24 01:05:10,778: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:05:10.779081131Z [2024-02-24 01:05:10,778: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:05:10.779200626Z [2024-02-24 01:05:10,779: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:05:10.779265845Z [2024-02-24 01:05:10,779: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:05:10.779506334Z [2024-02-24 01:05:10,779: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:05:10.779527440Z [2024-02-24 01:05:10,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:05:10.863103273Z [2024-02-24 01:05:10,862: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:05:11.514034007Z [2024-02-24 01:05:11,512: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[42b0dd03-e5ad-46ea-87ae-426526eb24b7] succeeded in 2.2669615240001804s: None
2024-02-24T01:06:00.762631774Z [2024-02-24 01:06:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc5dcd07-72d8-483a-a3ad-e0b992bbcf03] received
2024-02-24T01:06:00.765381902Z [2024-02-24 01:06:00,765: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83b4784a-936f-446e-a334-917fce3ce213] received
2024-02-24T01:06:00.771733637Z [2024-02-24 01:06:00,771: INFO/ForkPoolWorker-16] [83b4784a-936f-446e-a334-917fce3ce213] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:06:00.777142189Z [2024-02-24 01:06:00,776: INFO/ForkPoolWorker-15] [bc5dcd07-72d8-483a-a3ad-e0b992bbcf03] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:06:00.780287677Z [2024-02-24 01:06:00,780: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c524038-858f-4149-ad80-e8be8c89ac35] received
2024-02-24T01:06:00.781761821Z [2024-02-24 01:06:00,781: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f26121b3-5656-43a5-bea5-509b41de7cb1] received
2024-02-24T01:06:00.791489028Z [2024-02-24 01:06:00,791: INFO/ForkPoolWorker-1] [1c524038-858f-4149-ad80-e8be8c89ac35] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:06:00.796748281Z [2024-02-24 01:06:00,796: INFO/ForkPoolWorker-2] [f26121b3-5656-43a5-bea5-509b41de7cb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:06:01.117690776Z [2024-02-24 01:06:01,114: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:06:01.174993902Z [2024-02-24 01:06:01,171: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:06:01.386506867Z [2024-02-24 01:06:01,383: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:06:01.412507845Z [2024-02-24 01:06:01,409: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:06:01.451673250Z [2024-02-24 01:06:01,451: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:06:01.456033035Z [2024-02-24 01:06:01,455: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:06:01.491695992Z [2024-02-24 01:06:01,491: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:06:01.493352705Z [2024-02-24 01:06:01,493: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:06:01.493532016Z [2024-02-24 01:06:01,493: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:06:01.495617224Z [2024-02-24 01:06:01,493: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:06:01.496030817Z [2024-02-24 01:06:01,495: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:06:01.603929759Z [2024-02-24 01:06:01,603: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:06:01.616685182Z [2024-02-24 01:06:01,616: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:06:02.291288804Z [2024-02-24 01:06:02,290: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bc5dcd07-72d8-483a-a3ad-e0b992bbcf03] succeeded in 1.5242778270003328s: None
2024-02-24T01:06:02.372006388Z [2024-02-24 01:06:02,371: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c524038-858f-4149-ad80-e8be8c89ac35] succeeded in 1.5889930840003217s: None
2024-02-24T01:06:02.878719410Z [2024-02-24 01:06:02,878: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:06:02.882062877Z [2024-02-24 01:06:02,881: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:06:02.903336312Z [2024-02-24 01:06:02,903: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:06:02.904537372Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:06:02.904551411Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:06:02.904681653Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:06:02.904717758Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:06:02.904947292Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:06:02.905017987Z [2024-02-24 01:06:02,904: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:06:03.024199493Z [2024-02-24 01:06:03,023: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:06:03.129067462Z [2024-02-24 01:06:03,128: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:06:03.132449095Z [2024-02-24 01:06:03,131: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:06:03.162922672Z [2024-02-24 01:06:03,162: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:06:03.164961580Z [2024-02-24 01:06:03,164: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:06:03.165038633Z [2024-02-24 01:06:03,164: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:06:03.165062435Z [2024-02-24 01:06:03,164: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:06:03.165206021Z [2024-02-24 01:06:03,164: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:06:03.165387939Z [2024-02-24 01:06:03,165: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:06:03.165467766Z [2024-02-24 01:06:03,165: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:06:03.267197044Z [2024-02-24 01:06:03,266: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:06:05.618982344Z [2024-02-24 01:06:05,618: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f26121b3-5656-43a5-bea5-509b41de7cb1] succeeded in 4.83580203099973s: None
2024-02-24T01:06:06.129911072Z [2024-02-24 01:06:06,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[83b4784a-936f-446e-a334-917fce3ce213] succeeded in 5.363114022000445s: None
2024-02-24T01:07:01.292255221Z [2024-02-24 01:07:01,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[642d9f89-262d-4d37-9873-22935fd06784] received
2024-02-24T01:07:01.293678553Z [2024-02-24 01:07:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e552a2e-205a-4382-b66f-11f921ec399a] received
2024-02-24T01:07:01.300409758Z [2024-02-24 01:07:01,300: INFO/ForkPoolWorker-15] [642d9f89-262d-4d37-9873-22935fd06784] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:07:01.304197318Z [2024-02-24 01:07:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f62affc5-ea25-4f6f-8fc4-81a940cf37ef] received
2024-02-24T01:07:01.315677540Z [2024-02-24 01:07:01,315: INFO/ForkPoolWorker-16] [9e552a2e-205a-4382-b66f-11f921ec399a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:07:01.316585266Z [2024-02-24 01:07:01,316: INFO/ForkPoolWorker-1] [f62affc5-ea25-4f6f-8fc4-81a940cf37ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:07:01.593416799Z [2024-02-24 01:07:01,590: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:07:01.666017554Z [2024-02-24 01:07:01,661: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:07:01.703257063Z [2024-02-24 01:07:01,699: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:07:01.839620382Z [2024-02-24 01:07:01,838: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:07:01.844161657Z [2024-02-24 01:07:01,843: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:07:01.884975259Z [2024-02-24 01:07:01,884: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:07:01.890959071Z [2024-02-24 01:07:01,890: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:07:01.891277537Z [2024-02-24 01:07:01,890: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:07:01.891614801Z [2024-02-24 01:07:01,891: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:07:01.892047199Z [2024-02-24 01:07:01,891: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:07:01.989366472Z [2024-02-24 01:07:01,989: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:07:02.622101509Z [2024-02-24 01:07:02,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e552a2e-205a-4382-b66f-11f921ec399a] succeeded in 1.3197496689999753s: None
2024-02-24T01:07:03.003724073Z [2024-02-24 01:07:03,003: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:07:03.007342320Z [2024-02-24 01:07:03,006: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:07:03.030923467Z [2024-02-24 01:07:03,030: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:07:03.033082200Z [2024-02-24 01:07:03,032: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:07:03.033300313Z [2024-02-24 01:07:03,032: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:07:03.033555909Z [2024-02-24 01:07:03,033: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:07:03.033696998Z [2024-02-24 01:07:03,033: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:07:03.034194010Z [2024-02-24 01:07:03,034: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:07:03.034350554Z [2024-02-24 01:07:03,034: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:07:03.103705453Z [2024-02-24 01:07:03,103: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:07:03.107666538Z [2024-02-24 01:07:03,107: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:07:03.110426179Z [2024-02-24 01:07:03,110: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:07:03.130281003Z [2024-02-24 01:07:03,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:07:03.131943133Z [2024-02-24 01:07:03,131: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:07:03.131992881Z [2024-02-24 01:07:03,131: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:07:03.132096233Z [2024-02-24 01:07:03,131: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:07:03.132147567Z [2024-02-24 01:07:03,132: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:07:03.132393789Z [2024-02-24 01:07:03,132: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:07:03.132451946Z [2024-02-24 01:07:03,132: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:07:03.260879780Z [2024-02-24 01:07:03,260: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:07:05.947974659Z [2024-02-24 01:07:05,947: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f62affc5-ea25-4f6f-8fc4-81a940cf37ef] succeeded in 4.640744497999549s: None
2024-02-24T01:07:07.085992626Z [2024-02-24 01:07:07,084: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[642d9f89-262d-4d37-9873-22935fd06784] succeeded in 5.790269226000419s: None
2024-02-24T01:08:01.250373199Z [2024-02-24 01:08:01,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95294d7b-9c1e-464b-a7f1-51873227b2bf] received
2024-02-24T01:08:01.276006296Z [2024-02-24 01:08:01,271: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c7f8b84-22f6-4f14-ab93-2b445a1b7af1] received
2024-02-24T01:08:01.276027083Z [2024-02-24 01:08:01,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39979b7e-50d2-46fd-9419-7a5d53e4a6dd] received
2024-02-24T01:08:01.276042103Z [2024-02-24 01:08:01,275: INFO/ForkPoolWorker-15] [95294d7b-9c1e-464b-a7f1-51873227b2bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:08:01.283788908Z [2024-02-24 01:08:01,283: INFO/ForkPoolWorker-16] [6c7f8b84-22f6-4f14-ab93-2b445a1b7af1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:08:01.290700949Z [2024-02-24 01:08:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c587deb0-3ca1-450a-ac7d-e1c5a9da30e6] received
2024-02-24T01:08:01.304184702Z [2024-02-24 01:08:01,303: INFO/ForkPoolWorker-2] [c587deb0-3ca1-450a-ac7d-e1c5a9da30e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:08:01.310462387Z [2024-02-24 01:08:01,310: INFO/ForkPoolWorker-1] [39979b7e-50d2-46fd-9419-7a5d53e4a6dd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:08:01.588870222Z [2024-02-24 01:08:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:08:01.642574806Z [2024-02-24 01:08:01,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:08:01.761642790Z [2024-02-24 01:08:01,757: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:08:01.784546804Z [2024-02-24 01:08:01,784: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:08:01.792860599Z [2024-02-24 01:08:01,787: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:08:01.840706917Z [2024-02-24 01:08:01,840: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:08:01.844485087Z [2024-02-24 01:08:01,844: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:08:01.844942577Z [2024-02-24 01:08:01,844: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:08:01.845104720Z [2024-02-24 01:08:01,844: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:08:01.845544707Z [2024-02-24 01:08:01,845: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:08:01.877524965Z [2024-02-24 01:08:01,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:08:01.957331721Z [2024-02-24 01:08:01,957: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:08:02.206232581Z [2024-02-24 01:08:02,205: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:08:02.600304563Z [2024-02-24 01:08:02,599: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[95294d7b-9c1e-464b-a7f1-51873227b2bf] succeeded in 1.3484534250001161s: None
2024-02-24T01:08:02.923557370Z [2024-02-24 01:08:02,923: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[39979b7e-50d2-46fd-9419-7a5d53e4a6dd] succeeded in 1.637757569000314s: None
2024-02-24T01:08:03.174000136Z [2024-02-24 01:08:03,173: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:08:03.177455330Z [2024-02-24 01:08:03,176: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:08:03.192563543Z [2024-02-24 01:08:03,192: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:08:03.196957548Z [2024-02-24 01:08:03,196: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:08:03.202751957Z [2024-02-24 01:08:03,202: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:08:03.204422557Z [2024-02-24 01:08:03,204: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:08:03.204514717Z [2024-02-24 01:08:03,204: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:08:03.204730116Z [2024-02-24 01:08:03,204: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:08:03.204837595Z [2024-02-24 01:08:03,204: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:08:03.205165109Z [2024-02-24 01:08:03,204: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:08:03.206235277Z [2024-02-24 01:08:03,205: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:08:03.226153289Z [2024-02-24 01:08:03,225: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:08:03.227590090Z [2024-02-24 01:08:03,227: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:08:03.227625849Z [2024-02-24 01:08:03,227: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:08:03.227783034Z [2024-02-24 01:08:03,227: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:08:03.227818782Z [2024-02-24 01:08:03,227: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:08:03.228424100Z [2024-02-24 01:08:03,227: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:08:03.228506361Z [2024-02-24 01:08:03,228: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:08:03.305480038Z [2024-02-24 01:08:03,305: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:08:03.340867581Z [2024-02-24 01:08:03,340: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:08:05.247045974Z [2024-02-24 01:08:05,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c7f8b84-22f6-4f14-ab93-2b445a1b7af1] succeeded in 3.9703554880006777s: None
2024-02-24T01:08:05.662342054Z [2024-02-24 01:08:05,661: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c587deb0-3ca1-450a-ac7d-e1c5a9da30e6] succeeded in 4.3671277680005005s: None
2024-02-24T01:09:01.250135382Z [2024-02-24 01:09:01,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b103b2d5-9270-4248-bbb4-64fb8abe4c17] received
2024-02-24T01:09:01.260688693Z [2024-02-24 01:09:01,260: INFO/ForkPoolWorker-15] [b103b2d5-9270-4248-bbb4-64fb8abe4c17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:09:01.296337650Z [2024-02-24 01:09:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50c0e25a-7687-433d-a6d8-f765bd40650e] received
2024-02-24T01:09:01.306578731Z [2024-02-24 01:09:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3af7d855-824a-4000-ac0a-2dc007e49454] received
2024-02-24T01:09:01.310414350Z [2024-02-24 01:09:01,310: INFO/ForkPoolWorker-16] [50c0e25a-7687-433d-a6d8-f765bd40650e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:09:01.323104324Z [2024-02-24 01:09:01,322: INFO/ForkPoolWorker-1] [3af7d855-824a-4000-ac0a-2dc007e49454] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:09:01.580272412Z [2024-02-24 01:09:01,576: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:09:01.639343657Z [2024-02-24 01:09:01,635: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:09:01.670693016Z [2024-02-24 01:09:01,667: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:09:01.834721072Z [2024-02-24 01:09:01,834: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:09:01.839039430Z [2024-02-24 01:09:01,838: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:09:01.867197424Z [2024-02-24 01:09:01,866: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:09:01.869617962Z [2024-02-24 01:09:01,869: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:09:01.870074305Z [2024-02-24 01:09:01,869: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:09:01.870333909Z [2024-02-24 01:09:01,870: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:09:01.870810827Z [2024-02-24 01:09:01,870: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:09:01.992108817Z [2024-02-24 01:09:01,991: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:09:02.624627096Z [2024-02-24 01:09:02,624: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[50c0e25a-7687-433d-a6d8-f765bd40650e] succeeded in 1.324643651999395s: None
2024-02-24T01:09:02.881069996Z [2024-02-24 01:09:02,880: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:09:02.885060618Z [2024-02-24 01:09:02,884: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:09:02.910007257Z [2024-02-24 01:09:02,909: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:09:02.911482310Z [2024-02-24 01:09:02,911: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:09:02.913102194Z [2024-02-24 01:09:02,912: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:09:02.913181387Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:09:02.913300869Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:09:02.913360468Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:09:02.913607052Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:09:02.913647570Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:09:02.914428570Z [2024-02-24 01:09:02,913: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:09:02.939442550Z [2024-02-24 01:09:02,939: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:09:02.941009950Z [2024-02-24 01:09:02,940: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:09:02.941306352Z [2024-02-24 01:09:02,941: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:09:02.941645957Z [2024-02-24 01:09:02,941: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:09:02.941939678Z [2024-02-24 01:09:02,941: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:09:02.942321214Z [2024-02-24 01:09:02,942: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:09:02.942579615Z [2024-02-24 01:09:02,942: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:09:03.040418604Z [2024-02-24 01:09:03,040: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:09:03.060448827Z [2024-02-24 01:09:03,060: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:09:05.726890792Z [2024-02-24 01:09:05,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b103b2d5-9270-4248-bbb4-64fb8abe4c17] succeeded in 4.476555983000253s: None
2024-02-24T01:09:06.598037395Z [2024-02-24 01:09:06,596: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3af7d855-824a-4000-ac0a-2dc007e49454] succeeded in 5.285829317999742s: None
2024-02-24T01:10:00.651418022Z [2024-02-24 01:10:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[75a2f2fa-9524-4246-8b69-ca2d1bfb7b63] received
2024-02-24T01:10:00.654871875Z [2024-02-24 01:10:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02277c8c-8699-4601-afa5-f5ad6bc2c4f2] received
2024-02-24T01:10:00.659919695Z [2024-02-24 01:10:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b25454b4-a087-4c21-88c5-c34dbd464a40] received
2024-02-24T01:10:00.662033310Z [2024-02-24 01:10:00,661: INFO/ForkPoolWorker-15] [75a2f2fa-9524-4246-8b69-ca2d1bfb7b63] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:10:00.664268635Z [2024-02-24 01:10:00,664: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d29e0c5-9218-4eb6-accc-f34c931a6d00] received
2024-02-24T01:10:00.664946360Z [2024-02-24 01:10:00,664: INFO/ForkPoolWorker-16] [02277c8c-8699-4601-afa5-f5ad6bc2c4f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:10:00.670051716Z [2024-02-24 01:10:00,669: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa08e53b-764f-4f04-afab-1eab150042bb] received
2024-02-24T01:10:00.678471538Z [2024-02-24 01:10:00,678: INFO/ForkPoolWorker-1] [b25454b4-a087-4c21-88c5-c34dbd464a40] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:10:00.684262291Z [2024-02-24 01:10:00,683: INFO/ForkPoolWorker-3] [fa08e53b-764f-4f04-afab-1eab150042bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:10:00.684997548Z [2024-02-24 01:10:00,684: INFO/ForkPoolWorker-2] [1d29e0c5-9218-4eb6-accc-f34c931a6d00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:10:01.103280951Z [2024-02-24 01:10:01,100: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:10:01.103636537Z [2024-02-24 01:10:01,099: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:10:01.201376171Z [2024-02-24 01:10:01,197: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:10:01.447850825Z [2024-02-24 01:10:01,444: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:10:01.495251570Z [2024-02-24 01:10:01,490: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:10:01.539294393Z [2024-02-24 01:10:01,539: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:01.598752120Z [2024-02-24 01:10:01,598: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:10:01.605209579Z [2024-02-24 01:10:01,604: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:01.663244556Z [2024-02-24 01:10:01,663: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:10:01.666690785Z [2024-02-24 01:10:01,666: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:10:01.666780677Z [2024-02-24 01:10:01,666: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:10:01.666846838Z [2024-02-24 01:10:01,666: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:10:01.667083473Z [2024-02-24 01:10:01,666: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:10:01.954123046Z [2024-02-24 01:10:01,953: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:02.361896683Z [2024-02-24 01:10:02,357: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02277c8c-8699-4601-afa5-f5ad6bc2c4f2] succeeded in 1.7014075540000704s: None
2024-02-24T01:10:03.478104498Z [2024-02-24 01:10:03,473: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1d29e0c5-9218-4eb6-accc-f34c931a6d00] succeeded in 2.804678471000443s: None
2024-02-24T01:10:04.372104235Z [2024-02-24 01:10:04,371: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T01:10:04.376957770Z [2024-02-24 01:10:04,376: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:04.450328037Z [2024-02-24 01:10:04,449: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:10:04.459150700Z [2024-02-24 01:10:04,455: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:04.459167474Z [2024-02-24 01:10:04,455: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:04.459175207Z [2024-02-24 01:10:04,456: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:04.459180143Z [2024-02-24 01:10:04,456: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T01:10:04.459191680Z [2024-02-24 01:10:04,456: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:10:04.459195413Z [2024-02-24 01:10:04,457: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:04.609877679Z [2024-02-24 01:10:04,607: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:04.656710004Z [2024-02-24 01:10:04,656: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:10:04.660163686Z [2024-02-24 01:10:04,659: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:04.662476007Z [2024-02-24 01:10:04,662: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:10:04.666328245Z [2024-02-24 01:10:04,665: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:04.696538456Z [2024-02-24 01:10:04,695: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:10:04.699169683Z [2024-02-24 01:10:04,698: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:04.699182205Z [2024-02-24 01:10:04,698: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:04.699186113Z [2024-02-24 01:10:04,698: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:04.699189360Z [2024-02-24 01:10:04,698: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:10:04.699201121Z [2024-02-24 01:10:04,699: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:10:04.699305041Z [2024-02-24 01:10:04,699: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:04.711472931Z [2024-02-24 01:10:04,711: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:10:04.713692572Z [2024-02-24 01:10:04,713: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:04.713879934Z [2024-02-24 01:10:04,713: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:04.714008409Z [2024-02-24 01:10:04,713: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:04.714093843Z [2024-02-24 01:10:04,714: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:10:04.714392597Z [2024-02-24 01:10:04,714: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:10:04.714532566Z [2024-02-24 01:10:04,714: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:04.841928019Z [2024-02-24 01:10:04,839: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:04.841952398Z [2024-02-24 01:10:04,839: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:05.498918377Z [2024-02-24 01:10:05,498: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[75a2f2fa-9524-4246-8b69-ca2d1bfb7b63] succeeded in 4.843560092000189s: None
2024-02-24T01:10:06.269448012Z [2024-02-24 01:10:06,269: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4877920-89c4-4168-a6ce-8b9be04474be] received
2024-02-24T01:10:06.276341518Z [2024-02-24 01:10:06,276: INFO/ForkPoolWorker-15] [e4877920-89c4-4168-a6ce-8b9be04474be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:10:06.561483677Z [2024-02-24 01:10:06,560: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fa08e53b-764f-4f04-afab-1eab150042bb] succeeded in 5.887949091000337s: None
2024-02-24T01:10:06.573025396Z [2024-02-24 01:10:06,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:10:06.873916530Z [2024-02-24 01:10:06,870: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b25454b4-a087-4c21-88c5-c34dbd464a40] succeeded in 6.208883659000094s: None
2024-02-24T01:10:07.766857180Z [2024-02-24 01:10:07,766: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:10:07.770223369Z [2024-02-24 01:10:07,769: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:07.798816299Z [2024-02-24 01:10:07,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:10:07.800030629Z [2024-02-24 01:10:07,799: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:07.800047932Z [2024-02-24 01:10:07,799: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:07.800151611Z [2024-02-24 01:10:07,799: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:07.800163425Z [2024-02-24 01:10:07,800: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:10:07.800509451Z [2024-02-24 01:10:07,800: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:10:07.800518340Z [2024-02-24 01:10:07,800: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:07.887323569Z [2024-02-24 01:10:07,886: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:08.622655657Z [2024-02-24 01:10:08,622: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4877920-89c4-4168-a6ce-8b9be04474be] succeeded in 2.3514907329999915s: None
2024-02-24T01:10:08.937992693Z [2024-02-24 01:10:08,937: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba4a285e-addd-4aee-886c-c95c6525f892] received
2024-02-24T01:10:08.954548790Z [2024-02-24 01:10:08,954: INFO/ForkPoolWorker-15] [ba4a285e-addd-4aee-886c-c95c6525f892] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:10:09.236402244Z [2024-02-24 01:10:09,233: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:10:10.383378529Z [2024-02-24 01:10:10,381: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:10:10.385339401Z [2024-02-24 01:10:10,384: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:10.412704661Z [2024-02-24 01:10:10,412: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:10:10.418033640Z [2024-02-24 01:10:10,413: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:10.418043160Z [2024-02-24 01:10:10,414: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:10.418048268Z [2024-02-24 01:10:10,414: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:10.418067578Z [2024-02-24 01:10:10,414: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:10:10.418071888Z [2024-02-24 01:10:10,414: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:10:10.418075976Z [2024-02-24 01:10:10,414: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:10.495748405Z [2024-02-24 01:10:10,495: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:11.184664845Z [2024-02-24 01:10:11,182: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba4a285e-addd-4aee-886c-c95c6525f892] succeeded in 2.2378018199997314s: None
2024-02-24T01:10:11.404342773Z [2024-02-24 01:10:11,400: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4aa5b12-e156-420b-aa92-b61652d4c4ce] received
2024-02-24T01:10:11.410026560Z [2024-02-24 01:10:11,409: INFO/ForkPoolWorker-15] [a4aa5b12-e156-420b-aa92-b61652d4c4ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:10:11.715695133Z [2024-02-24 01:10:11,712: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:10:12.930464199Z [2024-02-24 01:10:12,930: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:10:12.934284677Z [2024-02-24 01:10:12,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:10:12.951845416Z [2024-02-24 01:10:12,951: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:10:12.952976841Z [2024-02-24 01:10:12,952: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:10:12.952991562Z [2024-02-24 01:10:12,952: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:10:12.953127134Z [2024-02-24 01:10:12,952: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:10:12.953181482Z [2024-02-24 01:10:12,953: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:10:12.953443319Z [2024-02-24 01:10:12,953: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:10:12.953451983Z [2024-02-24 01:10:12,953: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:10:13.044145252Z [2024-02-24 01:10:13,043: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:10:13.675796877Z [2024-02-24 01:10:13,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4aa5b12-e156-420b-aa92-b61652d4c4ce] succeeded in 2.271495665999282s: None
2024-02-24T01:11:00.958055739Z [2024-02-24 01:11:00,957: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47e01262-1a31-406e-adfb-13bb602d5efc] received
2024-02-24T01:11:00.963779112Z [2024-02-24 01:11:00,963: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8740b15c-1cc5-43ac-b4be-9abf94aff52a] received
2024-02-24T01:11:00.967519786Z [2024-02-24 01:11:00,966: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d92fc2f-73c8-42f3-b553-881c0b391209] received
2024-02-24T01:11:00.970500195Z [2024-02-24 01:11:00,970: INFO/ForkPoolWorker-15] [47e01262-1a31-406e-adfb-13bb602d5efc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:11:00.973637713Z [2024-02-24 01:11:00,973: INFO/ForkPoolWorker-16] [8740b15c-1cc5-43ac-b4be-9abf94aff52a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:11:00.976774985Z [2024-02-24 01:11:00,976: INFO/ForkPoolWorker-1] [3d92fc2f-73c8-42f3-b553-881c0b391209] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:11:01.363218068Z [2024-02-24 01:11:01,359: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:11:01.365578510Z [2024-02-24 01:11:01,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:11:01.415014558Z [2024-02-24 01:11:01,411: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:11:01.607952794Z [2024-02-24 01:11:01,607: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:11:01.612261723Z [2024-02-24 01:11:01,611: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:11:01.644182256Z [2024-02-24 01:11:01,643: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:11:01.646611254Z [2024-02-24 01:11:01,646: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:11:01.646872105Z [2024-02-24 01:11:01,646: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:11:01.646963520Z [2024-02-24 01:11:01,646: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:11:01.647191581Z [2024-02-24 01:11:01,647: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:11:01.754656289Z [2024-02-24 01:11:01,754: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:11:02.489871967Z [2024-02-24 01:11:02,489: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3d92fc2f-73c8-42f3-b553-881c0b391209] succeeded in 1.5199830110004768s: None
2024-02-24T01:11:02.602812618Z [2024-02-24 01:11:02,602: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:11:02.606543415Z [2024-02-24 01:11:02,605: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:11:02.612458794Z [2024-02-24 01:11:02,612: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:11:02.616553345Z [2024-02-24 01:11:02,616: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:11:02.624717362Z [2024-02-24 01:11:02,624: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:11:02.627467736Z [2024-02-24 01:11:02,626: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:11:02.627477448Z [2024-02-24 01:11:02,627: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:11:02.627483212Z [2024-02-24 01:11:02,627: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:11:02.627487028Z [2024-02-24 01:11:02,627: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:11:02.627783565Z [2024-02-24 01:11:02,627: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:11:02.627790118Z [2024-02-24 01:11:02,627: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:11:02.648669636Z [2024-02-24 01:11:02,647: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:11:02.649899109Z [2024-02-24 01:11:02,649: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:11:02.649912805Z [2024-02-24 01:11:02,649: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:11:02.649917033Z [2024-02-24 01:11:02,649: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:11:02.653966758Z [2024-02-24 01:11:02,649: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:11:02.653975042Z [2024-02-24 01:11:02,650: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:11:02.653979161Z [2024-02-24 01:11:02,650: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:11:02.767135716Z [2024-02-24 01:11:02,766: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:11:02.771791656Z [2024-02-24 01:11:02,771: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:11:05.110274464Z [2024-02-24 01:11:05,109: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47e01262-1a31-406e-adfb-13bb602d5efc] succeeded in 4.150069016999623s: None
2024-02-24T01:11:05.396784900Z [2024-02-24 01:11:05,396: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8740b15c-1cc5-43ac-b4be-9abf94aff52a] succeeded in 4.43077009299941s: None
2024-02-24T01:12:01.169407722Z [2024-02-24 01:12:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3755e5f3-a9c5-4a46-8f6d-c0e43ab6913a] received
2024-02-24T01:12:01.174850485Z [2024-02-24 01:12:01,174: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a439c22a-b907-4779-b18d-228e15cc97e2] received
2024-02-24T01:12:01.177654082Z [2024-02-24 01:12:01,177: INFO/ForkPoolWorker-15] [3755e5f3-a9c5-4a46-8f6d-c0e43ab6913a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:12:01.180995157Z [2024-02-24 01:12:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb5136dd-838f-4ebf-8925-c55fcf34c75c] received
2024-02-24T01:12:01.181605499Z [2024-02-24 01:12:01,181: INFO/ForkPoolWorker-16] [a439c22a-b907-4779-b18d-228e15cc97e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:12:01.194199824Z [2024-02-24 01:12:01,193: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b693d262-780a-4fd0-b2d3-5951a3507114] received
2024-02-24T01:12:01.196855224Z [2024-02-24 01:12:01,196: INFO/ForkPoolWorker-1] [bb5136dd-838f-4ebf-8925-c55fcf34c75c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:12:01.200691261Z [2024-02-24 01:12:01,200: INFO/ForkPoolWorker-2] [b693d262-780a-4fd0-b2d3-5951a3507114] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:12:01.558902973Z [2024-02-24 01:12:01,555: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:12:01.583818646Z [2024-02-24 01:12:01,580: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:12:01.584462239Z [2024-02-24 01:12:01,579: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:12:01.639660155Z [2024-02-24 01:12:01,636: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:12:01.776641985Z [2024-02-24 01:12:01,776: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:12:01.780692410Z [2024-02-24 01:12:01,780: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:12:01.824208816Z [2024-02-24 01:12:01,823: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:12:01.826573274Z [2024-02-24 01:12:01,826: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:12:01.826769212Z [2024-02-24 01:12:01,826: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:12:01.826985703Z [2024-02-24 01:12:01,826: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:12:01.827289898Z [2024-02-24 01:12:01,827: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:12:01.918307100Z [2024-02-24 01:12:01,917: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:12:01.947817888Z [2024-02-24 01:12:01,947: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:12:02.586260194Z [2024-02-24 01:12:02,585: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a439c22a-b907-4779-b18d-228e15cc97e2] succeeded in 1.4097944430004645s: None
2024-02-24T01:12:02.586285448Z [2024-02-24 01:12:02,585: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3755e5f3-a9c5-4a46-8f6d-c0e43ab6913a] succeeded in 1.4146293869998772s: None
2024-02-24T01:12:03.007283562Z [2024-02-24 01:12:03,006: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:12:03.011161360Z [2024-02-24 01:12:03,010: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:12:03.040832932Z [2024-02-24 01:12:03,040: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:12:03.042344523Z [2024-02-24 01:12:03,042: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:12:03.042646161Z [2024-02-24 01:12:03,042: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:12:03.042820672Z [2024-02-24 01:12:03,042: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:12:03.042884784Z [2024-02-24 01:12:03,042: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:12:03.043560570Z [2024-02-24 01:12:03,043: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:12:03.043576446Z [2024-02-24 01:12:03,043: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:12:03.049623138Z [2024-02-24 01:12:03,049: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:12:03.053114758Z [2024-02-24 01:12:03,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:12:03.084966645Z [2024-02-24 01:12:03,084: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:12:03.087140791Z [2024-02-24 01:12:03,086: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:12:03.087162798Z [2024-02-24 01:12:03,087: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:12:03.087338778Z [2024-02-24 01:12:03,087: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:12:03.087509962Z [2024-02-24 01:12:03,087: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:12:03.087930808Z [2024-02-24 01:12:03,087: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:12:03.088177884Z [2024-02-24 01:12:03,087: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:12:03.158303064Z [2024-02-24 01:12:03,158: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:12:03.184614046Z [2024-02-24 01:12:03,184: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:12:05.337958837Z [2024-02-24 01:12:05,337: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b693d262-780a-4fd0-b2d3-5951a3507114] succeeded in 4.1422608069997295s: None
2024-02-24T01:12:06.594985596Z [2024-02-24 01:12:06,594: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bb5136dd-838f-4ebf-8925-c55fcf34c75c] succeeded in 5.403714523999952s: None
2024-02-24T01:13:00.581021921Z [2024-02-24 01:13:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37e6cd62-170a-4ac2-91da-0f100c5f8d07] received
2024-02-24T01:13:00.586019328Z [2024-02-24 01:13:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bee0cf9-fa1f-4560-9b7c-5b5bac3fb673] received
2024-02-24T01:13:00.591103245Z [2024-02-24 01:13:00,590: INFO/ForkPoolWorker-15] [37e6cd62-170a-4ac2-91da-0f100c5f8d07] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:13:00.594945246Z [2024-02-24 01:13:00,594: INFO/ForkPoolWorker-16] [9bee0cf9-fa1f-4560-9b7c-5b5bac3fb673] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:13:00.595669620Z [2024-02-24 01:13:00,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b85532d2-a378-46a3-86c6-8b91e47addc3] received
2024-02-24T01:13:00.602276667Z [2024-02-24 01:13:00,602: INFO/ForkPoolWorker-1] [b85532d2-a378-46a3-86c6-8b91e47addc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:13:00.878994792Z [2024-02-24 01:13:00,875: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:13:00.892617464Z [2024-02-24 01:13:00,889: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:13:00.903179232Z [2024-02-24 01:13:00,900: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:13:01.038361000Z [2024-02-24 01:13:01,037: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:13:01.043254361Z [2024-02-24 01:13:01,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:13:01.070584623Z [2024-02-24 01:13:01,070: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:13:01.071731171Z [2024-02-24 01:13:01,071: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:13:01.071937587Z [2024-02-24 01:13:01,071: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:13:01.072141739Z [2024-02-24 01:13:01,071: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:13:01.072418363Z [2024-02-24 01:13:01,072: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:13:01.266275312Z [2024-02-24 01:13:01,264: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:13:01.943469896Z [2024-02-24 01:13:01,942: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b85532d2-a378-46a3-86c6-8b91e47addc3] succeeded in 1.346317963000729s: None
2024-02-24T01:13:02.262068762Z [2024-02-24 01:13:02,261: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:13:02.265372128Z [2024-02-24 01:13:02,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:13:02.290774710Z [2024-02-24 01:13:02,290: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:13:02.292214633Z [2024-02-24 01:13:02,291: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:13:02.292318970Z [2024-02-24 01:13:02,292: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:13:02.292406550Z [2024-02-24 01:13:02,292: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:13:02.292424816Z [2024-02-24 01:13:02,292: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:13:02.292733073Z [2024-02-24 01:13:02,292: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:13:02.292871768Z [2024-02-24 01:13:02,292: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:13:02.385916747Z [2024-02-24 01:13:02,383: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:13:02.396061461Z [2024-02-24 01:13:02,395: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:13:02.404219879Z [2024-02-24 01:13:02,403: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:13:02.432861184Z [2024-02-24 01:13:02,432: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:13:02.434275576Z [2024-02-24 01:13:02,434: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:13:02.434296716Z [2024-02-24 01:13:02,434: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:13:02.434516347Z [2024-02-24 01:13:02,434: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:13:02.434727424Z [2024-02-24 01:13:02,434: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:13:02.435111415Z [2024-02-24 01:13:02,434: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:13:02.435285883Z [2024-02-24 01:13:02,435: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:13:02.541840932Z [2024-02-24 01:13:02,541: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:13:04.133539996Z [2024-02-24 01:13:04,133: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9bee0cf9-fa1f-4560-9b7c-5b5bac3fb673] succeeded in 3.545117767999727s: None
2024-02-24T01:13:04.309935000Z [2024-02-24 01:13:04,309: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37e6cd62-170a-4ac2-91da-0f100c5f8d07] succeeded in 3.7259152690003248s: None
2024-02-24T01:14:00.615352493Z [2024-02-24 01:14:00,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[359841c1-22f1-4df9-8de9-424eeb7142e8] received
2024-02-24T01:14:00.618355719Z [2024-02-24 01:14:00,618: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99668358-58ea-4900-b767-b5ff995e3606] received
2024-02-24T01:14:00.627085165Z [2024-02-24 01:14:00,626: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b6cd679f-4672-4a81-9bd6-a4a5d0ede2a5] received
2024-02-24T01:14:00.629246516Z [2024-02-24 01:14:00,628: INFO/ForkPoolWorker-15] [359841c1-22f1-4df9-8de9-424eeb7142e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:14:00.632367545Z [2024-02-24 01:14:00,632: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a88c712f-1533-4906-836b-5dbe5beb2c83] received
2024-02-24T01:14:00.639280164Z [2024-02-24 01:14:00,639: INFO/ForkPoolWorker-16] [99668358-58ea-4900-b767-b5ff995e3606] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:14:00.639632605Z [2024-02-24 01:14:00,639: INFO/ForkPoolWorker-2] [a88c712f-1533-4906-836b-5dbe5beb2c83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:14:00.641693608Z [2024-02-24 01:14:00,641: INFO/ForkPoolWorker-1] [b6cd679f-4672-4a81-9bd6-a4a5d0ede2a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:14:00.964594533Z [2024-02-24 01:14:00,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:14:00.975432237Z [2024-02-24 01:14:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:14:00.985291863Z [2024-02-24 01:14:00,979: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:14:00.985313931Z [2024-02-24 01:14:00,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:14:01.193653835Z [2024-02-24 01:14:01,193: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:14:01.197450361Z [2024-02-24 01:14:01,197: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:14:01.309516313Z [2024-02-24 01:14:01,302: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:14:01.325987156Z [2024-02-24 01:14:01,321: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:14:01.326005703Z [2024-02-24 01:14:01,321: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:14:01.326011794Z [2024-02-24 01:14:01,321: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:14:01.326015078Z [2024-02-24 01:14:01,321: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:14:01.370606923Z [2024-02-24 01:14:01,370: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:14:01.463351057Z [2024-02-24 01:14:01,462: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:14:02.072754427Z [2024-02-24 01:14:02,072: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99668358-58ea-4900-b767-b5ff995e3606] succeeded in 1.4531610170006388s: None
2024-02-24T01:14:02.120098348Z [2024-02-24 01:14:02,119: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[359841c1-22f1-4df9-8de9-424eeb7142e8] succeeded in 1.5005053109998698s: None
2024-02-24T01:14:02.373995465Z [2024-02-24 01:14:02,372: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:14:02.377583393Z [2024-02-24 01:14:02,376: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:14:02.397841243Z [2024-02-24 01:14:02,397: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:14:02.403536874Z [2024-02-24 01:14:02,400: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:14:02.420427364Z [2024-02-24 01:14:02,420: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:14:02.421688780Z [2024-02-24 01:14:02,421: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:14:02.422376096Z [2024-02-24 01:14:02,422: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:14:02.422578587Z [2024-02-24 01:14:02,422: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:14:02.422694205Z [2024-02-24 01:14:02,422: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:14:02.423054653Z [2024-02-24 01:14:02,422: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:14:02.423394400Z [2024-02-24 01:14:02,423: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:14:02.429963174Z [2024-02-24 01:14:02,429: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:14:02.431236735Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:14:02.431359910Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:14:02.431549494Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:14:02.431660790Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:14:02.431967598Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:14:02.432070724Z [2024-02-24 01:14:02,431: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:14:02.514585112Z [2024-02-24 01:14:02,514: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:14:02.532704625Z [2024-02-24 01:14:02,532: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:14:04.461456303Z [2024-02-24 01:14:04,460: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b6cd679f-4672-4a81-9bd6-a4a5d0ede2a5] succeeded in 3.831843117999597s: None
2024-02-24T01:14:05.127064082Z [2024-02-24 01:14:05,126: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a88c712f-1533-4906-836b-5dbe5beb2c83] succeeded in 4.4926440200006255s: None
2024-02-24T01:15:01.079273086Z [2024-02-24 01:15:01,078: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c25d4a68-e83f-4179-a586-faeebedcd078] received
2024-02-24T01:15:01.084620387Z [2024-02-24 01:15:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f370c54f-ccef-45d3-96bd-f04a51093061] received
2024-02-24T01:15:01.088086760Z [2024-02-24 01:15:01,087: INFO/ForkPoolWorker-15] [c25d4a68-e83f-4179-a586-faeebedcd078] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:15:01.089332899Z [2024-02-24 01:15:01,089: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc2a7801-fc13-4e3a-9ed6-ac6d6dfdcc67] received
2024-02-24T01:15:01.093548658Z [2024-02-24 01:15:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4cdd7f83-04e8-4634-b434-7a4b44786247] received
2024-02-24T01:15:01.104130749Z [2024-02-24 01:15:01,103: INFO/ForkPoolWorker-2] [4cdd7f83-04e8-4634-b434-7a4b44786247] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:15:01.106759373Z [2024-02-24 01:15:01,106: INFO/ForkPoolWorker-16] [f370c54f-ccef-45d3-96bd-f04a51093061] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:15:01.111460814Z [2024-02-24 01:15:01,111: INFO/ForkPoolWorker-1] [bc2a7801-fc13-4e3a-9ed6-ac6d6dfdcc67] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:15:01.640209626Z [2024-02-24 01:15:01,635: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:15:01.696806100Z [2024-02-24 01:15:01,693: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:15:01.786361152Z [2024-02-24 01:15:01,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:15:01.798260720Z [2024-02-24 01:15:01,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:15:01.817991831Z [2024-02-24 01:15:01,817: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:15:01.822391306Z [2024-02-24 01:15:01,821: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:01.870833559Z [2024-02-24 01:15:01,870: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:15:01.872867009Z [2024-02-24 01:15:01,872: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:15:01.873112893Z [2024-02-24 01:15:01,872: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:15:01.873405738Z [2024-02-24 01:15:01,873: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:15:01.874779249Z [2024-02-24 01:15:01,873: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:15:01.959033452Z [2024-02-24 01:15:01,958: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:02.810421050Z [2024-02-24 01:15:02,810: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc2a7801-fc13-4e3a-9ed6-ac6d6dfdcc67] succeeded in 1.7161705449998408s: None
2024-02-24T01:15:03.107943118Z [2024-02-24 01:15:03,107: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:15:03.111257093Z [2024-02-24 01:15:03,110: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:03.129825759Z [2024-02-24 01:15:03,129: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:15:03.131013574Z [2024-02-24 01:15:03,130: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:03.131029626Z [2024-02-24 01:15:03,130: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:03.131129179Z [2024-02-24 01:15:03,130: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:03.131163705Z [2024-02-24 01:15:03,131: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:15:03.131390045Z [2024-02-24 01:15:03,131: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:15:03.131406876Z [2024-02-24 01:15:03,131: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:03.238863927Z [2024-02-24 01:15:03,238: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:03.340984146Z [2024-02-24 01:15:03,340: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:15:03.344699942Z [2024-02-24 01:15:03,344: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:03.372109908Z [2024-02-24 01:15:03,371: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:15:03.374779905Z [2024-02-24 01:15:03,374: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:03.374849946Z [2024-02-24 01:15:03,374: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:03.375022092Z [2024-02-24 01:15:03,374: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:03.375102644Z [2024-02-24 01:15:03,375: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:15:03.375380109Z [2024-02-24 01:15:03,375: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:15:03.375477477Z [2024-02-24 01:15:03,375: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:03.447869693Z [2024-02-24 01:15:03,447: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:15:03.452651978Z [2024-02-24 01:15:03,452: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:03.483535420Z [2024-02-24 01:15:03,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:15:03.484982849Z [2024-02-24 01:15:03,484: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:03.485416426Z [2024-02-24 01:15:03,485: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:03.485507687Z [2024-02-24 01:15:03,485: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:03.485606670Z [2024-02-24 01:15:03,485: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:15:03.485983978Z [2024-02-24 01:15:03,485: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:15:03.486556283Z [2024-02-24 01:15:03,485: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:03.500344675Z [2024-02-24 01:15:03,500: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:03.594518090Z [2024-02-24 01:15:03,594: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:04.671009069Z [2024-02-24 01:15:04,670: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c25d4a68-e83f-4179-a586-faeebedcd078] succeeded in 3.5895005409993246s: None
2024-02-24T01:15:05.119118477Z [2024-02-24 01:15:05,118: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4cdd7f83-04e8-4634-b434-7a4b44786247] succeeded in 4.023444999000276s: None
2024-02-24T01:15:05.630455003Z [2024-02-24 01:15:05,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[67129a9d-1c95-4c53-80ff-94fdd2e618f3] received
2024-02-24T01:15:05.638806921Z [2024-02-24 01:15:05,638: INFO/ForkPoolWorker-15] [67129a9d-1c95-4c53-80ff-94fdd2e618f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:15:05.974324863Z [2024-02-24 01:15:05,970: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:15:05.996114880Z [2024-02-24 01:15:05,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f370c54f-ccef-45d3-96bd-f04a51093061] succeeded in 4.908848325999315s: None
2024-02-24T01:15:07.122755489Z [2024-02-24 01:15:07,122: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:15:07.126346707Z [2024-02-24 01:15:07,125: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:07.152643718Z [2024-02-24 01:15:07,152: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:15:07.154291805Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:07.154320475Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:07.154476911Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:07.154502602Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:15:07.154803943Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:15:07.154858560Z [2024-02-24 01:15:07,154: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:07.268800234Z [2024-02-24 01:15:07,268: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:07.913541209Z [2024-02-24 01:15:07,913: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[67129a9d-1c95-4c53-80ff-94fdd2e618f3] succeeded in 2.2810600140001043s: None
2024-02-24T01:15:08.362699461Z [2024-02-24 01:15:08,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89015928-5505-47cb-b868-1fc4c453e0f4] received
2024-02-24T01:15:08.370870164Z [2024-02-24 01:15:08,370: INFO/ForkPoolWorker-15] [89015928-5505-47cb-b868-1fc4c453e0f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:15:08.650285829Z [2024-02-24 01:15:08,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:15:09.762167351Z [2024-02-24 01:15:09,761: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:15:09.765606107Z [2024-02-24 01:15:09,765: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:09.787179298Z [2024-02-24 01:15:09,786: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:15:09.788507153Z [2024-02-24 01:15:09,788: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:09.788581811Z [2024-02-24 01:15:09,788: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:09.788775106Z [2024-02-24 01:15:09,788: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:09.788880647Z [2024-02-24 01:15:09,788: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:15:09.789349413Z [2024-02-24 01:15:09,789: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:15:09.789398774Z [2024-02-24 01:15:09,789: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:09.891288390Z [2024-02-24 01:15:09,890: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:10.501120869Z [2024-02-24 01:15:10,500: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89015928-5505-47cb-b868-1fc4c453e0f4] succeeded in 2.1351214240003173s: None
2024-02-24T01:15:10.704996466Z [2024-02-24 01:15:10,704: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9666073c-917a-41a6-baa5-4ce08f84dd71] received
2024-02-24T01:15:10.716974689Z [2024-02-24 01:15:10,716: INFO/ForkPoolWorker-15] [9666073c-917a-41a6-baa5-4ce08f84dd71] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:15:11.061950301Z [2024-02-24 01:15:11,058: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:15:12.174299315Z [2024-02-24 01:15:12,173: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:15:12.177813460Z [2024-02-24 01:15:12,177: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:15:12.195853594Z [2024-02-24 01:15:12,195: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:15:12.197381912Z [2024-02-24 01:15:12,197: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:15:12.197595885Z [2024-02-24 01:15:12,197: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:15:12.197919014Z [2024-02-24 01:15:12,197: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:15:12.198075248Z [2024-02-24 01:15:12,197: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:15:12.198476554Z [2024-02-24 01:15:12,198: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:15:12.198670503Z [2024-02-24 01:15:12,198: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:15:12.275787188Z [2024-02-24 01:15:12,275: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:15:12.872776432Z [2024-02-24 01:15:12,872: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9666073c-917a-41a6-baa5-4ce08f84dd71] succeeded in 2.1646859570000743s: None
2024-02-24T01:16:01.257700268Z [2024-02-24 01:16:01,257: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c91ced1-5046-47dc-a6da-48323372d58c] received
2024-02-24T01:16:01.265971737Z [2024-02-24 01:16:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c239e033-8104-4b27-bf8a-a73335fbfdd7] received
2024-02-24T01:16:01.266004009Z [2024-02-24 01:16:01,265: INFO/ForkPoolWorker-15] [7c91ced1-5046-47dc-a6da-48323372d58c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:16:01.281505046Z [2024-02-24 01:16:01,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2cc4e3d-c5cc-46e9-b9fd-865b58265026] received
2024-02-24T01:16:01.289051503Z [2024-02-24 01:16:01,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f0ec12e-b1f0-4583-896c-ab19a3b736f9] received
2024-02-24T01:16:01.291730328Z [2024-02-24 01:16:01,289: INFO/ForkPoolWorker-16] [c239e033-8104-4b27-bf8a-a73335fbfdd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:16:01.312188860Z [2024-02-24 01:16:01,311: INFO/ForkPoolWorker-1] [e2cc4e3d-c5cc-46e9-b9fd-865b58265026] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:16:01.317074849Z [2024-02-24 01:16:01,316: INFO/ForkPoolWorker-2] [7f0ec12e-b1f0-4583-896c-ab19a3b736f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:16:01.613338150Z [2024-02-24 01:16:01,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:16:01.614088177Z [2024-02-24 01:16:01,610: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:16:01.627889873Z [2024-02-24 01:16:01,624: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:16:01.688993326Z [2024-02-24 01:16:01,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:16:01.808351171Z [2024-02-24 01:16:01,807: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:16:01.813617336Z [2024-02-24 01:16:01,813: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:16:01.857077551Z [2024-02-24 01:16:01,856: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:16:01.858115671Z [2024-02-24 01:16:01,857: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:16:01.858178572Z [2024-02-24 01:16:01,858: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:16:01.858219476Z [2024-02-24 01:16:01,858: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:16:01.858412358Z [2024-02-24 01:16:01,858: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:16:01.971959410Z [2024-02-24 01:16:01,971: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:16:01.984828855Z [2024-02-24 01:16:01,984: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:16:02.778010135Z [2024-02-24 01:16:02,777: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c91ced1-5046-47dc-a6da-48323372d58c] succeeded in 1.5190174190001926s: None
2024-02-24T01:16:02.917121591Z [2024-02-24 01:16:02,916: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e2cc4e3d-c5cc-46e9-b9fd-865b58265026] succeeded in 1.6259288609999203s: None
2024-02-24T01:16:03.235233705Z [2024-02-24 01:16:03,234: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:16:03.243121268Z [2024-02-24 01:16:03,242: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:16:03.278838974Z [2024-02-24 01:16:03,278: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:16:03.282932695Z [2024-02-24 01:16:03,282: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:16:03.283147502Z [2024-02-24 01:16:03,282: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:16:03.283394664Z [2024-02-24 01:16:03,283: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:16:03.283553648Z [2024-02-24 01:16:03,283: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:16:03.283941860Z [2024-02-24 01:16:03,283: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:16:03.284188905Z [2024-02-24 01:16:03,283: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:16:03.338092883Z [2024-02-24 01:16:03,337: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:16:03.341378630Z [2024-02-24 01:16:03,340: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:16:03.378418346Z [2024-02-24 01:16:03,378: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:16:03.382943725Z [2024-02-24 01:16:03,382: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:16:03.383020844Z [2024-02-24 01:16:03,382: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:16:03.383173331Z [2024-02-24 01:16:03,383: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:16:03.383247155Z [2024-02-24 01:16:03,383: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:16:03.383527361Z [2024-02-24 01:16:03,383: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:16:03.383613426Z [2024-02-24 01:16:03,383: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:16:03.437537767Z [2024-02-24 01:16:03,437: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:16:03.487434247Z [2024-02-24 01:16:03,487: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:16:04.962697328Z [2024-02-24 01:16:04,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f0ec12e-b1f0-4583-896c-ab19a3b736f9] succeeded in 3.6589364620003835s: None
2024-02-24T01:16:05.305263699Z [2024-02-24 01:16:05,304: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c239e033-8104-4b27-bf8a-a73335fbfdd7] succeeded in 4.039504039999883s: None
2024-02-24T01:17:00.466949354Z [2024-02-24 01:17:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22c3c8dc-9375-4260-bc06-1bbc3fb07811] received
2024-02-24T01:17:00.471625395Z [2024-02-24 01:17:00,471: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d877957b-e691-410a-899c-c930dea1f623] received
2024-02-24T01:17:00.474548915Z [2024-02-24 01:17:00,474: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a56de4e3-1b5b-469c-ae86-effee2b98c84] received
2024-02-24T01:17:00.488286461Z [2024-02-24 01:17:00,487: INFO/ForkPoolWorker-16] [d877957b-e691-410a-899c-c930dea1f623] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:17:00.491149223Z [2024-02-24 01:17:00,490: INFO/ForkPoolWorker-15] [22c3c8dc-9375-4260-bc06-1bbc3fb07811] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:17:00.496024365Z [2024-02-24 01:17:00,495: INFO/ForkPoolWorker-1] [a56de4e3-1b5b-469c-ae86-effee2b98c84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:17:00.829121506Z [2024-02-24 01:17:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:17:00.847775473Z [2024-02-24 01:17:00,843: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:17:00.858296274Z [2024-02-24 01:17:00,855: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:17:01.030484538Z [2024-02-24 01:17:01,029: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:17:01.037188038Z [2024-02-24 01:17:01,036: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:17:01.076373356Z [2024-02-24 01:17:01,076: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:17:01.078399770Z [2024-02-24 01:17:01,077: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:17:01.079012489Z [2024-02-24 01:17:01,078: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:17:01.079254291Z [2024-02-24 01:17:01,079: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:17:01.079864492Z [2024-02-24 01:17:01,079: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:17:01.197611126Z [2024-02-24 01:17:01,197: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:17:01.925743768Z [2024-02-24 01:17:01,925: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a56de4e3-1b5b-469c-ae86-effee2b98c84] succeeded in 1.4486788579997665s: None
2024-02-24T01:17:02.056002425Z [2024-02-24 01:17:02,055: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:17:02.059560495Z [2024-02-24 01:17:02,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:17:02.082306660Z [2024-02-24 01:17:02,081: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:17:02.085926059Z [2024-02-24 01:17:02,085: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:17:02.086347579Z [2024-02-24 01:17:02,086: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:17:02.086929403Z [2024-02-24 01:17:02,086: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:17:02.087151739Z [2024-02-24 01:17:02,086: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:17:02.087632893Z [2024-02-24 01:17:02,087: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:17:02.087917704Z [2024-02-24 01:17:02,087: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:17:02.142238644Z [2024-02-24 01:17:02,141: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:17:02.145825767Z [2024-02-24 01:17:02,145: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:17:02.171015214Z [2024-02-24 01:17:02,170: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:17:02.172774916Z [2024-02-24 01:17:02,172: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:17:02.173009549Z [2024-02-24 01:17:02,172: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:17:02.173375086Z [2024-02-24 01:17:02,173: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:17:02.173588376Z [2024-02-24 01:17:02,173: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:17:02.175116395Z [2024-02-24 01:17:02,174: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:17:02.175274563Z [2024-02-24 01:17:02,175: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:17:02.181438673Z [2024-02-24 01:17:02,181: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:17:02.268448815Z [2024-02-24 01:17:02,268: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:17:04.043322692Z [2024-02-24 01:17:04,042: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22c3c8dc-9375-4260-bc06-1bbc3fb07811] succeeded in 3.5725447599998006s: None
2024-02-24T01:17:04.114293412Z [2024-02-24 01:17:04,113: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d877957b-e691-410a-899c-c930dea1f623] succeeded in 3.6396650599999703s: None
2024-02-24T01:18:01.052928720Z [2024-02-24 01:18:01,052: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68ff3fe3-5c43-4c87-9cc9-a7e74b8e9a19] received
2024-02-24T01:18:01.057364233Z [2024-02-24 01:18:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c01fb2d-1e75-49ec-8648-2a74ff014751] received
2024-02-24T01:18:01.065385871Z [2024-02-24 01:18:01,065: INFO/ForkPoolWorker-15] [68ff3fe3-5c43-4c87-9cc9-a7e74b8e9a19] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:18:01.072128058Z [2024-02-24 01:18:01,071: INFO/ForkPoolWorker-16] [2c01fb2d-1e75-49ec-8648-2a74ff014751] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:18:01.076619117Z [2024-02-24 01:18:01,076: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[253cad39-2ae9-473e-a157-1c02888a53e1] received
2024-02-24T01:18:01.085452044Z [2024-02-24 01:18:01,085: INFO/ForkPoolWorker-1] [253cad39-2ae9-473e-a157-1c02888a53e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:18:01.091428151Z [2024-02-24 01:18:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd14bdf0-c480-4d31-896c-a63d89be6408] received
2024-02-24T01:18:01.106488807Z [2024-02-24 01:18:01,106: INFO/ForkPoolWorker-2] [fd14bdf0-c480-4d31-896c-a63d89be6408] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:18:01.430801611Z [2024-02-24 01:18:01,425: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:18:01.456652052Z [2024-02-24 01:18:01,452: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:18:01.484029834Z [2024-02-24 01:18:01,480: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:18:01.562680698Z [2024-02-24 01:18:01,553: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:18:01.633299130Z [2024-02-24 01:18:01,632: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:18:01.637213633Z [2024-02-24 01:18:01,636: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:18:01.666494264Z [2024-02-24 01:18:01,666: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:18:01.674388125Z [2024-02-24 01:18:01,674: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:18:01.674548072Z [2024-02-24 01:18:01,674: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:18:01.674628597Z [2024-02-24 01:18:01,674: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:18:01.674869081Z [2024-02-24 01:18:01,674: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:18:01.680401187Z [2024-02-24 01:18:01,680: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:18:01.775411287Z [2024-02-24 01:18:01,775: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:18:02.302997414Z [2024-02-24 01:18:02,302: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[68ff3fe3-5c43-4c87-9cc9-a7e74b8e9a19] succeeded in 1.2439911319997918s: None
2024-02-24T01:18:02.406082471Z [2024-02-24 01:18:02,400: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fd14bdf0-c480-4d31-896c-a63d89be6408] succeeded in 1.3070875329995033s: None
2024-02-24T01:18:02.962159966Z [2024-02-24 01:18:02,961: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:18:02.965639506Z [2024-02-24 01:18:02,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:18:02.994958218Z [2024-02-24 01:18:02,994: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:18:02.997253483Z [2024-02-24 01:18:02,996: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:18:02.997266737Z [2024-02-24 01:18:02,997: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:18:02.997360223Z [2024-02-24 01:18:02,997: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:18:02.997396327Z [2024-02-24 01:18:02,997: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:18:02.998017143Z [2024-02-24 01:18:02,997: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:18:02.998033041Z [2024-02-24 01:18:02,997: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:18:03.087973022Z [2024-02-24 01:18:03,087: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:18:03.168227281Z [2024-02-24 01:18:03,167: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:18:03.171697597Z [2024-02-24 01:18:03,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:18:03.190090059Z [2024-02-24 01:18:03,189: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:18:03.191240813Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:18:03.191255945Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:18:03.191366973Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:18:03.191394956Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:18:03.191601998Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:18:03.191627877Z [2024-02-24 01:18:03,191: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:18:03.264351055Z [2024-02-24 01:18:03,264: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:18:04.833331227Z [2024-02-24 01:18:04,832: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c01fb2d-1e75-49ec-8648-2a74ff014751] succeeded in 3.766443118999632s: None
2024-02-24T01:18:05.599819500Z [2024-02-24 01:18:05,599: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[253cad39-2ae9-473e-a157-1c02888a53e1] succeeded in 4.520354551999844s: None
2024-02-24T01:19:00.249543207Z [2024-02-24 01:19:00,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20166fd1-676f-49ca-8ed3-158492b99c7b] received
2024-02-24T01:19:00.256418759Z [2024-02-24 01:19:00,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abfcb585-94ec-443d-96f7-bd3aa742293e] received
2024-02-24T01:19:00.259797137Z [2024-02-24 01:19:00,259: INFO/ForkPoolWorker-15] [20166fd1-676f-49ca-8ed3-158492b99c7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:19:00.265113689Z [2024-02-24 01:19:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ee28f15-6d77-40ff-8687-e49bc304f0ee] received
2024-02-24T01:19:00.266998659Z [2024-02-24 01:19:00,266: INFO/ForkPoolWorker-16] [abfcb585-94ec-443d-96f7-bd3aa742293e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:19:00.271514521Z [2024-02-24 01:19:00,271: INFO/ForkPoolWorker-1] [9ee28f15-6d77-40ff-8687-e49bc304f0ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:19:00.533938437Z [2024-02-24 01:19:00,530: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:19:00.560310820Z [2024-02-24 01:19:00,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:19:00.573019016Z [2024-02-24 01:19:00,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:19:00.729184558Z [2024-02-24 01:19:00,728: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:19:00.733534012Z [2024-02-24 01:19:00,732: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:19:00.761649637Z [2024-02-24 01:19:00,761: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:19:00.763004602Z [2024-02-24 01:19:00,762: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:19:00.763193619Z [2024-02-24 01:19:00,762: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:19:00.763371318Z [2024-02-24 01:19:00,763: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:19:00.763673303Z [2024-02-24 01:19:00,763: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:19:00.849524299Z [2024-02-24 01:19:00,849: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:19:01.659479438Z [2024-02-24 01:19:01,659: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[abfcb585-94ec-443d-96f7-bd3aa742293e] succeeded in 1.4011744449999242s: None
2024-02-24T01:19:01.899167287Z [2024-02-24 01:19:01,898: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:19:01.902844678Z [2024-02-24 01:19:01,902: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:19:01.937294441Z [2024-02-24 01:19:01,937: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:19:01.939311302Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:19:01.939367351Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:19:01.939556551Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:19:01.939612811Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:19:01.939870427Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:19:01.939932294Z [2024-02-24 01:19:01,939: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:19:02.062813141Z [2024-02-24 01:19:02,062: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:19:02.066515589Z [2024-02-24 01:19:02,066: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:19:02.103638826Z [2024-02-24 01:19:02,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:19:02.105836728Z [2024-02-24 01:19:02,105: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:19:02.106330988Z [2024-02-24 01:19:02,106: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:19:02.106636686Z [2024-02-24 01:19:02,106: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:19:02.106752417Z [2024-02-24 01:19:02,106: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:19:02.107007652Z [2024-02-24 01:19:02,106: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:19:02.107138961Z [2024-02-24 01:19:02,107: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:19:02.144774576Z [2024-02-24 01:19:02,144: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:19:02.238227736Z [2024-02-24 01:19:02,237: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:19:04.346554595Z [2024-02-24 01:19:04,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20166fd1-676f-49ca-8ed3-158492b99c7b] succeeded in 4.094080164999468s: None
2024-02-24T01:19:04.606721834Z [2024-02-24 01:19:04,606: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9ee28f15-6d77-40ff-8687-e49bc304f0ee] succeeded in 4.339007423999647s: None
2024-02-24T01:20:01.118342470Z [2024-02-24 01:20:01,118: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3061c1c6-b864-488a-b191-efceaa97d081] received
2024-02-24T01:20:01.120624462Z [2024-02-24 01:20:01,120: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a946ed6-7d24-4f57-9328-4f0e028b2929] received
2024-02-24T01:20:01.127649309Z [2024-02-24 01:20:01,127: INFO/ForkPoolWorker-16] [3a946ed6-7d24-4f57-9328-4f0e028b2929] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:20:01.129248516Z [2024-02-24 01:20:01,129: INFO/ForkPoolWorker-15] [3061c1c6-b864-488a-b191-efceaa97d081] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:20:01.146481041Z [2024-02-24 01:20:01,146: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fc62c9a-b71d-47ad-a1c4-56b2b64c9eb9] received
2024-02-24T01:20:01.150870320Z [2024-02-24 01:20:01,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60ad62ee-7619-45b0-8faf-9b9a70b9f595] received
2024-02-24T01:20:01.152781471Z [2024-02-24 01:20:01,152: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e7cc3175-339e-466d-866e-024dc8d02f4c] received
2024-02-24T01:20:01.159656635Z [2024-02-24 01:20:01,159: INFO/ForkPoolWorker-1] [6fc62c9a-b71d-47ad-a1c4-56b2b64c9eb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:20:01.166940494Z [2024-02-24 01:20:01,166: INFO/ForkPoolWorker-3] [e7cc3175-339e-466d-866e-024dc8d02f4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:20:01.187909117Z [2024-02-24 01:20:01,187: INFO/ForkPoolWorker-2] [60ad62ee-7619-45b0-8faf-9b9a70b9f595] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:20:01.516144454Z [2024-02-24 01:20:01,513: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:20:01.525302063Z [2024-02-24 01:20:01,522: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:20:01.592269345Z [2024-02-24 01:20:01,588: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:20:01.797851291Z [2024-02-24 01:20:01,783: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:20:01.835419949Z [2024-02-24 01:20:01,835: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:01.839885031Z [2024-02-24 01:20:01,834: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:20:02.173568823Z [2024-02-24 01:20:02,173: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T01:20:02.183328965Z [2024-02-24 01:20:02,182: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:02.250125065Z [2024-02-24 01:20:02,249: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:20:02.252396855Z [2024-02-24 01:20:02,252: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:20:02.252595721Z [2024-02-24 01:20:02,252: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:20:02.252749307Z [2024-02-24 01:20:02,252: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T01:20:02.253069694Z [2024-02-24 01:20:02,252: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:20:02.446066921Z [2024-02-24 01:20:02,445: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:02.451553238Z [2024-02-24 01:20:02,450: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3a946ed6-7d24-4f57-9328-4f0e028b2929] succeeded in 1.3292748100002427s: None
2024-02-24T01:20:03.181048699Z [2024-02-24 01:20:03,180: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e7cc3175-339e-466d-866e-024dc8d02f4c] succeeded in 2.023729466000077s: None
2024-02-24T01:20:03.322266973Z [2024-02-24 01:20:03,321: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:20:03.325888583Z [2024-02-24 01:20:03,325: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:03.361900863Z [2024-02-24 01:20:03,361: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:20:03.365049145Z [2024-02-24 01:20:03,364: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:03.365441479Z [2024-02-24 01:20:03,365: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:03.366067943Z [2024-02-24 01:20:03,365: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:03.366339458Z [2024-02-24 01:20:03,366: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:20:03.366792959Z [2024-02-24 01:20:03,366: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:20:03.367182431Z [2024-02-24 01:20:03,366: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:03.447607106Z [2024-02-24 01:20:03,447: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:20:03.451358863Z [2024-02-24 01:20:03,450: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:03.452257295Z [2024-02-24 01:20:03,452: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:03.481023571Z [2024-02-24 01:20:03,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:20:03.483617307Z [2024-02-24 01:20:03,483: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:03.483645432Z [2024-02-24 01:20:03,483: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:03.483813235Z [2024-02-24 01:20:03,483: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:03.483853754Z [2024-02-24 01:20:03,483: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:20:03.484116982Z [2024-02-24 01:20:03,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:20:03.484168295Z [2024-02-24 01:20:03,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:03.602702145Z [2024-02-24 01:20:03,602: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:03.608025263Z [2024-02-24 01:20:03,607: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:20:03.614662074Z [2024-02-24 01:20:03,614: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:03.651063573Z [2024-02-24 01:20:03,650: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:20:03.655257448Z [2024-02-24 01:20:03,654: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:03.655278080Z [2024-02-24 01:20:03,654: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:03.655522552Z [2024-02-24 01:20:03,655: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:03.655529079Z [2024-02-24 01:20:03,655: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:20:03.656009359Z [2024-02-24 01:20:03,655: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:20:03.656018809Z [2024-02-24 01:20:03,655: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:03.816124614Z [2024-02-24 01:20:03,812: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:04.315476241Z [2024-02-24 01:20:04,315: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3061c1c6-b864-488a-b191-efceaa97d081] succeeded in 3.193604521999987s: None
2024-02-24T01:20:05.060848523Z [2024-02-24 01:20:05,060: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc140e34-338d-4160-a177-725f5e970338] received
2024-02-24T01:20:05.075241141Z [2024-02-24 01:20:05,074: INFO/ForkPoolWorker-15] [cc140e34-338d-4160-a177-725f5e970338] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:20:05.384481361Z [2024-02-24 01:20:05,381: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:20:05.437405725Z [2024-02-24 01:20:05,437: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6fc62c9a-b71d-47ad-a1c4-56b2b64c9eb9] succeeded in 4.2890501699994275s: None
2024-02-24T01:20:05.438375921Z [2024-02-24 01:20:05,438: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[60ad62ee-7619-45b0-8faf-9b9a70b9f595] succeeded in 4.284599204999722s: None
2024-02-24T01:20:06.518942644Z [2024-02-24 01:20:06,518: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:20:06.522569190Z [2024-02-24 01:20:06,522: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:06.559839104Z [2024-02-24 01:20:06,559: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:20:06.561539977Z [2024-02-24 01:20:06,561: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:06.561558594Z [2024-02-24 01:20:06,561: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:06.561795115Z [2024-02-24 01:20:06,561: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:06.561878945Z [2024-02-24 01:20:06,561: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:20:06.562751555Z [2024-02-24 01:20:06,562: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:20:06.562763698Z [2024-02-24 01:20:06,562: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:06.647742479Z [2024-02-24 01:20:06,647: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:07.387897251Z [2024-02-24 01:20:07,386: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cc140e34-338d-4160-a177-725f5e970338] succeeded in 2.3223554410005818s: None
2024-02-24T01:20:08.137178634Z [2024-02-24 01:20:08,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3dfba33b-1414-433b-af4a-76ee78c79613] received
2024-02-24T01:20:08.149120756Z [2024-02-24 01:20:08,148: INFO/ForkPoolWorker-15] [3dfba33b-1414-433b-af4a-76ee78c79613] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:20:08.443715954Z [2024-02-24 01:20:08,440: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:20:09.624352267Z [2024-02-24 01:20:09,623: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:20:09.628513608Z [2024-02-24 01:20:09,628: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:09.659665593Z [2024-02-24 01:20:09,659: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:20:09.661641396Z [2024-02-24 01:20:09,661: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:09.661879066Z [2024-02-24 01:20:09,661: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:09.662222866Z [2024-02-24 01:20:09,661: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:09.662409551Z [2024-02-24 01:20:09,662: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:20:09.662984752Z [2024-02-24 01:20:09,662: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:20:09.663266944Z [2024-02-24 01:20:09,663: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:09.785311300Z [2024-02-24 01:20:09,784: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:10.419460860Z [2024-02-24 01:20:10,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3dfba33b-1414-433b-af4a-76ee78c79613] succeeded in 2.2777219650006373s: None
2024-02-24T01:20:10.483991460Z [2024-02-24 01:20:10,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c4c863b-db32-4ba8-af7a-4c5fb0bd34f9] received
2024-02-24T01:20:10.515425931Z [2024-02-24 01:20:10,515: INFO/ForkPoolWorker-15] [2c4c863b-db32-4ba8-af7a-4c5fb0bd34f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:20:10.848578090Z [2024-02-24 01:20:10,845: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:20:12.120954044Z [2024-02-24 01:20:12,120: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:20:12.124673442Z [2024-02-24 01:20:12,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:20:12.153979527Z [2024-02-24 01:20:12,153: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:20:12.156079580Z [2024-02-24 01:20:12,155: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:20:12.156204784Z [2024-02-24 01:20:12,156: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:20:12.156429145Z [2024-02-24 01:20:12,156: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:20:12.156534360Z [2024-02-24 01:20:12,156: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:20:12.156853585Z [2024-02-24 01:20:12,156: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:20:12.157010811Z [2024-02-24 01:20:12,156: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:20:12.287691084Z [2024-02-24 01:20:12,287: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:20:12.966123692Z [2024-02-24 01:20:12,965: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c4c863b-db32-4ba8-af7a-4c5fb0bd34f9] succeeded in 2.4760552429997915s: None
2024-02-24T01:21:01.171585794Z [2024-02-24 01:21:01,171: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56c434b9-4f6f-4a7a-a2ea-099dfee5e11b] received
2024-02-24T01:21:01.173767536Z [2024-02-24 01:21:01,173: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ff6f1c9-e509-485d-a0f4-5953120c1955] received
2024-02-24T01:21:01.184111324Z [2024-02-24 01:21:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7d2b90f-5f5d-41de-a76e-e50947ea7521] received
2024-02-24T01:21:01.185817714Z [2024-02-24 01:21:01,185: INFO/ForkPoolWorker-15] [56c434b9-4f6f-4a7a-a2ea-099dfee5e11b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:21:01.187128759Z [2024-02-24 01:21:01,186: INFO/ForkPoolWorker-16] [1ff6f1c9-e509-485d-a0f4-5953120c1955] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:21:01.194570329Z [2024-02-24 01:21:01,194: INFO/ForkPoolWorker-1] [f7d2b90f-5f5d-41de-a76e-e50947ea7521] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:21:01.572737110Z [2024-02-24 01:21:01,569: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:21:01.596593208Z [2024-02-24 01:21:01,593: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:21:01.609166470Z [2024-02-24 01:21:01,604: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:21:01.734416547Z [2024-02-24 01:21:01,733: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:21:01.738345803Z [2024-02-24 01:21:01,737: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:21:01.767303991Z [2024-02-24 01:21:01,767: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:21:01.770575374Z [2024-02-24 01:21:01,770: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:21:01.770738710Z [2024-02-24 01:21:01,770: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:21:01.770873884Z [2024-02-24 01:21:01,770: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:21:01.771192565Z [2024-02-24 01:21:01,771: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:21:01.891192043Z [2024-02-24 01:21:01,890: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:21:02.530265211Z [2024-02-24 01:21:02,529: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56c434b9-4f6f-4a7a-a2ea-099dfee5e11b] succeeded in 1.3530999869999505s: None
2024-02-24T01:21:02.773009526Z [2024-02-24 01:21:02,772: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:21:02.777164885Z [2024-02-24 01:21:02,776: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:21:02.817328516Z [2024-02-24 01:21:02,817: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:21:02.818969092Z [2024-02-24 01:21:02,818: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:21:02.818993372Z [2024-02-24 01:21:02,818: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:21:02.819212830Z [2024-02-24 01:21:02,819: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:21:02.819387298Z [2024-02-24 01:21:02,819: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:21:02.819752308Z [2024-02-24 01:21:02,819: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:21:02.819917620Z [2024-02-24 01:21:02,819: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:21:02.833484285Z [2024-02-24 01:21:02,833: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:21:02.836941835Z [2024-02-24 01:21:02,836: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:21:02.854426495Z [2024-02-24 01:21:02,854: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:21:02.856256389Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:21:02.856331087Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:21:02.856555882Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:21:02.856600679Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:21:02.856957876Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:21:02.857198982Z [2024-02-24 01:21:02,856: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:21:02.909526331Z [2024-02-24 01:21:02,909: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:21:02.937542311Z [2024-02-24 01:21:02,937: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:21:04.485914801Z [2024-02-24 01:21:04,485: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7d2b90f-5f5d-41de-a76e-e50947ea7521] succeeded in 3.298485921000065s: None
2024-02-24T01:21:05.104931369Z [2024-02-24 01:21:05,104: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ff6f1c9-e509-485d-a0f4-5953120c1955] succeeded in 3.9286234930004866s: None
2024-02-24T01:22:01.149827757Z [2024-02-24 01:22:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[150634e7-ee1e-4cf8-ac0c-fbc9fa4932af] received
2024-02-24T01:22:01.156551717Z [2024-02-24 01:22:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05681218-2b12-48ae-be08-a56be6598bc6] received
2024-02-24T01:22:01.170182568Z [2024-02-24 01:22:01,169: INFO/ForkPoolWorker-15] [150634e7-ee1e-4cf8-ac0c-fbc9fa4932af] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:22:01.171238356Z [2024-02-24 01:22:01,170: INFO/ForkPoolWorker-16] [05681218-2b12-48ae-be08-a56be6598bc6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:22:01.183770597Z [2024-02-24 01:22:01,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6004fdb-011c-449f-8c86-0dd20e689c8d] received
2024-02-24T01:22:01.187826126Z [2024-02-24 01:22:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c731e562-cc0e-4727-98d6-646ef3fc7d6a] received
2024-02-24T01:22:01.203820011Z [2024-02-24 01:22:01,203: INFO/ForkPoolWorker-2] [c731e562-cc0e-4727-98d6-646ef3fc7d6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:22:01.205474019Z [2024-02-24 01:22:01,205: INFO/ForkPoolWorker-1] [a6004fdb-011c-449f-8c86-0dd20e689c8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:22:01.534853306Z [2024-02-24 01:22:01,531: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:22:01.596456082Z [2024-02-24 01:22:01,592: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:22:01.609339410Z [2024-02-24 01:22:01,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:22:01.669427894Z [2024-02-24 01:22:01,666: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:22:01.797385523Z [2024-02-24 01:22:01,796: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:22:01.803126054Z [2024-02-24 01:22:01,802: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:22:01.849443832Z [2024-02-24 01:22:01,849: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:22:01.850629203Z [2024-02-24 01:22:01,850: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:22:01.850674000Z [2024-02-24 01:22:01,850: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:22:01.850749636Z [2024-02-24 01:22:01,850: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:22:01.850903571Z [2024-02-24 01:22:01,850: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:22:01.931770758Z [2024-02-24 01:22:01,931: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:22:01.940594036Z [2024-02-24 01:22:01,940: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:22:02.533094758Z [2024-02-24 01:22:02,532: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a6004fdb-011c-449f-8c86-0dd20e689c8d] succeeded in 1.3478166029999556s: None
2024-02-24T01:22:02.737546563Z [2024-02-24 01:22:02,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[150634e7-ee1e-4cf8-ac0c-fbc9fa4932af] succeeded in 1.5805824990002293s: None
2024-02-24T01:22:03.073861444Z [2024-02-24 01:22:03,073: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:22:03.077215262Z [2024-02-24 01:22:03,076: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:22:03.100743765Z [2024-02-24 01:22:03,100: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:22:03.102374573Z [2024-02-24 01:22:03,102: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:22:03.102427054Z [2024-02-24 01:22:03,102: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:22:03.102537481Z [2024-02-24 01:22:03,102: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:22:03.102697213Z [2024-02-24 01:22:03,102: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:22:03.103057013Z [2024-02-24 01:22:03,102: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:22:03.103170245Z [2024-02-24 01:22:03,103: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:22:03.110176207Z [2024-02-24 01:22:03,109: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:22:03.114086340Z [2024-02-24 01:22:03,113: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:22:03.136483090Z [2024-02-24 01:22:03,136: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:22:03.138142133Z [2024-02-24 01:22:03,137: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:22:03.138491817Z [2024-02-24 01:22:03,138: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:22:03.139148714Z [2024-02-24 01:22:03,138: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:22:03.139466828Z [2024-02-24 01:22:03,139: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:22:03.140326883Z [2024-02-24 01:22:03,139: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:22:03.140566574Z [2024-02-24 01:22:03,140: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:22:03.189383686Z [2024-02-24 01:22:03,189: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:22:03.220259057Z [2024-02-24 01:22:03,220: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:22:04.988181736Z [2024-02-24 01:22:04,987: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[05681218-2b12-48ae-be08-a56be6598bc6] succeeded in 3.829463677999229s: None
2024-02-24T01:22:05.367488967Z [2024-02-24 01:22:05,366: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c731e562-cc0e-4727-98d6-646ef3fc7d6a] succeeded in 4.177890087999913s: None
2024-02-24T01:23:01.105873913Z [2024-02-24 01:23:01,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[753a4315-c846-44e9-b37e-411991a9c2cc] received
2024-02-24T01:23:01.111859157Z [2024-02-24 01:23:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f1b3b7a-de6b-41d1-a6c8-c4ba1f07885d] received
2024-02-24T01:23:01.116591120Z [2024-02-24 01:23:01,116: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7d75cd5-0a5a-4ae0-92ea-0f0729c6fab5] received
2024-02-24T01:23:01.120324751Z [2024-02-24 01:23:01,119: INFO/ForkPoolWorker-15] [753a4315-c846-44e9-b37e-411991a9c2cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:23:01.133938924Z [2024-02-24 01:23:01,132: INFO/ForkPoolWorker-1] [f7d75cd5-0a5a-4ae0-92ea-0f0729c6fab5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:23:01.134301745Z [2024-02-24 01:23:01,134: INFO/ForkPoolWorker-16] [5f1b3b7a-de6b-41d1-a6c8-c4ba1f07885d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:23:01.465466354Z [2024-02-24 01:23:01,462: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:23:01.493956582Z [2024-02-24 01:23:01,490: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:23:01.574985746Z [2024-02-24 01:23:01,569: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:23:01.780331646Z [2024-02-24 01:23:01,779: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:23:01.784641409Z [2024-02-24 01:23:01,784: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:23:01.834753868Z [2024-02-24 01:23:01,834: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:23:01.836265108Z [2024-02-24 01:23:01,836: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:23:01.836424921Z [2024-02-24 01:23:01,836: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:23:01.836587656Z [2024-02-24 01:23:01,836: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:23:01.837139302Z [2024-02-24 01:23:01,836: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:23:01.951967282Z [2024-02-24 01:23:01,951: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:23:02.597111995Z [2024-02-24 01:23:02,595: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7d75cd5-0a5a-4ae0-92ea-0f0729c6fab5] succeeded in 1.4781027959998028s: None
2024-02-24T01:23:02.830222396Z [2024-02-24 01:23:02,829: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:23:02.834376533Z [2024-02-24 01:23:02,833: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:23:02.859018592Z [2024-02-24 01:23:02,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:23:02.865064119Z [2024-02-24 01:23:02,864: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:23:02.865838563Z [2024-02-24 01:23:02,865: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:23:02.866011271Z [2024-02-24 01:23:02,865: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:23:02.866072100Z [2024-02-24 01:23:02,865: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:23:02.866384035Z [2024-02-24 01:23:02,866: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:23:02.866597844Z [2024-02-24 01:23:02,866: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:23:02.951614831Z [2024-02-24 01:23:02,951: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:23:02.955463747Z [2024-02-24 01:23:02,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:23:02.984161620Z [2024-02-24 01:23:02,983: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:23:02.985381050Z [2024-02-24 01:23:02,985: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:23:02.990563894Z [2024-02-24 01:23:02,990: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:23:02.990852701Z [2024-02-24 01:23:02,990: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:23:02.991084151Z [2024-02-24 01:23:02,990: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:23:02.991239767Z [2024-02-24 01:23:02,991: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:23:02.991602986Z [2024-02-24 01:23:02,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:23:02.991822874Z [2024-02-24 01:23:02,991: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:23:03.106470149Z [2024-02-24 01:23:03,106: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:23:04.979347753Z [2024-02-24 01:23:04,978: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[753a4315-c846-44e9-b37e-411991a9c2cc] succeeded in 3.870534272000441s: None
2024-02-24T01:23:05.502102066Z [2024-02-24 01:23:05,501: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5f1b3b7a-de6b-41d1-a6c8-c4ba1f07885d] succeeded in 4.387381828999423s: None
2024-02-24T01:24:00.302874359Z [2024-02-24 01:24:00,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a171b9ff-e262-4509-a4a6-43b2fea8b43d] received
2024-02-24T01:24:00.313692852Z [2024-02-24 01:24:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a73011d7-cf47-48f9-bf0f-acc8a490ff2e] received
2024-02-24T01:24:00.314439584Z [2024-02-24 01:24:00,314: INFO/ForkPoolWorker-15] [a171b9ff-e262-4509-a4a6-43b2fea8b43d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:24:00.326204214Z [2024-02-24 01:24:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[867e41a3-394d-4452-8859-db9b5ca6d0e5] received
2024-02-24T01:24:00.330893337Z [2024-02-24 01:24:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e3fa760c-0142-4040-824f-44cd1f13bb03] received
2024-02-24T01:24:00.331157838Z [2024-02-24 01:24:00,330: INFO/ForkPoolWorker-16] [a73011d7-cf47-48f9-bf0f-acc8a490ff2e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:24:00.336179802Z [2024-02-24 01:24:00,335: INFO/ForkPoolWorker-1] [867e41a3-394d-4452-8859-db9b5ca6d0e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:24:00.366709913Z [2024-02-24 01:24:00,366: INFO/ForkPoolWorker-2] [e3fa760c-0142-4040-824f-44cd1f13bb03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:24:00.680780326Z [2024-02-24 01:24:00,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:24:00.719748716Z [2024-02-24 01:24:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:24:00.745602925Z [2024-02-24 01:24:00,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:24:00.775055630Z [2024-02-24 01:24:00,771: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:24:00.979161704Z [2024-02-24 01:24:00,978: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:24:00.986987524Z [2024-02-24 01:24:00,986: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:24:01.028014421Z [2024-02-24 01:24:01,027: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:24:01.038882335Z [2024-02-24 01:24:01,038: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:24:01.043976291Z [2024-02-24 01:24:01,043: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:24:01.044074707Z [2024-02-24 01:24:01,043: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:24:01.044119225Z [2024-02-24 01:24:01,043: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:24:01.044397844Z [2024-02-24 01:24:01,044: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:24:01.171436180Z [2024-02-24 01:24:01,171: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:24:01.675547406Z [2024-02-24 01:24:01,675: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a171b9ff-e262-4509-a4a6-43b2fea8b43d] succeeded in 1.3696614210002735s: None
2024-02-24T01:24:01.835140553Z [2024-02-24 01:24:01,834: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[867e41a3-394d-4452-8859-db9b5ca6d0e5] succeeded in 1.5102831180001886s: None
2024-02-24T01:24:02.028000876Z [2024-02-24 01:24:02,025: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:24:02.029214664Z [2024-02-24 01:24:02,028: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:24:02.063056651Z [2024-02-24 01:24:02,062: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:24:02.064977562Z [2024-02-24 01:24:02,064: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:24:02.065002082Z [2024-02-24 01:24:02,064: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:24:02.065205619Z [2024-02-24 01:24:02,064: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:24:02.065274146Z [2024-02-24 01:24:02,065: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:24:02.065620574Z [2024-02-24 01:24:02,065: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:24:02.065678526Z [2024-02-24 01:24:02,065: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:24:02.143696395Z [2024-02-24 01:24:02,143: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:24:02.147196292Z [2024-02-24 01:24:02,146: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:24:02.156855214Z [2024-02-24 01:24:02,156: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:24:02.182467566Z [2024-02-24 01:24:02,182: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:24:02.185315141Z [2024-02-24 01:24:02,185: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:24:02.185584551Z [2024-02-24 01:24:02,185: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:24:02.185946076Z [2024-02-24 01:24:02,185: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:24:02.186169662Z [2024-02-24 01:24:02,186: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:24:02.186793654Z [2024-02-24 01:24:02,186: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:24:02.187011268Z [2024-02-24 01:24:02,186: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:24:02.266789818Z [2024-02-24 01:24:02,266: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:24:03.768849452Z [2024-02-24 01:24:03,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a73011d7-cf47-48f9-bf0f-acc8a490ff2e] succeeded in 3.4511447429995314s: None
2024-02-24T01:24:04.316174312Z [2024-02-24 01:24:04,315: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e3fa760c-0142-4040-824f-44cd1f13bb03] succeeded in 3.980251010999382s: None
2024-02-24T01:25:00.261759758Z [2024-02-24 01:25:00,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[157ff487-9fae-4bea-ae2f-06e276b4e999] received
2024-02-24T01:25:00.265008626Z [2024-02-24 01:25:00,264: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[61100fb4-543d-406a-ac4e-b62c753ef00f] received
2024-02-24T01:25:00.275313397Z [2024-02-24 01:25:00,275: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c34287d-897b-4564-886c-34f8924c465f] received
2024-02-24T01:25:00.276064531Z [2024-02-24 01:25:00,275: INFO/ForkPoolWorker-16] [61100fb4-543d-406a-ac4e-b62c753ef00f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:25:00.276348047Z [2024-02-24 01:25:00,276: INFO/ForkPoolWorker-15] [157ff487-9fae-4bea-ae2f-06e276b4e999] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:25:00.282764834Z [2024-02-24 01:25:00,282: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b4bbe7f-428a-4804-bad7-245a61fc4294] received
2024-02-24T01:25:00.283737782Z [2024-02-24 01:25:00,283: INFO/ForkPoolWorker-1] [4c34287d-897b-4564-886c-34f8924c465f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:25:00.290728978Z [2024-02-24 01:25:00,290: INFO/ForkPoolWorker-2] [0b4bbe7f-428a-4804-bad7-245a61fc4294] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:25:00.583678820Z [2024-02-24 01:25:00,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:25:00.594368510Z [2024-02-24 01:25:00,591: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:25:00.622675573Z [2024-02-24 01:25:00,619: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:25:00.659743824Z [2024-02-24 01:25:00,656: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:25:00.805369766Z [2024-02-24 01:25:00,804: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:25:00.812574358Z [2024-02-24 01:25:00,812: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:00.858947888Z [2024-02-24 01:25:00,858: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:25:00.859853075Z [2024-02-24 01:25:00,859: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:25:00.859984534Z [2024-02-24 01:25:00,859: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:25:00.860117550Z [2024-02-24 01:25:00,860: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:25:00.860403478Z [2024-02-24 01:25:00,860: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:25:00.975328942Z [2024-02-24 01:25:00,975: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:01.609323675Z [2024-02-24 01:25:01,608: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[61100fb4-543d-406a-ac4e-b62c753ef00f] succeeded in 1.3400014079998073s: None
2024-02-24T01:25:01.872206197Z [2024-02-24 01:25:01,871: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:25:01.875713054Z [2024-02-24 01:25:01,875: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:01.915211632Z [2024-02-24 01:25:01,915: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:25:01.917865286Z [2024-02-24 01:25:01,917: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:01.918096015Z [2024-02-24 01:25:01,917: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:01.918286778Z [2024-02-24 01:25:01,918: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:01.918411412Z [2024-02-24 01:25:01,918: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:25:01.918668746Z [2024-02-24 01:25:01,918: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:25:01.918743365Z [2024-02-24 01:25:01,918: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:01.919518861Z [2024-02-24 01:25:01,919: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:25:01.922715999Z [2024-02-24 01:25:01,922: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:01.953305355Z [2024-02-24 01:25:01,953: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:25:01.954882838Z [2024-02-24 01:25:01,954: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:01.954901620Z [2024-02-24 01:25:01,954: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:01.955093273Z [2024-02-24 01:25:01,954: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:01.955150191Z [2024-02-24 01:25:01,955: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:25:01.956062640Z [2024-02-24 01:25:01,955: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:25:01.956098395Z [2024-02-24 01:25:01,956: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:01.999346317Z [2024-02-24 01:25:01,999: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:02.052687266Z [2024-02-24 01:25:02,052: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:02.062314303Z [2024-02-24 01:25:02,061: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:25:02.065641950Z [2024-02-24 01:25:02,065: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:02.088929647Z [2024-02-24 01:25:02,088: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:25:02.090177419Z [2024-02-24 01:25:02,089: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:02.090309616Z [2024-02-24 01:25:02,090: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:02.090511754Z [2024-02-24 01:25:02,090: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:02.090643770Z [2024-02-24 01:25:02,090: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:25:02.090939673Z [2024-02-24 01:25:02,090: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:25:02.091076606Z [2024-02-24 01:25:02,090: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:02.170841511Z [2024-02-24 01:25:02,170: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:02.719973425Z [2024-02-24 01:25:02,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[157ff487-9fae-4bea-ae2f-06e276b4e999] succeeded in 2.450405741000395s: None
2024-02-24T01:25:03.141075731Z [2024-02-24 01:25:03,140: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dd218b4-bf76-4cfb-af85-9d9818f8e566] received
2024-02-24T01:25:03.153020607Z [2024-02-24 01:25:03,152: INFO/ForkPoolWorker-15] [7dd218b4-bf76-4cfb-af85-9d9818f8e566] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:25:03.463561760Z [2024-02-24 01:25:03,456: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:25:03.621225918Z [2024-02-24 01:25:03,620: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0b4bbe7f-428a-4804-bad7-245a61fc4294] succeeded in 3.3358837679998032s: None
2024-02-24T01:25:04.262953766Z [2024-02-24 01:25:04,262: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4c34287d-897b-4564-886c-34f8924c465f] succeeded in 3.985558860999845s: None
2024-02-24T01:25:04.754882132Z [2024-02-24 01:25:04,754: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:25:04.758311024Z [2024-02-24 01:25:04,757: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:04.780462971Z [2024-02-24 01:25:04,780: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:25:04.781967803Z [2024-02-24 01:25:04,781: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:04.781984727Z [2024-02-24 01:25:04,781: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:04.782231080Z [2024-02-24 01:25:04,781: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:04.782296284Z [2024-02-24 01:25:04,782: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:25:04.782675082Z [2024-02-24 01:25:04,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:25:04.782773080Z [2024-02-24 01:25:04,782: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:04.872886534Z [2024-02-24 01:25:04,872: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:05.534236194Z [2024-02-24 01:25:05,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2084974b-44f1-411c-9c62-dd0a53a2ea6c] received
2024-02-24T01:25:05.544353350Z [2024-02-24 01:25:05,544: INFO/ForkPoolWorker-16] [2084974b-44f1-411c-9c62-dd0a53a2ea6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:25:05.564581908Z [2024-02-24 01:25:05,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dd218b4-bf76-4cfb-af85-9d9818f8e566] succeeded in 2.420850698999857s: None
2024-02-24T01:25:05.824455370Z [2024-02-24 01:25:05,821: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:25:07.017006443Z [2024-02-24 01:25:07,016: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:25:07.020617388Z [2024-02-24 01:25:07,020: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:07.050090174Z [2024-02-24 01:25:07,049: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:25:07.054849590Z [2024-02-24 01:25:07,054: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:07.054914000Z [2024-02-24 01:25:07,054: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:07.055242998Z [2024-02-24 01:25:07,054: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:07.055381591Z [2024-02-24 01:25:07,055: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:25:07.055879223Z [2024-02-24 01:25:07,055: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:25:07.056018052Z [2024-02-24 01:25:07,055: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:07.169567828Z [2024-02-24 01:25:07,169: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:07.715368921Z [2024-02-24 01:25:07,714: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2084974b-44f1-411c-9c62-dd0a53a2ea6c] succeeded in 2.177612983000472s: None
2024-02-24T01:25:08.230644141Z [2024-02-24 01:25:08,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c291304-8c17-4620-8c98-5f7c1885db35] received
2024-02-24T01:25:08.244913604Z [2024-02-24 01:25:08,243: INFO/ForkPoolWorker-15] [6c291304-8c17-4620-8c98-5f7c1885db35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:25:08.519684773Z [2024-02-24 01:25:08,516: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:25:09.600320284Z [2024-02-24 01:25:09,599: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:25:09.603692259Z [2024-02-24 01:25:09,603: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:25:09.629462415Z [2024-02-24 01:25:09,629: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:25:09.631181715Z [2024-02-24 01:25:09,630: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:25:09.631199077Z [2024-02-24 01:25:09,631: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:25:09.631330249Z [2024-02-24 01:25:09,631: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:25:09.631364487Z [2024-02-24 01:25:09,631: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:25:09.631788935Z [2024-02-24 01:25:09,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:25:09.631818150Z [2024-02-24 01:25:09,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:25:09.748802782Z [2024-02-24 01:25:09,748: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:25:10.346823350Z [2024-02-24 01:25:10,346: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6c291304-8c17-4620-8c98-5f7c1885db35] succeeded in 2.1115726340003675s: None
2024-02-24T01:26:00.324510313Z [2024-02-24 01:26:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcc21a63-f9d7-4e1a-99c2-0179082d8dd5] received
2024-02-24T01:26:00.330065206Z [2024-02-24 01:26:00,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39f8fe14-9a30-42d1-b8da-1a1efc7124e1] received
2024-02-24T01:26:00.335833668Z [2024-02-24 01:26:00,335: INFO/ForkPoolWorker-15] [fcc21a63-f9d7-4e1a-99c2-0179082d8dd5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:26:00.340680569Z [2024-02-24 01:26:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83f0f3f5-a952-4962-824a-a3efae1c3837] received
2024-02-24T01:26:00.341299480Z [2024-02-24 01:26:00,341: INFO/ForkPoolWorker-16] [39f8fe14-9a30-42d1-b8da-1a1efc7124e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:26:00.349614755Z [2024-02-24 01:26:00,349: INFO/ForkPoolWorker-1] [83f0f3f5-a952-4962-824a-a3efae1c3837] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:26:00.350565177Z [2024-02-24 01:26:00,350: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ba1dbfe-9b62-4fc1-8e55-66695b45569e] received
2024-02-24T01:26:00.363140431Z [2024-02-24 01:26:00,362: INFO/ForkPoolWorker-2] [4ba1dbfe-9b62-4fc1-8e55-66695b45569e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:26:00.679540871Z [2024-02-24 01:26:00,675: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:26:00.706284458Z [2024-02-24 01:26:00,701: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:26:00.706704994Z [2024-02-24 01:26:00,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:26:00.710838752Z [2024-02-24 01:26:00,707: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:26:00.921592369Z [2024-02-24 01:26:00,921: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:26:00.925327204Z [2024-02-24 01:26:00,924: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:26:00.959605167Z [2024-02-24 01:26:00,959: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:26:00.963585759Z [2024-02-24 01:26:00,963: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:26:00.963790902Z [2024-02-24 01:26:00,963: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:26:00.963951175Z [2024-02-24 01:26:00,963: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:26:00.964251153Z [2024-02-24 01:26:00,964: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:26:01.073271290Z [2024-02-24 01:26:01,073: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:26:01.107430701Z [2024-02-24 01:26:01,107: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:26:01.711848162Z [2024-02-24 01:26:01,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39f8fe14-9a30-42d1-b8da-1a1efc7124e1] succeeded in 1.3782534830006625s: None
2024-02-24T01:26:01.828360206Z [2024-02-24 01:26:01,827: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcc21a63-f9d7-4e1a-99c2-0179082d8dd5] succeeded in 1.4968758539998817s: None
2024-02-24T01:26:02.077921243Z [2024-02-24 01:26:02,077: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:26:02.081406274Z [2024-02-24 01:26:02,080: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:26:02.100824410Z [2024-02-24 01:26:02,100: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:26:02.102126149Z [2024-02-24 01:26:02,101: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:26:02.103725789Z [2024-02-24 01:26:02,103: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:26:02.103780524Z [2024-02-24 01:26:02,103: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:26:02.103961300Z [2024-02-24 01:26:02,103: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:26:02.104901573Z [2024-02-24 01:26:02,103: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:26:02.105227605Z [2024-02-24 01:26:02,105: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:26:02.105270633Z [2024-02-24 01:26:02,105: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:26:02.105645249Z [2024-02-24 01:26:02,105: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:26:02.134029099Z [2024-02-24 01:26:02,133: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:26:02.135784196Z [2024-02-24 01:26:02,135: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:26:02.135980690Z [2024-02-24 01:26:02,135: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:26:02.136257740Z [2024-02-24 01:26:02,135: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:26:02.136372905Z [2024-02-24 01:26:02,136: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:26:02.137047756Z [2024-02-24 01:26:02,136: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:26:02.137291219Z [2024-02-24 01:26:02,137: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:26:02.216913635Z [2024-02-24 01:26:02,216: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:26:02.244836114Z [2024-02-24 01:26:02,244: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:26:04.060909042Z [2024-02-24 01:26:04,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[83f0f3f5-a952-4962-824a-a3efae1c3837] succeeded in 3.7178978390002158s: None
2024-02-24T01:26:04.189867349Z [2024-02-24 01:26:04,189: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4ba1dbfe-9b62-4fc1-8e55-66695b45569e] succeeded in 3.8369539570003326s: None
2024-02-24T01:27:01.330003847Z [2024-02-24 01:27:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2768016e-3bab-4b97-8821-58679b2fc8ed] received
2024-02-24T01:27:01.332326909Z [2024-02-24 01:27:01,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf7f830f-1af5-455d-8cbd-58b0315ac4ee] received
2024-02-24T01:27:01.337351628Z [2024-02-24 01:27:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c01bc63-b141-44e6-9a2f-01d58744c918] received
2024-02-24T01:27:01.338561230Z [2024-02-24 01:27:01,338: INFO/ForkPoolWorker-16] [bf7f830f-1af5-455d-8cbd-58b0315ac4ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:27:01.350682388Z [2024-02-24 01:27:01,350: INFO/ForkPoolWorker-15] [2768016e-3bab-4b97-8821-58679b2fc8ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:27:01.354466848Z [2024-02-24 01:27:01,354: INFO/ForkPoolWorker-1] [2c01bc63-b141-44e6-9a2f-01d58744c918] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:27:01.630942623Z [2024-02-24 01:27:01,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:27:01.666454312Z [2024-02-24 01:27:01,663: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:27:01.670804634Z [2024-02-24 01:27:01,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:27:01.795066856Z [2024-02-24 01:27:01,794: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:27:01.799038693Z [2024-02-24 01:27:01,798: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:27:01.821340313Z [2024-02-24 01:27:01,821: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:27:01.822462492Z [2024-02-24 01:27:01,822: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:27:01.822580194Z [2024-02-24 01:27:01,822: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:27:01.822658765Z [2024-02-24 01:27:01,822: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:27:01.822959332Z [2024-02-24 01:27:01,822: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:27:01.913601268Z [2024-02-24 01:27:01,913: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:27:02.542424534Z [2024-02-24 01:27:02,541: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c01bc63-b141-44e6-9a2f-01d58744c918] succeeded in 1.2025641479995102s: None
2024-02-24T01:27:02.955110019Z [2024-02-24 01:27:02,954: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:27:02.958896259Z [2024-02-24 01:27:02,958: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:27:02.960392358Z [2024-02-24 01:27:02,959: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:27:02.963937541Z [2024-02-24 01:27:02,963: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:27:02.986249622Z [2024-02-24 01:27:02,985: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:27:02.987563263Z [2024-02-24 01:27:02,987: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:27:02.987622458Z [2024-02-24 01:27:02,987: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:27:02.987836052Z [2024-02-24 01:27:02,987: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:27:02.987900780Z [2024-02-24 01:27:02,987: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:27:02.988298440Z [2024-02-24 01:27:02,988: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:27:02.988424988Z [2024-02-24 01:27:02,988: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:27:02.998571960Z [2024-02-24 01:27:02,994: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:27:03.003684647Z [2024-02-24 01:27:03,003: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:27:03.003705508Z [2024-02-24 01:27:03,003: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:27:03.003822519Z [2024-02-24 01:27:03,003: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:27:03.003831442Z [2024-02-24 01:27:03,003: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:27:03.004256534Z [2024-02-24 01:27:03,004: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:27:03.004268512Z [2024-02-24 01:27:03,004: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:27:03.086871499Z [2024-02-24 01:27:03,086: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:27:03.111638772Z [2024-02-24 01:27:03,111: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:27:06.147424109Z [2024-02-24 01:27:06,146: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bf7f830f-1af5-455d-8cbd-58b0315ac4ee] succeeded in 4.813942441000108s: None
2024-02-24T01:27:07.188283125Z [2024-02-24 01:27:07,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2768016e-3bab-4b97-8821-58679b2fc8ed] succeeded in 5.856568842999877s: None
2024-02-24T01:28:01.164664557Z [2024-02-24 01:28:01,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c34dd184-3a9f-42a4-b389-645193580a4e] received
2024-02-24T01:28:01.168494713Z [2024-02-24 01:28:01,168: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02bc0c08-7f1a-445b-897c-5ac231568744] received
2024-02-24T01:28:01.179655323Z [2024-02-24 01:28:01,179: INFO/ForkPoolWorker-15] [c34dd184-3a9f-42a4-b389-645193580a4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:28:01.182663064Z [2024-02-24 01:28:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[431b9298-70c1-41bb-824d-8b81e3d2a25e] received
2024-02-24T01:28:01.184835563Z [2024-02-24 01:28:01,184: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e68c5488-1248-4ed3-8616-1c69fac17299] received
2024-02-24T01:28:01.196007181Z [2024-02-24 01:28:01,195: INFO/ForkPoolWorker-2] [e68c5488-1248-4ed3-8616-1c69fac17299] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:28:01.197105162Z [2024-02-24 01:28:01,196: INFO/ForkPoolWorker-1] [431b9298-70c1-41bb-824d-8b81e3d2a25e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:28:01.199183000Z [2024-02-24 01:28:01,198: INFO/ForkPoolWorker-16] [02bc0c08-7f1a-445b-897c-5ac231568744] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:28:01.548246218Z [2024-02-24 01:28:01,544: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:28:01.558785612Z [2024-02-24 01:28:01,554: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:28:01.608812012Z [2024-02-24 01:28:01,604: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:28:01.674510011Z [2024-02-24 01:28:01,671: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:28:01.860316702Z [2024-02-24 01:28:01,860: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:28:01.866652610Z [2024-02-24 01:28:01,866: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:28:01.871520337Z [2024-02-24 01:28:01,870: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:28:01.914623440Z [2024-02-24 01:28:01,914: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:28:01.919171300Z [2024-02-24 01:28:01,918: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:28:01.919448092Z [2024-02-24 01:28:01,919: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:28:01.919623630Z [2024-02-24 01:28:01,919: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:28:01.919966118Z [2024-02-24 01:28:01,919: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:28:02.066379899Z [2024-02-24 01:28:02,066: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:28:02.502061126Z [2024-02-24 01:28:02,501: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[02bc0c08-7f1a-445b-897c-5ac231568744] succeeded in 1.3266749370004618s: None
2024-02-24T01:28:02.820446665Z [2024-02-24 01:28:02,820: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e68c5488-1248-4ed3-8616-1c69fac17299] succeeded in 1.6341387299999042s: None
2024-02-24T01:28:03.083792581Z [2024-02-24 01:28:03,083: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:28:03.087975797Z [2024-02-24 01:28:03,087: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:28:03.091635182Z [2024-02-24 01:28:03,091: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:28:03.095219021Z [2024-02-24 01:28:03,094: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:28:03.110379849Z [2024-02-24 01:28:03,110: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:28:03.111828810Z [2024-02-24 01:28:03,111: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:28:03.111864739Z [2024-02-24 01:28:03,111: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:28:03.111987606Z [2024-02-24 01:28:03,111: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:28:03.112121929Z [2024-02-24 01:28:03,111: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:28:03.112451652Z [2024-02-24 01:28:03,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:28:03.112558021Z [2024-02-24 01:28:03,112: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:28:03.125443095Z [2024-02-24 01:28:03,125: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:28:03.127064124Z [2024-02-24 01:28:03,126: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:28:03.127414915Z [2024-02-24 01:28:03,126: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:28:03.127756985Z [2024-02-24 01:28:03,127: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:28:03.127994633Z [2024-02-24 01:28:03,127: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:28:03.128596136Z [2024-02-24 01:28:03,128: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:28:03.128860007Z [2024-02-24 01:28:03,128: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:28:03.211105129Z [2024-02-24 01:28:03,210: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:28:03.241253798Z [2024-02-24 01:28:03,240: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:28:05.340381011Z [2024-02-24 01:28:05,339: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[431b9298-70c1-41bb-824d-8b81e3d2a25e] succeeded in 4.155218197999602s: None
2024-02-24T01:28:05.564493483Z [2024-02-24 01:28:05,563: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c34dd184-3a9f-42a4-b389-645193580a4e] succeeded in 4.392686085000605s: None
2024-02-24T01:29:00.571870954Z [2024-02-24 01:29:00,571: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f89727fd-3210-4366-8386-f62d94686e68] received
2024-02-24T01:29:00.578531453Z [2024-02-24 01:29:00,578: INFO/ForkPoolWorker-15] [f89727fd-3210-4366-8386-f62d94686e68] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:29:00.594357443Z [2024-02-24 01:29:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ecf05c8-44e2-4cf4-92bc-8892d6539172] received
2024-02-24T01:29:00.596187727Z [2024-02-24 01:29:00,596: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[503e0f67-d886-41a0-8b12-dda1a135e453] received
2024-02-24T01:29:00.604286867Z [2024-02-24 01:29:00,604: INFO/ForkPoolWorker-16] [1ecf05c8-44e2-4cf4-92bc-8892d6539172] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:29:00.604771637Z [2024-02-24 01:29:00,604: INFO/ForkPoolWorker-1] [503e0f67-d886-41a0-8b12-dda1a135e453] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:29:00.923759974Z [2024-02-24 01:29:00,920: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:29:00.973861291Z [2024-02-24 01:29:00,970: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:29:01.003729921Z [2024-02-24 01:29:01,000: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:29:01.155667251Z [2024-02-24 01:29:01,155: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:29:01.159620714Z [2024-02-24 01:29:01,159: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:29:01.196797895Z [2024-02-24 01:29:01,196: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:29:01.198954808Z [2024-02-24 01:29:01,198: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:29:01.199324499Z [2024-02-24 01:29:01,198: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:29:01.199546884Z [2024-02-24 01:29:01,199: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:29:01.200085960Z [2024-02-24 01:29:01,199: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:29:01.350665498Z [2024-02-24 01:29:01,350: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:29:02.054787456Z [2024-02-24 01:29:02,054: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[503e0f67-d886-41a0-8b12-dda1a135e453] succeeded in 1.4570817209996676s: None
2024-02-24T01:29:02.198077037Z [2024-02-24 01:29:02,197: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:29:02.202524393Z [2024-02-24 01:29:02,202: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:29:02.239942657Z [2024-02-24 01:29:02,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:29:02.242607995Z [2024-02-24 01:29:02,242: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:29:02.242804719Z [2024-02-24 01:29:02,242: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:29:02.243026537Z [2024-02-24 01:29:02,242: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:29:02.243151035Z [2024-02-24 01:29:02,243: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:29:02.244320207Z [2024-02-24 01:29:02,244: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:29:02.244487428Z [2024-02-24 01:29:02,244: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:29:02.294333541Z [2024-02-24 01:29:02,293: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:29:02.298525507Z [2024-02-24 01:29:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:29:02.324710107Z [2024-02-24 01:29:02,324: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:29:02.327685370Z [2024-02-24 01:29:02,327: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:29:02.327713026Z [2024-02-24 01:29:02,327: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:29:02.327896503Z [2024-02-24 01:29:02,327: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:29:02.327913246Z [2024-02-24 01:29:02,327: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:29:02.328238123Z [2024-02-24 01:29:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:29:02.328753833Z [2024-02-24 01:29:02,328: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:29:02.330560481Z [2024-02-24 01:29:02,330: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:29:02.424417518Z [2024-02-24 01:29:02,424: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:29:04.100025392Z [2024-02-24 01:29:04,099: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f89727fd-3210-4366-8386-f62d94686e68] succeeded in 3.5264009029997396s: None
2024-02-24T01:29:04.447590903Z [2024-02-24 01:29:04,446: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1ecf05c8-44e2-4cf4-92bc-8892d6539172] succeeded in 3.850268221999613s: None
2024-02-24T01:30:01.321110525Z [2024-02-24 01:30:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56f03854-d6ea-4f59-9e5a-4735734405f2] received
2024-02-24T01:30:01.326476308Z [2024-02-24 01:30:01,326: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99531063-33bb-4ccd-ad5e-f515cf8a2002] received
2024-02-24T01:30:01.328219897Z [2024-02-24 01:30:01,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7eb11ecd-8f44-4e45-a7bc-e923c20942a3] received
2024-02-24T01:30:01.330791957Z [2024-02-24 01:30:01,330: INFO/ForkPoolWorker-15] [56f03854-d6ea-4f59-9e5a-4735734405f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:30:01.331148976Z [2024-02-24 01:30:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e333622-1d5f-4624-97bf-420298e8231e] received
2024-02-24T01:30:01.336428347Z [2024-02-24 01:30:01,336: INFO/ForkPoolWorker-16] [99531063-33bb-4ccd-ad5e-f515cf8a2002] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:30:01.336852851Z [2024-02-24 01:30:01,336: INFO/ForkPoolWorker-1] [7eb11ecd-8f44-4e45-a7bc-e923c20942a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:30:01.340417748Z [2024-02-24 01:30:01,340: INFO/ForkPoolWorker-2] [8e333622-1d5f-4624-97bf-420298e8231e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:30:01.360901034Z [2024-02-24 01:30:01,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a8a2e70-dc49-4c1c-97c1-cc5b43d28ce6] received
2024-02-24T01:30:01.372760580Z [2024-02-24 01:30:01,372: INFO/ForkPoolWorker-3] [9a8a2e70-dc49-4c1c-97c1-cc5b43d28ce6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:30:01.706050519Z [2024-02-24 01:30:01,702: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:30:01.838841240Z [2024-02-24 01:30:01,835: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:30:01.845476960Z [2024-02-24 01:30:01,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:30:01.845653804Z [2024-02-24 01:30:01,840: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:30:01.984091816Z [2024-02-24 01:30:01,980: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:30:02.063436006Z [2024-02-24 01:30:02,063: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:02.106324668Z [2024-02-24 01:30:02,105: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:30:02.110964507Z [2024-02-24 01:30:02,110: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:02.162246982Z [2024-02-24 01:30:02,161: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:30:02.164319380Z [2024-02-24 01:30:02,164: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:30:02.164676002Z [2024-02-24 01:30:02,164: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:30:02.164912938Z [2024-02-24 01:30:02,164: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:30:02.165335128Z [2024-02-24 01:30:02,165: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:30:02.322746959Z [2024-02-24 01:30:02,322: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:02.916208360Z [2024-02-24 01:30:02,915: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8e333622-1d5f-4624-97bf-420298e8231e] succeeded in 1.5830098370006453s: None
2024-02-24T01:30:03.106807943Z [2024-02-24 01:30:03,106: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[56f03854-d6ea-4f59-9e5a-4735734405f2] succeeded in 1.7839378909993684s: None
2024-02-24T01:30:03.710703718Z [2024-02-24 01:30:03,710: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:30:03.714208564Z [2024-02-24 01:30:03,713: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:03.728514534Z [2024-02-24 01:30:03,728: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T01:30:03.732290832Z [2024-02-24 01:30:03,731: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:03.736819311Z [2024-02-24 01:30:03,736: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:30:03.738098203Z [2024-02-24 01:30:03,737: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:03.738119074Z [2024-02-24 01:30:03,738: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:03.738234619Z [2024-02-24 01:30:03,738: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:03.738261540Z [2024-02-24 01:30:03,738: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:30:03.738538127Z [2024-02-24 01:30:03,738: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:30:03.738546064Z [2024-02-24 01:30:03,738: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:03.768771914Z [2024-02-24 01:30:03,768: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:30:03.770833667Z [2024-02-24 01:30:03,770: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:03.770850927Z [2024-02-24 01:30:03,770: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:03.770855079Z [2024-02-24 01:30:03,770: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:03.770977305Z [2024-02-24 01:30:03,770: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T01:30:03.771526989Z [2024-02-24 01:30:03,771: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:30:03.771544901Z [2024-02-24 01:30:03,771: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:03.816204213Z [2024-02-24 01:30:03,815: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:30:03.824434355Z [2024-02-24 01:30:03,822: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:03.841608498Z [2024-02-24 01:30:03,841: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:03.856202433Z [2024-02-24 01:30:03,855: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:03.869823859Z [2024-02-24 01:30:03,869: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:30:03.875864778Z [2024-02-24 01:30:03,875: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:03.876036789Z [2024-02-24 01:30:03,875: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:03.876570284Z [2024-02-24 01:30:03,876: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:03.876798881Z [2024-02-24 01:30:03,876: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:30:03.877496574Z [2024-02-24 01:30:03,877: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:30:03.877638056Z [2024-02-24 01:30:03,877: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:04.037267679Z [2024-02-24 01:30:04,036: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:04.799410579Z [2024-02-24 01:30:04,798: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7eb11ecd-8f44-4e45-a7bc-e923c20942a3] succeeded in 3.4693009539996638s: None
2024-02-24T01:30:05.510179392Z [2024-02-24 01:30:05,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6aff891f-9c2a-45cb-8dcf-93cf06eec8fb] received
2024-02-24T01:30:05.518193351Z [2024-02-24 01:30:05,517: INFO/ForkPoolWorker-15] [6aff891f-9c2a-45cb-8dcf-93cf06eec8fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:30:05.637279143Z [2024-02-24 01:30:05,636: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[99531063-33bb-4ccd-ad5e-f515cf8a2002] succeeded in 4.308999440999287s: None
2024-02-24T01:30:05.807535252Z [2024-02-24 01:30:05,804: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:30:06.087660851Z [2024-02-24 01:30:06,087: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9a8a2e70-dc49-4c1c-97c1-cc5b43d28ce6] succeeded in 4.724396405000334s: None
2024-02-24T01:30:06.989807053Z [2024-02-24 01:30:06,989: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:30:06.993223930Z [2024-02-24 01:30:06,992: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:07.025595889Z [2024-02-24 01:30:07,025: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:30:07.028154924Z [2024-02-24 01:30:07,027: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:07.028203757Z [2024-02-24 01:30:07,028: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:07.028444453Z [2024-02-24 01:30:07,028: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:07.028496784Z [2024-02-24 01:30:07,028: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:30:07.028895949Z [2024-02-24 01:30:07,028: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:30:07.029006581Z [2024-02-24 01:30:07,028: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:07.166216252Z [2024-02-24 01:30:07,165: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:07.770437648Z [2024-02-24 01:30:07,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6aff891f-9c2a-45cb-8dcf-93cf06eec8fb] succeeded in 2.257095027000105s: None
2024-02-24T01:30:08.262391103Z [2024-02-24 01:30:08,262: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[268da403-02f8-4295-a63d-d91205f2d857] received
2024-02-24T01:30:08.274405729Z [2024-02-24 01:30:08,274: INFO/ForkPoolWorker-15] [268da403-02f8-4295-a63d-d91205f2d857] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:30:08.545038498Z [2024-02-24 01:30:08,541: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:30:09.658500315Z [2024-02-24 01:30:09,658: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:30:09.661708612Z [2024-02-24 01:30:09,661: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:09.679803859Z [2024-02-24 01:30:09,679: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:30:09.681018112Z [2024-02-24 01:30:09,680: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:09.681098348Z [2024-02-24 01:30:09,680: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:09.681218506Z [2024-02-24 01:30:09,681: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:09.681300597Z [2024-02-24 01:30:09,681: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:30:09.681564645Z [2024-02-24 01:30:09,681: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:30:09.681687735Z [2024-02-24 01:30:09,681: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:09.760554983Z [2024-02-24 01:30:09,760: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:10.245461235Z [2024-02-24 01:30:10,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[268da403-02f8-4295-a63d-d91205f2d857] succeeded in 1.9812607499998194s: None
2024-02-24T01:30:10.555740568Z [2024-02-24 01:30:10,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66ed255b-25ef-43fe-ad8e-b9dc5207fd4c] received
2024-02-24T01:30:10.563080894Z [2024-02-24 01:30:10,562: INFO/ForkPoolWorker-15] [66ed255b-25ef-43fe-ad8e-b9dc5207fd4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:30:10.856279958Z [2024-02-24 01:30:10,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:30:12.015280664Z [2024-02-24 01:30:12,014: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:30:12.018916412Z [2024-02-24 01:30:12,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:30:12.045443216Z [2024-02-24 01:30:12,045: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:30:12.046956269Z [2024-02-24 01:30:12,046: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:30:12.047038895Z [2024-02-24 01:30:12,046: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:30:12.047217122Z [2024-02-24 01:30:12,047: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:30:12.047324884Z [2024-02-24 01:30:12,047: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:30:12.047757449Z [2024-02-24 01:30:12,047: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:30:12.047868227Z [2024-02-24 01:30:12,047: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:30:12.124372139Z [2024-02-24 01:30:12,124: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:30:12.676174632Z [2024-02-24 01:30:12,674: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[66ed255b-25ef-43fe-ad8e-b9dc5207fd4c] succeeded in 2.118025702000523s: None
2024-02-24T01:31:01.189196786Z [2024-02-24 01:31:01,188: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f0ced18-7e53-4c49-8146-e287f2fd943d] received
2024-02-24T01:31:01.195367344Z [2024-02-24 01:31:01,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[960000e3-3c4e-41dc-a823-c3a6594e98aa] received
2024-02-24T01:31:01.200553168Z [2024-02-24 01:31:01,200: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b79284dd-c707-4b4f-bfe7-5e4616fea67c] received
2024-02-24T01:31:01.209721202Z [2024-02-24 01:31:01,209: INFO/ForkPoolWorker-16] [960000e3-3c4e-41dc-a823-c3a6594e98aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:31:01.218041868Z [2024-02-24 01:31:01,215: INFO/ForkPoolWorker-1] [b79284dd-c707-4b4f-bfe7-5e4616fea67c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:31:01.218069790Z [2024-02-24 01:31:01,216: INFO/ForkPoolWorker-15] [6f0ced18-7e53-4c49-8146-e287f2fd943d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:31:01.559777304Z [2024-02-24 01:31:01,556: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:31:01.573261500Z [2024-02-24 01:31:01,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:31:01.609814791Z [2024-02-24 01:31:01,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:31:01.772833123Z [2024-02-24 01:31:01,772: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:31:01.777382028Z [2024-02-24 01:31:01,776: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:31:01.820659053Z [2024-02-24 01:31:01,820: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:31:01.822647486Z [2024-02-24 01:31:01,822: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:31:01.822717518Z [2024-02-24 01:31:01,822: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:31:01.822806599Z [2024-02-24 01:31:01,822: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:31:01.823078640Z [2024-02-24 01:31:01,822: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:31:01.908165264Z [2024-02-24 01:31:01,907: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:31:02.742431465Z [2024-02-24 01:31:02,741: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b79284dd-c707-4b4f-bfe7-5e4616fea67c] succeeded in 1.5405716880004547s: None
2024-02-24T01:31:02.965031485Z [2024-02-24 01:31:02,964: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:31:02.968691835Z [2024-02-24 01:31:02,968: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:31:02.992499251Z [2024-02-24 01:31:02,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:31:02.994442047Z [2024-02-24 01:31:02,994: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:31:02.994613016Z [2024-02-24 01:31:02,994: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:31:02.994899763Z [2024-02-24 01:31:02,994: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:31:02.995035670Z [2024-02-24 01:31:02,994: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:31:02.995464135Z [2024-02-24 01:31:02,995: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:31:02.995767155Z [2024-02-24 01:31:02,995: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:31:03.014587782Z [2024-02-24 01:31:03,014: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:31:03.018832311Z [2024-02-24 01:31:03,018: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:31:03.041816494Z [2024-02-24 01:31:03,041: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:31:03.043340139Z [2024-02-24 01:31:03,043: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:31:03.043589344Z [2024-02-24 01:31:03,043: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:31:03.043774268Z [2024-02-24 01:31:03,043: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:31:03.043887903Z [2024-02-24 01:31:03,043: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:31:03.044198640Z [2024-02-24 01:31:03,044: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:31:03.044341512Z [2024-02-24 01:31:03,044: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:31:03.122765867Z [2024-02-24 01:31:03,122: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:31:03.124801646Z [2024-02-24 01:31:03,124: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:31:05.305554490Z [2024-02-24 01:31:05,305: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f0ced18-7e53-4c49-8146-e287f2fd943d] succeeded in 4.112763262000044s: None
2024-02-24T01:31:05.498755840Z [2024-02-24 01:31:05,498: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[960000e3-3c4e-41dc-a823-c3a6594e98aa] succeeded in 4.300979138999537s: None
2024-02-24T01:32:00.962486865Z [2024-02-24 01:32:00,962: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802055dc-d3f7-4b04-9e06-bf98e9d81032] received
2024-02-24T01:32:00.965524667Z [2024-02-24 01:32:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3e25311-fc3f-4424-8e61-98bd8ae08eaf] received
2024-02-24T01:32:00.971795833Z [2024-02-24 01:32:00,971: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58b1934f-b769-4667-a4e5-0138fcf7bef9] received
2024-02-24T01:32:00.974592253Z [2024-02-24 01:32:00,974: INFO/ForkPoolWorker-15] [802055dc-d3f7-4b04-9e06-bf98e9d81032] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:32:00.974907612Z [2024-02-24 01:32:00,974: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f0d0607-1271-41cc-8d47-ec58fbcf70c9] received
2024-02-24T01:32:00.976881259Z [2024-02-24 01:32:00,976: INFO/ForkPoolWorker-16] [c3e25311-fc3f-4424-8e61-98bd8ae08eaf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:32:00.992069180Z [2024-02-24 01:32:00,991: INFO/ForkPoolWorker-1] [58b1934f-b769-4667-a4e5-0138fcf7bef9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:32:00.993096202Z [2024-02-24 01:32:00,992: INFO/ForkPoolWorker-2] [4f0d0607-1271-41cc-8d47-ec58fbcf70c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:32:01.367407091Z [2024-02-24 01:32:01,363: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:32:01.409013764Z [2024-02-24 01:32:01,406: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:32:01.668995952Z [2024-02-24 01:32:01,668: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:32:01.750112466Z [2024-02-24 01:32:01,733: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:32:01.837132912Z [2024-02-24 01:32:01,834: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:32:02.164539599Z [2024-02-24 01:32:02,164: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:32:02.168670986Z [2024-02-24 01:32:02,168: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:32:02.204382471Z [2024-02-24 01:32:02,204: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:32:02.215042728Z [2024-02-24 01:32:02,214: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:32:02.215269163Z [2024-02-24 01:32:02,214: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:32:02.215443509Z [2024-02-24 01:32:02,215: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:32:02.215626695Z [2024-02-24 01:32:02,215: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:32:02.334426520Z [2024-02-24 01:32:02,334: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[802055dc-d3f7-4b04-9e06-bf98e9d81032] succeeded in 1.3705066399998032s: None
2024-02-24T01:32:02.384053468Z [2024-02-24 01:32:02,383: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:32:02.842778994Z [2024-02-24 01:32:02,842: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:32:02.851370621Z [2024-02-24 01:32:02,850: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:32:02.883677472Z [2024-02-24 01:32:02,883: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:32:02.885119963Z [2024-02-24 01:32:02,884: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:32:02.885170112Z [2024-02-24 01:32:02,885: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:32:02.885341658Z [2024-02-24 01:32:02,885: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:32:02.885391639Z [2024-02-24 01:32:02,885: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:32:02.885816469Z [2024-02-24 01:32:02,885: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:32:02.885924479Z [2024-02-24 01:32:02,885: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:32:02.978162095Z [2024-02-24 01:32:02,977: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:32:03.060232053Z [2024-02-24 01:32:03,059: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f0d0607-1271-41cc-8d47-ec58fbcf70c9] succeeded in 2.0822747550000713s: None
2024-02-24T01:32:03.364172577Z [2024-02-24 01:32:03,363: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:32:03.367597545Z [2024-02-24 01:32:03,367: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:32:03.399603180Z [2024-02-24 01:32:03,399: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:32:03.401449544Z [2024-02-24 01:32:03,401: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:32:03.401492882Z [2024-02-24 01:32:03,401: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:32:03.401655393Z [2024-02-24 01:32:03,401: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:32:03.401666310Z [2024-02-24 01:32:03,401: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:32:03.402149668Z [2024-02-24 01:32:03,401: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:32:03.402201160Z [2024-02-24 01:32:03,402: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:32:03.495408652Z [2024-02-24 01:32:03,494: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:32:04.984010265Z [2024-02-24 01:32:04,983: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58b1934f-b769-4667-a4e5-0138fcf7bef9] succeeded in 4.010024068999883s: None
2024-02-24T01:32:05.282999256Z [2024-02-24 01:32:05,282: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3e25311-fc3f-4424-8e61-98bd8ae08eaf] succeeded in 4.31578486699982s: None
2024-02-24T01:33:00.745467198Z [2024-02-24 01:33:00,745: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bffad0a8-a647-407b-b45d-7fd2a480a70d] received
2024-02-24T01:33:00.754970620Z [2024-02-24 01:33:00,754: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8980fd8b-3c5e-4352-a0e8-98c02d48e13c] received
2024-02-24T01:33:00.757965841Z [2024-02-24 01:33:00,755: INFO/ForkPoolWorker-15] [bffad0a8-a647-407b-b45d-7fd2a480a70d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:33:00.764152575Z [2024-02-24 01:33:00,763: INFO/ForkPoolWorker-16] [8980fd8b-3c5e-4352-a0e8-98c02d48e13c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:33:01.056980701Z [2024-02-24 01:33:01,053: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:33:01.109546750Z [2024-02-24 01:33:01,109: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58bdce01-747d-45c8-bf3a-840466429a9b] received
2024-02-24T01:33:01.127878514Z [2024-02-24 01:33:01,127: INFO/ForkPoolWorker-1] [58bdce01-747d-45c8-bf3a-840466429a9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:33:01.149152169Z [2024-02-24 01:33:01,145: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:33:01.906574486Z [2024-02-24 01:33:01,901: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:33:02.098055325Z [2024-02-24 01:33:02,097: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:33:02.102234329Z [2024-02-24 01:33:02,101: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:33:02.135562500Z [2024-02-24 01:33:02,135: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:33:02.137588665Z [2024-02-24 01:33:02,137: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:33:02.137799450Z [2024-02-24 01:33:02,137: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:33:02.138167627Z [2024-02-24 01:33:02,137: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:33:02.138330503Z [2024-02-24 01:33:02,138: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:33:02.248510481Z [2024-02-24 01:33:02,248: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:33:02.726229179Z [2024-02-24 01:33:02,725: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:33:02.749151809Z [2024-02-24 01:33:02,748: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:33:02.849077518Z [2024-02-24 01:33:02,848: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:33:02.850998019Z [2024-02-24 01:33:02,850: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:33:02.851164741Z [2024-02-24 01:33:02,850: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:33:02.851409333Z [2024-02-24 01:33:02,851: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:33:02.851623358Z [2024-02-24 01:33:02,851: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:33:02.851932517Z [2024-02-24 01:33:02,851: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:33:02.852067530Z [2024-02-24 01:33:02,851: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:33:02.952438647Z [2024-02-24 01:33:02,952: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:33:02.966851791Z [2024-02-24 01:33:02,966: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:33:02.970462833Z [2024-02-24 01:33:02,969: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:33:02.999442746Z [2024-02-24 01:33:02,999: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:33:03.000784117Z [2024-02-24 01:33:03,000: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:33:03.000874989Z [2024-02-24 01:33:03,000: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:33:03.001012012Z [2024-02-24 01:33:03,000: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:33:03.001097346Z [2024-02-24 01:33:03,001: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:33:03.001401862Z [2024-02-24 01:33:03,001: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:33:03.001527778Z [2024-02-24 01:33:03,001: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:33:03.079465802Z [2024-02-24 01:33:03,079: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:33:03.107921745Z [2024-02-24 01:33:03,107: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58bdce01-747d-45c8-bf3a-840466429a9b] succeeded in 1.995436124000662s: None
2024-02-24T01:33:04.888112070Z [2024-02-24 01:33:04,887: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8980fd8b-3c5e-4352-a0e8-98c02d48e13c] succeeded in 4.1313295569998445s: None
2024-02-24T01:33:05.572357660Z [2024-02-24 01:33:05,571: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bffad0a8-a647-407b-b45d-7fd2a480a70d] succeeded in 4.824316557000202s: None
2024-02-24T01:34:00.422837393Z [2024-02-24 01:34:00,422: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64a7ce20-add7-4ed9-8e34-ac79720cf350] received
2024-02-24T01:34:00.426179029Z [2024-02-24 01:34:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f47b97d3-819d-4ec1-8053-63dc3ee2c494] received
2024-02-24T01:34:00.434038181Z [2024-02-24 01:34:00,433: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8667a1b8-62af-430f-b25f-a3cd6ac70fc5] received
2024-02-24T01:34:00.435666663Z [2024-02-24 01:34:00,435: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19914eb5-e71b-4a2e-ae23-8e8bf0cb7519] received
2024-02-24T01:34:00.436763267Z [2024-02-24 01:34:00,436: INFO/ForkPoolWorker-16] [f47b97d3-819d-4ec1-8053-63dc3ee2c494] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:34:00.441054631Z [2024-02-24 01:34:00,440: INFO/ForkPoolWorker-15] [64a7ce20-add7-4ed9-8e34-ac79720cf350] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:34:00.445280446Z [2024-02-24 01:34:00,444: INFO/ForkPoolWorker-1] [8667a1b8-62af-430f-b25f-a3cd6ac70fc5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:34:00.446374565Z [2024-02-24 01:34:00,446: INFO/ForkPoolWorker-2] [19914eb5-e71b-4a2e-ae23-8e8bf0cb7519] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:34:00.786742432Z [2024-02-24 01:34:00,783: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:34:00.828831160Z [2024-02-24 01:34:00,825: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:34:00.870889507Z [2024-02-24 01:34:00,867: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:34:00.968168951Z [2024-02-24 01:34:00,964: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:34:00.974239350Z [2024-02-24 01:34:00,973: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:34:00.978195148Z [2024-02-24 01:34:00,977: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:34:01.011967843Z [2024-02-24 01:34:01,011: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:34:01.015201774Z [2024-02-24 01:34:01,014: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:34:01.015700551Z [2024-02-24 01:34:01,015: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:34:01.015769270Z [2024-02-24 01:34:01,015: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:34:01.016018456Z [2024-02-24 01:34:01,015: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:34:01.133808294Z [2024-02-24 01:34:01,133: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:34:01.136013924Z [2024-02-24 01:34:01,135: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:34:01.862718038Z [2024-02-24 01:34:01,862: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64a7ce20-add7-4ed9-8e34-ac79720cf350] succeeded in 1.434797269000228s: None
2024-02-24T01:34:01.926960265Z [2024-02-24 01:34:01,926: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f47b97d3-819d-4ec1-8053-63dc3ee2c494] succeeded in 1.4960411219999514s: None
2024-02-24T01:34:02.641963247Z [2024-02-24 01:34:02,637: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:34:02.642003226Z [2024-02-24 01:34:02,641: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:34:02.691657917Z [2024-02-24 01:34:02,691: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:34:02.695192917Z [2024-02-24 01:34:02,694: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:34:02.760998153Z [2024-02-24 01:34:02,757: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:34:02.783200843Z [2024-02-24 01:34:02,782: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:34:02.783230380Z [2024-02-24 01:34:02,783: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:34:02.783331027Z [2024-02-24 01:34:02,783: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:34:02.783371058Z [2024-02-24 01:34:02,783: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:34:02.783639074Z [2024-02-24 01:34:02,783: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:34:02.783727673Z [2024-02-24 01:34:02,783: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:34:02.821447294Z [2024-02-24 01:34:02,820: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:34:02.823641036Z [2024-02-24 01:34:02,823: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:34:02.823974467Z [2024-02-24 01:34:02,823: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:34:02.824198223Z [2024-02-24 01:34:02,824: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:34:02.824326770Z [2024-02-24 01:34:02,824: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:34:02.824966810Z [2024-02-24 01:34:02,824: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:34:02.826022316Z [2024-02-24 01:34:02,825: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:34:02.893855792Z [2024-02-24 01:34:02,893: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:34:02.920590467Z [2024-02-24 01:34:02,920: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:34:04.663782617Z [2024-02-24 01:34:04,663: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8667a1b8-62af-430f-b25f-a3cd6ac70fc5] succeeded in 4.226414847999877s: None
2024-02-24T01:34:05.110614472Z [2024-02-24 01:34:05,110: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[19914eb5-e71b-4a2e-ae23-8e8bf0cb7519] succeeded in 4.672654013999818s: None
2024-02-24T01:35:00.925037441Z [2024-02-24 01:35:00,924: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14db5997-8f8b-4fbf-b012-ea5221c91180] received
2024-02-24T01:35:00.930985864Z [2024-02-24 01:35:00,930: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b250a5e6-4bde-4c0a-8ed1-61cd7d889a6c] received
2024-02-24T01:35:00.931765809Z [2024-02-24 01:35:00,931: INFO/ForkPoolWorker-15] [14db5997-8f8b-4fbf-b012-ea5221c91180] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:35:00.939901126Z [2024-02-24 01:35:00,939: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa3d53cc-4e49-46bc-b1c2-e7b18597b528] received
2024-02-24T01:35:00.942786528Z [2024-02-24 01:35:00,942: INFO/ForkPoolWorker-16] [b250a5e6-4bde-4c0a-8ed1-61cd7d889a6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:35:00.943173027Z [2024-02-24 01:35:00,943: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c117266-9957-49a4-ab5e-86570a69a9c1] received
2024-02-24T01:35:00.952707883Z [2024-02-24 01:35:00,952: INFO/ForkPoolWorker-2] [3c117266-9957-49a4-ab5e-86570a69a9c1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:35:00.957452530Z [2024-02-24 01:35:00,957: INFO/ForkPoolWorker-1] [aa3d53cc-4e49-46bc-b1c2-e7b18597b528] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:35:01.259711369Z [2024-02-24 01:35:01,255: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:35:01.343600024Z [2024-02-24 01:35:01,335: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:35:01.350136581Z [2024-02-24 01:35:01,323: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:35:01.362019107Z [2024-02-24 01:35:01,353: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:35:01.631234195Z [2024-02-24 01:35:01,630: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:35:01.635773543Z [2024-02-24 01:35:01,635: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:01.675162582Z [2024-02-24 01:35:01,674: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:35:01.682867186Z [2024-02-24 01:35:01,682: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:35:01.683007864Z [2024-02-24 01:35:01,682: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:35:01.683097002Z [2024-02-24 01:35:01,683: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:35:01.683397186Z [2024-02-24 01:35:01,683: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:35:01.824501813Z [2024-02-24 01:35:01,824: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:02.524121104Z [2024-02-24 01:35:02,523: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b250a5e6-4bde-4c0a-8ed1-61cd7d889a6c] succeeded in 1.5909510459996454s: None
2024-02-24T01:35:02.904603814Z [2024-02-24 01:35:02,904: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:35:02.908239100Z [2024-02-24 01:35:02,907: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:02.912206117Z [2024-02-24 01:35:02,911: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:35:02.915738187Z [2024-02-24 01:35:02,915: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:02.933300635Z [2024-02-24 01:35:02,933: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:35:02.934662921Z [2024-02-24 01:35:02,934: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:02.934799251Z [2024-02-24 01:35:02,934: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:02.934994341Z [2024-02-24 01:35:02,934: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:02.935003019Z [2024-02-24 01:35:02,934: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:35:02.935259624Z [2024-02-24 01:35:02,935: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:35:02.935323253Z [2024-02-24 01:35:02,935: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:02.951878463Z [2024-02-24 01:35:02,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:35:02.953198137Z [2024-02-24 01:35:02,952: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:02.953356390Z [2024-02-24 01:35:02,953: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:02.953521081Z [2024-02-24 01:35:02,953: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:02.953587966Z [2024-02-24 01:35:02,953: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:35:02.953897493Z [2024-02-24 01:35:02,953: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:35:02.953986177Z [2024-02-24 01:35:02,953: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:03.074771046Z [2024-02-24 01:35:03,074: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:35:03.080752401Z [2024-02-24 01:35:03,080: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:03.082310446Z [2024-02-24 01:35:03,082: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:03.085496795Z [2024-02-24 01:35:03,085: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:03.109713600Z [2024-02-24 01:35:03,109: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:35:03.111505750Z [2024-02-24 01:35:03,111: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:03.112012942Z [2024-02-24 01:35:03,111: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:03.112478490Z [2024-02-24 01:35:03,112: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:03.112629768Z [2024-02-24 01:35:03,112: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:35:03.112929681Z [2024-02-24 01:35:03,112: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:35:03.113043551Z [2024-02-24 01:35:03,112: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:03.192227212Z [2024-02-24 01:35:03,191: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:04.027874051Z [2024-02-24 01:35:04,027: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14db5997-8f8b-4fbf-b012-ea5221c91180] succeeded in 3.10121414599962s: None
2024-02-24T01:35:04.142851564Z [2024-02-24 01:35:04,142: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[606abe6e-a752-43fe-a146-bc2b60f633f2] received
2024-02-24T01:35:04.155214477Z [2024-02-24 01:35:04,154: INFO/ForkPoolWorker-15] [606abe6e-a752-43fe-a146-bc2b60f633f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:35:04.436887896Z [2024-02-24 01:35:04,433: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:35:04.777430672Z [2024-02-24 01:35:04,777: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa3d53cc-4e49-46bc-b1c2-e7b18597b528] succeeded in 3.8293745979999585s: None
2024-02-24T01:35:05.115761902Z [2024-02-24 01:35:05,115: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c117266-9957-49a4-ab5e-86570a69a9c1] succeeded in 4.170033291999971s: None
2024-02-24T01:35:05.650011148Z [2024-02-24 01:35:05,649: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:35:05.653482155Z [2024-02-24 01:35:05,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:05.673388356Z [2024-02-24 01:35:05,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:35:05.674841352Z [2024-02-24 01:35:05,674: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:05.674896820Z [2024-02-24 01:35:05,674: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:05.675115040Z [2024-02-24 01:35:05,674: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:05.675222538Z [2024-02-24 01:35:05,675: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:35:05.675476793Z [2024-02-24 01:35:05,675: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:35:05.675551587Z [2024-02-24 01:35:05,675: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:05.750609999Z [2024-02-24 01:35:05,750: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:06.464686892Z [2024-02-24 01:35:06,464: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[606abe6e-a752-43fe-a146-bc2b60f633f2] succeeded in 2.3198211980006818s: None
2024-02-24T01:35:06.600288427Z [2024-02-24 01:35:06,599: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa913da0-540f-4cb5-9e71-515f03d9f359] received
2024-02-24T01:35:06.609612510Z [2024-02-24 01:35:06,609: INFO/ForkPoolWorker-15] [fa913da0-540f-4cb5-9e71-515f03d9f359] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:35:06.902369547Z [2024-02-24 01:35:06,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:35:07.996894702Z [2024-02-24 01:35:07,996: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:35:08.000335965Z [2024-02-24 01:35:07,999: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:08.024736058Z [2024-02-24 01:35:08,024: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:35:08.026018694Z [2024-02-24 01:35:08,025: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:08.026068663Z [2024-02-24 01:35:08,025: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:08.026209554Z [2024-02-24 01:35:08,026: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:08.026286652Z [2024-02-24 01:35:08,026: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:35:08.026623392Z [2024-02-24 01:35:08,026: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:35:08.029530575Z [2024-02-24 01:35:08,029: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:08.119429402Z [2024-02-24 01:35:08,118: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:08.671569030Z [2024-02-24 01:35:08,671: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be36607e-e32f-408f-b5b1-7fc59d155c72] received
2024-02-24T01:35:08.681991993Z [2024-02-24 01:35:08,681: INFO/ForkPoolWorker-16] [be36607e-e32f-408f-b5b1-7fc59d155c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:35:08.712051051Z [2024-02-24 01:35:08,711: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fa913da0-540f-4cb5-9e71-515f03d9f359] succeeded in 2.109593598000174s: None
2024-02-24T01:35:08.953362736Z [2024-02-24 01:35:08,950: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:35:10.087817674Z [2024-02-24 01:35:10,087: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:35:10.091261575Z [2024-02-24 01:35:10,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:35:10.114172613Z [2024-02-24 01:35:10,113: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:35:10.115594710Z [2024-02-24 01:35:10,115: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:35:10.115752739Z [2024-02-24 01:35:10,115: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:35:10.116065357Z [2024-02-24 01:35:10,115: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:35:10.116120145Z [2024-02-24 01:35:10,115: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:35:10.116455943Z [2024-02-24 01:35:10,116: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:35:10.116687628Z [2024-02-24 01:35:10,116: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:35:10.218271375Z [2024-02-24 01:35:10,217: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:35:10.899006461Z [2024-02-24 01:35:10,898: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[be36607e-e32f-408f-b5b1-7fc59d155c72] succeeded in 2.225591784000244s: None
2024-02-24T01:36:00.385746694Z [2024-02-24 01:36:00,384: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[378cf407-036a-4584-b9bf-9e53fa03c342] received
2024-02-24T01:36:00.387816332Z [2024-02-24 01:36:00,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0bf3b455-5e8f-4a38-a72d-e1eca6eb1f78] received
2024-02-24T01:36:00.390176556Z [2024-02-24 01:36:00,389: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e14bc8c-91e9-4cdd-a33d-15fccc9d22b3] received
2024-02-24T01:36:00.393569393Z [2024-02-24 01:36:00,393: INFO/ForkPoolWorker-15] [378cf407-036a-4584-b9bf-9e53fa03c342] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:36:00.393600198Z [2024-02-24 01:36:00,393: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30ed779b-86ff-4ded-8dd7-d805a32cd46e] received
2024-02-24T01:36:00.399266351Z [2024-02-24 01:36:00,398: INFO/ForkPoolWorker-16] [0bf3b455-5e8f-4a38-a72d-e1eca6eb1f78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:36:00.408262352Z [2024-02-24 01:36:00,407: INFO/ForkPoolWorker-1] [4e14bc8c-91e9-4cdd-a33d-15fccc9d22b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:36:00.409405797Z [2024-02-24 01:36:00,408: INFO/ForkPoolWorker-2] [30ed779b-86ff-4ded-8dd7-d805a32cd46e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:36:00.696870518Z [2024-02-24 01:36:00,693: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:36:00.770608040Z [2024-02-24 01:36:00,766: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:36:00.775010839Z [2024-02-24 01:36:00,771: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:36:00.902607578Z [2024-02-24 01:36:00,899: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:36:01.021939754Z [2024-02-24 01:36:01,021: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:36:01.033564736Z [2024-02-24 01:36:01,032: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:36:01.063764103Z [2024-02-24 01:36:01,063: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:36:01.065194503Z [2024-02-24 01:36:01,064: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:36:01.065301641Z [2024-02-24 01:36:01,065: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:36:01.065394505Z [2024-02-24 01:36:01,065: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:36:01.065640384Z [2024-02-24 01:36:01,065: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:36:01.152559052Z [2024-02-24 01:36:01,152: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:36:01.175583283Z [2024-02-24 01:36:01,175: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:36:01.917406628Z [2024-02-24 01:36:01,916: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[378cf407-036a-4584-b9bf-9e53fa03c342] succeeded in 1.530279848999271s: None
2024-02-24T01:36:01.952090917Z [2024-02-24 01:36:01,951: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4e14bc8c-91e9-4cdd-a33d-15fccc9d22b3] succeeded in 1.5602785370001584s: None
2024-02-24T01:36:01.960366331Z [2024-02-24 01:36:01,959: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:36:01.963834822Z [2024-02-24 01:36:01,963: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:36:01.986332516Z [2024-02-24 01:36:01,986: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:36:01.987683898Z [2024-02-24 01:36:01,987: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:36:01.987719560Z [2024-02-24 01:36:01,987: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:36:01.987866225Z [2024-02-24 01:36:01,987: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:36:01.987875794Z [2024-02-24 01:36:01,987: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:36:01.988158908Z [2024-02-24 01:36:01,988: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:36:01.988224806Z [2024-02-24 01:36:01,988: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:36:02.067526442Z [2024-02-24 01:36:02,066: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:36:02.071223584Z [2024-02-24 01:36:02,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:36:02.098620101Z [2024-02-24 01:36:02,098: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:36:02.100367834Z [2024-02-24 01:36:02,100: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:36:02.100807403Z [2024-02-24 01:36:02,100: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:36:02.101424201Z [2024-02-24 01:36:02,100: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:36:02.101631577Z [2024-02-24 01:36:02,101: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:36:02.102010800Z [2024-02-24 01:36:02,101: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:36:02.102171435Z [2024-02-24 01:36:02,101: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:36:02.104674447Z [2024-02-24 01:36:02,104: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:36:02.191869069Z [2024-02-24 01:36:02,191: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:36:03.726883918Z [2024-02-24 01:36:03,726: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[30ed779b-86ff-4ded-8dd7-d805a32cd46e] succeeded in 3.3315850930002853s: None
2024-02-24T01:36:04.123693582Z [2024-02-24 01:36:04,123: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0bf3b455-5e8f-4a38-a72d-e1eca6eb1f78] succeeded in 3.733274366999467s: None
2024-02-24T01:37:00.915175082Z [2024-02-24 01:37:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89f0d9bf-e796-455b-bcf1-b94a61fad5d4] received
2024-02-24T01:37:00.920559632Z [2024-02-24 01:37:00,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8e1bd54-a15b-46c5-88ad-33e1674926c5] received
2024-02-24T01:37:00.923407958Z [2024-02-24 01:37:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[66867d46-ff63-444d-aa24-640a02a0c3fc] received
2024-02-24T01:37:00.926519742Z [2024-02-24 01:37:00,925: INFO/ForkPoolWorker-15] [89f0d9bf-e796-455b-bcf1-b94a61fad5d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:37:00.936169665Z [2024-02-24 01:37:00,935: INFO/ForkPoolWorker-1] [66867d46-ff63-444d-aa24-640a02a0c3fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:37:00.936197792Z [2024-02-24 01:37:00,935: INFO/ForkPoolWorker-16] [b8e1bd54-a15b-46c5-88ad-33e1674926c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:37:01.238620743Z [2024-02-24 01:37:01,231: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:37:01.340913094Z [2024-02-24 01:37:01,336: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:37:01.404441085Z [2024-02-24 01:37:01,400: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:37:01.573032453Z [2024-02-24 01:37:01,572: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:37:01.579464909Z [2024-02-24 01:37:01,578: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:37:01.611211729Z [2024-02-24 01:37:01,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:37:01.613249597Z [2024-02-24 01:37:01,612: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:37:01.613627550Z [2024-02-24 01:37:01,613: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:37:01.613919048Z [2024-02-24 01:37:01,613: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:37:01.614401867Z [2024-02-24 01:37:01,614: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:37:01.740859634Z [2024-02-24 01:37:01,740: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:37:02.399697211Z [2024-02-24 01:37:02,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89f0d9bf-e796-455b-bcf1-b94a61fad5d4] succeeded in 1.4800392679999277s: None
2024-02-24T01:37:02.660493869Z [2024-02-24 01:37:02,660: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:37:02.664838870Z [2024-02-24 01:37:02,664: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:37:02.719630102Z [2024-02-24 01:37:02,716: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:37:02.722603394Z [2024-02-24 01:37:02,720: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:37:02.722621046Z [2024-02-24 01:37:02,720: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:37:02.722625547Z [2024-02-24 01:37:02,720: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:37:02.722629729Z [2024-02-24 01:37:02,720: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:37:02.722632902Z [2024-02-24 01:37:02,721: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:37:02.722636897Z [2024-02-24 01:37:02,721: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:37:02.789295027Z [2024-02-24 01:37:02,788: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:37:02.794245601Z [2024-02-24 01:37:02,793: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:37:02.829727724Z [2024-02-24 01:37:02,829: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:37:02.831736559Z [2024-02-24 01:37:02,831: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:37:02.831800526Z [2024-02-24 01:37:02,831: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:37:02.831860759Z [2024-02-24 01:37:02,831: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:37:02.831903132Z [2024-02-24 01:37:02,831: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:37:02.832231169Z [2024-02-24 01:37:02,832: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:37:02.832237424Z [2024-02-24 01:37:02,832: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:37:02.859730927Z [2024-02-24 01:37:02,859: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:37:02.950627115Z [2024-02-24 01:37:02,950: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:37:05.386597923Z [2024-02-24 01:37:05,386: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b8e1bd54-a15b-46c5-88ad-33e1674926c5] succeeded in 4.464115401000527s: None
2024-02-24T01:37:05.684684986Z [2024-02-24 01:37:05,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[66867d46-ff63-444d-aa24-640a02a0c3fc] succeeded in 4.757118853000065s: None
2024-02-24T01:38:00.310265798Z [2024-02-24 01:38:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04422095-ba2d-4c73-8e48-2854d321dae5] received
2024-02-24T01:38:00.315100039Z [2024-02-24 01:38:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c63a90b-c140-44d3-a887-46a371482c4c] received
2024-02-24T01:38:00.316901454Z [2024-02-24 01:38:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4f5dc21-6cdf-46c4-a0c9-349fd86cbfd2] received
2024-02-24T01:38:00.321402833Z [2024-02-24 01:38:00,321: INFO/ForkPoolWorker-15] [04422095-ba2d-4c73-8e48-2854d321dae5] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:38:00.327570438Z [2024-02-24 01:38:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e07fe510-ddd4-48ef-a40f-565ea914a682] received
2024-02-24T01:38:00.328993963Z [2024-02-24 01:38:00,328: INFO/ForkPoolWorker-16] [4c63a90b-c140-44d3-a887-46a371482c4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:38:00.333366095Z [2024-02-24 01:38:00,333: INFO/ForkPoolWorker-1] [b4f5dc21-6cdf-46c4-a0c9-349fd86cbfd2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:38:00.344697132Z [2024-02-24 01:38:00,344: INFO/ForkPoolWorker-2] [e07fe510-ddd4-48ef-a40f-565ea914a682] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:38:00.664962676Z [2024-02-24 01:38:00,661: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:38:00.672711034Z [2024-02-24 01:38:00,669: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:38:00.684085919Z [2024-02-24 01:38:00,680: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:38:00.741117972Z [2024-02-24 01:38:00,737: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:38:00.906724126Z [2024-02-24 01:38:00,906: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:38:00.912256501Z [2024-02-24 01:38:00,911: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:38:00.960911069Z [2024-02-24 01:38:00,960: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:38:00.968081506Z [2024-02-24 01:38:00,967: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:38:00.970140767Z [2024-02-24 01:38:00,967: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:38:00.970337465Z [2024-02-24 01:38:00,970: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:38:00.970692384Z [2024-02-24 01:38:00,970: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:38:00.999759673Z [2024-02-24 01:38:00,999: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:38:01.114093363Z [2024-02-24 01:38:01,113: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:38:01.813292213Z [2024-02-24 01:38:01,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04422095-ba2d-4c73-8e48-2854d321dae5] succeeded in 1.4968413919996237s: None
2024-02-24T01:38:01.902949102Z [2024-02-24 01:38:01,902: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4f5dc21-6cdf-46c4-a0c9-349fd86cbfd2] succeeded in 1.583969194999554s: None
2024-02-24T01:38:02.264152140Z [2024-02-24 01:38:02,263: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:38:02.267548210Z [2024-02-24 01:38:02,267: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:38:02.292838733Z [2024-02-24 01:38:02,292: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:38:02.296902647Z [2024-02-24 01:38:02,296: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:38:02.299896473Z [2024-02-24 01:38:02,299: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:38:02.301217668Z [2024-02-24 01:38:02,300: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:38:02.301300783Z [2024-02-24 01:38:02,301: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:38:02.301656573Z [2024-02-24 01:38:02,301: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:38:02.301714944Z [2024-02-24 01:38:02,301: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:38:02.302482566Z [2024-02-24 01:38:02,302: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:38:02.302571882Z [2024-02-24 01:38:02,302: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:38:02.343324687Z [2024-02-24 01:38:02,343: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:38:02.345150910Z [2024-02-24 01:38:02,344: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:38:02.345237190Z [2024-02-24 01:38:02,345: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:38:02.345450455Z [2024-02-24 01:38:02,345: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:38:02.345554080Z [2024-02-24 01:38:02,345: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:38:02.346068343Z [2024-02-24 01:38:02,345: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:38:02.346712030Z [2024-02-24 01:38:02,346: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:38:02.440127424Z [2024-02-24 01:38:02,439: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:38:02.472214844Z [2024-02-24 01:38:02,471: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:38:04.651538390Z [2024-02-24 01:38:04,650: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e07fe510-ddd4-48ef-a40f-565ea914a682] succeeded in 4.322135098999752s: None
2024-02-24T01:38:05.130443479Z [2024-02-24 01:38:05,129: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c63a90b-c140-44d3-a887-46a371482c4c] succeeded in 4.813662591999673s: None
2024-02-24T01:39:00.302132713Z [2024-02-24 01:39:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1f5f1a1-8d1b-4a6a-810d-b42ab7e17190] received
2024-02-24T01:39:00.304718551Z [2024-02-24 01:39:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[342f93ab-ced7-401b-bcd0-5a7cccfab018] received
2024-02-24T01:39:00.306798045Z [2024-02-24 01:39:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[79060368-8ee4-4d32-a0d2-6afabebed7df] received
2024-02-24T01:39:00.318323665Z [2024-02-24 01:39:00,317: INFO/ForkPoolWorker-16] [342f93ab-ced7-401b-bcd0-5a7cccfab018] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:39:00.318381488Z [2024-02-24 01:39:00,317: INFO/ForkPoolWorker-15] [a1f5f1a1-8d1b-4a6a-810d-b42ab7e17190] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:39:00.327426388Z [2024-02-24 01:39:00,327: INFO/ForkPoolWorker-1] [79060368-8ee4-4d32-a0d2-6afabebed7df] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:39:00.648375793Z [2024-02-24 01:39:00,644: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:39:00.655531043Z [2024-02-24 01:39:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:39:00.688209576Z [2024-02-24 01:39:00,685: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:39:00.869501073Z [2024-02-24 01:39:00,868: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:39:00.874964130Z [2024-02-24 01:39:00,874: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:39:00.903649905Z [2024-02-24 01:39:00,903: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:39:00.904709849Z [2024-02-24 01:39:00,904: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:39:00.904780750Z [2024-02-24 01:39:00,904: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:39:00.904847569Z [2024-02-24 01:39:00,904: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:39:00.905129236Z [2024-02-24 01:39:00,904: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:39:00.991019533Z [2024-02-24 01:39:00,990: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:39:01.687546249Z [2024-02-24 01:39:01,687: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[342f93ab-ced7-401b-bcd0-5a7cccfab018] succeeded in 1.3777653120014293s: None
2024-02-24T01:39:02.060414586Z [2024-02-24 01:39:02,059: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:39:02.063501926Z [2024-02-24 01:39:02,062: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:39:02.084870627Z [2024-02-24 01:39:02,084: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:39:02.086309420Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:39:02.086366331Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:39:02.086690687Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:39:02.086803668Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:39:02.086833631Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:39:02.087227289Z [2024-02-24 01:39:02,086: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:39:02.087394355Z [2024-02-24 01:39:02,087: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:39:02.091007883Z [2024-02-24 01:39:02,090: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:39:02.117557859Z [2024-02-24 01:39:02,117: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:39:02.119297684Z [2024-02-24 01:39:02,119: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:39:02.119462880Z [2024-02-24 01:39:02,119: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:39:02.119767390Z [2024-02-24 01:39:02,119: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:39:02.119888988Z [2024-02-24 01:39:02,119: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:39:02.120294208Z [2024-02-24 01:39:02,120: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:39:02.120459318Z [2024-02-24 01:39:02,120: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:39:02.180174143Z [2024-02-24 01:39:02,179: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:39:02.229372866Z [2024-02-24 01:39:02,229: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:39:03.871436061Z [2024-02-24 01:39:03,870: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a1f5f1a1-8d1b-4a6a-810d-b42ab7e17190] succeeded in 3.5667602739995345s: None
2024-02-24T01:39:04.557574077Z [2024-02-24 01:39:04,556: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[79060368-8ee4-4d32-a0d2-6afabebed7df] succeeded in 4.248660667999502s: None
2024-02-24T01:40:00.371765006Z [2024-02-24 01:40:00,371: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e21f1558-0bd2-4de6-9e5b-350c45054612] received
2024-02-24T01:40:00.374872759Z [2024-02-24 01:40:00,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebc9387d-3548-42cf-89ac-17a0a653e359] received
2024-02-24T01:40:00.376233457Z [2024-02-24 01:40:00,376: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4c498e-bdcd-4e99-bb6a-5cf4ddeedc6c] received
2024-02-24T01:40:00.377737436Z [2024-02-24 01:40:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25f12a4e-0648-4e19-8cb4-6618a5473d69] received
2024-02-24T01:40:00.379688104Z [2024-02-24 01:40:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80f7ee22-5b64-4a48-b808-8e9e85e807b8] received
2024-02-24T01:40:00.382007668Z [2024-02-24 01:40:00,381: INFO/ForkPoolWorker-16] [ebc9387d-3548-42cf-89ac-17a0a653e359] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:40:00.388105415Z [2024-02-24 01:40:00,387: INFO/ForkPoolWorker-2] [25f12a4e-0648-4e19-8cb4-6618a5473d69] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:40:00.388299084Z [2024-02-24 01:40:00,387: INFO/ForkPoolWorker-1] [aa4c498e-bdcd-4e99-bb6a-5cf4ddeedc6c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:40:00.388848789Z [2024-02-24 01:40:00,388: INFO/ForkPoolWorker-15] [e21f1558-0bd2-4de6-9e5b-350c45054612] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:40:00.398144669Z [2024-02-24 01:40:00,397: INFO/ForkPoolWorker-3] [80f7ee22-5b64-4a48-b808-8e9e85e807b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:40:00.703092965Z [2024-02-24 01:40:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:40:00.733351231Z [2024-02-24 01:40:00,728: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:40:00.755422976Z [2024-02-24 01:40:00,750: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:40:00.863904699Z [2024-02-24 01:40:00,860: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:40:00.906548547Z [2024-02-24 01:40:00,902: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:40:01.054629119Z [2024-02-24 01:40:01,054: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:40:01.069952063Z [2024-02-24 01:40:01,069: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:01.160257301Z [2024-02-24 01:40:01,160: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:40:01.162163538Z [2024-02-24 01:40:01,161: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:40:01.162216087Z [2024-02-24 01:40:01,162: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:40:01.162249133Z [2024-02-24 01:40:01,162: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:40:01.162436782Z [2024-02-24 01:40:01,162: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:40:01.210098879Z [2024-02-24 01:40:01,208: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:01.368118300Z [2024-02-24 01:40:01,367: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:02.059381239Z [2024-02-24 01:40:02,059: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[aa4c498e-bdcd-4e99-bb6a-5cf4ddeedc6c] succeeded in 1.681639112999619s: None
2024-02-24T01:40:02.062353728Z [2024-02-24 01:40:02,061: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[80f7ee22-5b64-4a48-b808-8e9e85e807b8] succeeded in 1.680231955000636s: None
2024-02-24T01:40:02.281311168Z [2024-02-24 01:40:02,280: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:40:02.284686079Z [2024-02-24 01:40:02,284: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:02.303569814Z [2024-02-24 01:40:02,303: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:40:02.305126776Z [2024-02-24 01:40:02,304: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:02.305293175Z [2024-02-24 01:40:02,305: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:02.305610811Z [2024-02-24 01:40:02,305: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:02.306109051Z [2024-02-24 01:40:02,305: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:40:02.306380419Z [2024-02-24 01:40:02,306: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:40:02.306885839Z [2024-02-24 01:40:02,306: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:02.416602248Z [2024-02-24 01:40:02,414: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:40:02.429980964Z [2024-02-24 01:40:02,420: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:02.459681561Z [2024-02-24 01:40:02,459: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:40:02.462752160Z [2024-02-24 01:40:02,462: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:02.462780591Z [2024-02-24 01:40:02,462: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:02.462802026Z [2024-02-24 01:40:02,462: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:02.462914351Z [2024-02-24 01:40:02,462: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:40:02.463473890Z [2024-02-24 01:40:02,463: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:40:02.463772310Z [2024-02-24 01:40:02,463: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:02.466604936Z [2024-02-24 01:40:02,466: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:02.528308584Z [2024-02-24 01:40:02,527: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:40:02.531712976Z [2024-02-24 01:40:02,531: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:02.560994833Z [2024-02-24 01:40:02,560: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:40:02.566012003Z [2024-02-24 01:40:02,565: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:02.566033306Z [2024-02-24 01:40:02,565: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:02.566131238Z [2024-02-24 01:40:02,565: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:02.566140543Z [2024-02-24 01:40:02,566: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:40:02.566441831Z [2024-02-24 01:40:02,566: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:40:02.566579501Z [2024-02-24 01:40:02,566: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:02.574379521Z [2024-02-24 01:40:02,565: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:02.712784218Z [2024-02-24 01:40:02,712: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:03.174008000Z [2024-02-24 01:40:03,173: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25f12a4e-0648-4e19-8cb4-6618a5473d69] succeeded in 2.794629760001044s: None
2024-02-24T01:40:03.199428323Z [2024-02-24 01:40:03,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c79f2459-d682-43f1-b873-23d0da109978] received
2024-02-24T01:40:03.209216259Z [2024-02-24 01:40:03,208: INFO/ForkPoolWorker-1] [c79f2459-d682-43f1-b873-23d0da109978] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:40:03.486334224Z [2024-02-24 01:40:03,482: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:40:04.618593972Z [2024-02-24 01:40:04,618: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:40:04.621556490Z [2024-02-24 01:40:04,621: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:04.642773396Z [2024-02-24 01:40:04,642: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:40:04.644095595Z [2024-02-24 01:40:04,643: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:04.644114082Z [2024-02-24 01:40:04,643: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:04.644250389Z [2024-02-24 01:40:04,644: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:04.644264051Z [2024-02-24 01:40:04,644: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:40:04.644635644Z [2024-02-24 01:40:04,644: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:40:04.644674467Z [2024-02-24 01:40:04,644: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:04.732176819Z [2024-02-24 01:40:04,731: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:04.869712325Z [2024-02-24 01:40:04,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e21f1558-0bd2-4de6-9e5b-350c45054612] succeeded in 4.495205524000994s: None
2024-02-24T01:40:04.989568009Z [2024-02-24 01:40:04,988: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ebc9387d-3548-42cf-89ac-17a0a653e359] succeeded in 4.61244063400045s: None
2024-02-24T01:40:05.459915628Z [2024-02-24 01:40:05,459: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c79f2459-d682-43f1-b873-23d0da109978] succeeded in 2.2580574599996908s: None
2024-02-24T01:40:05.636071728Z [2024-02-24 01:40:05,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b52be92-f8ad-4035-a75e-d02f9642a223] received
2024-02-24T01:40:05.643920712Z [2024-02-24 01:40:05,643: INFO/ForkPoolWorker-15] [0b52be92-f8ad-4035-a75e-d02f9642a223] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:40:05.927932667Z [2024-02-24 01:40:05,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:40:07.023516593Z [2024-02-24 01:40:07,023: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:40:07.027213536Z [2024-02-24 01:40:07,026: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:07.047200343Z [2024-02-24 01:40:07,046: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:40:07.048496535Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:07.048516861Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:07.048583238Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:07.048606678Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:40:07.048691683Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:40:07.048775907Z [2024-02-24 01:40:07,048: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:07.138135372Z [2024-02-24 01:40:07,137: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:07.692062820Z [2024-02-24 01:40:07,691: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b52be92-f8ad-4035-a75e-d02f9642a223] succeeded in 2.0540665780008567s: None
2024-02-24T01:40:08.249757673Z [2024-02-24 01:40:08,249: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[57ce934d-7a16-4efb-8203-d3d1d08c0273] received
2024-02-24T01:40:08.258463029Z [2024-02-24 01:40:08,257: INFO/ForkPoolWorker-15] [57ce934d-7a16-4efb-8203-d3d1d08c0273] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:40:08.518602304Z [2024-02-24 01:40:08,515: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:40:09.604024261Z [2024-02-24 01:40:09,603: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:40:09.607491739Z [2024-02-24 01:40:09,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:40:09.628666001Z [2024-02-24 01:40:09,628: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:40:09.630656866Z [2024-02-24 01:40:09,630: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:40:09.630832000Z [2024-02-24 01:40:09,630: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:40:09.631038825Z [2024-02-24 01:40:09,630: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:40:09.631107245Z [2024-02-24 01:40:09,631: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:40:09.631605333Z [2024-02-24 01:40:09,631: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:40:09.631675546Z [2024-02-24 01:40:09,631: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:40:09.724381728Z [2024-02-24 01:40:09,724: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:40:10.313647157Z [2024-02-24 01:40:10,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[57ce934d-7a16-4efb-8203-d3d1d08c0273] succeeded in 2.061956191999343s: None
2024-02-24T01:41:01.313192966Z [2024-02-24 01:41:01,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54b5fb44-2119-41d8-a977-d21dfba62bac] received
2024-02-24T01:41:01.320114036Z [2024-02-24 01:41:01,319: INFO/ForkPoolWorker-15] [54b5fb44-2119-41d8-a977-d21dfba62bac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:41:01.322358532Z [2024-02-24 01:41:01,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4acde3ad-d7ae-401c-8a20-c4fb4dce4bca] received
2024-02-24T01:41:01.327710346Z [2024-02-24 01:41:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bca83be3-21d3-42ec-b65f-b9995d586387] received
2024-02-24T01:41:01.339516242Z [2024-02-24 01:41:01,339: INFO/ForkPoolWorker-16] [4acde3ad-d7ae-401c-8a20-c4fb4dce4bca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:41:01.342576563Z [2024-02-24 01:41:01,342: INFO/ForkPoolWorker-1] [bca83be3-21d3-42ec-b65f-b9995d586387] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:41:01.621087251Z [2024-02-24 01:41:01,617: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:41:01.622052099Z [2024-02-24 01:41:01,618: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:41:01.697324363Z [2024-02-24 01:41:01,694: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:41:01.788508109Z [2024-02-24 01:41:01,787: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:41:01.792586493Z [2024-02-24 01:41:01,792: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:41:01.822295269Z [2024-02-24 01:41:01,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:41:01.824647678Z [2024-02-24 01:41:01,823: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:41:01.824803835Z [2024-02-24 01:41:01,824: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:41:01.824882749Z [2024-02-24 01:41:01,824: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:41:01.825107001Z [2024-02-24 01:41:01,824: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:41:01.950131776Z [2024-02-24 01:41:01,949: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:41:02.741852436Z [2024-02-24 01:41:02,739: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bca83be3-21d3-42ec-b65f-b9995d586387] succeeded in 1.410536850000426s: None
2024-02-24T01:41:02.945503996Z [2024-02-24 01:41:02,945: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:41:02.949012911Z [2024-02-24 01:41:02,948: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:41:02.978830169Z [2024-02-24 01:41:02,978: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:41:02.980637388Z [2024-02-24 01:41:02,980: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:41:02.980844326Z [2024-02-24 01:41:02,980: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:41:02.981122175Z [2024-02-24 01:41:02,980: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:41:02.981338626Z [2024-02-24 01:41:02,981: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:41:02.981765084Z [2024-02-24 01:41:02,981: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:41:02.982034141Z [2024-02-24 01:41:02,981: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:41:03.084386606Z [2024-02-24 01:41:03,081: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:41:03.128232059Z [2024-02-24 01:41:03,127: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:41:03.131787493Z [2024-02-24 01:41:03,131: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:41:03.152275691Z [2024-02-24 01:41:03,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:41:03.153551923Z [2024-02-24 01:41:03,153: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:41:03.153573091Z [2024-02-24 01:41:03,153: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:41:03.153683620Z [2024-02-24 01:41:03,153: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:41:03.153713729Z [2024-02-24 01:41:03,153: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:41:03.154326816Z [2024-02-24 01:41:03,154: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:41:03.154339711Z [2024-02-24 01:41:03,154: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:41:03.239528146Z [2024-02-24 01:41:03,239: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:41:05.221737406Z [2024-02-24 01:41:05,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54b5fb44-2119-41d8-a977-d21dfba62bac] succeeded in 3.907050926000011s: None
2024-02-24T01:41:06.035757201Z [2024-02-24 01:41:06,034: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4acde3ad-d7ae-401c-8a20-c4fb4dce4bca] succeeded in 4.7046263609991s: None
2024-02-24T01:42:01.270503448Z [2024-02-24 01:42:01,263: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0f04a4c-c97d-4025-bc41-f0a096cf4002] received
2024-02-24T01:42:01.287658915Z [2024-02-24 01:42:01,278: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25e1d1f0-ee2d-49c5-86c7-41da5724e2cc] received
2024-02-24T01:42:01.294704014Z [2024-02-24 01:42:01,291: INFO/ForkPoolWorker-15] [e0f04a4c-c97d-4025-bc41-f0a096cf4002] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:42:01.298161324Z [2024-02-24 01:42:01,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cf787226-692e-43c5-ae7c-b6df9cdaa04f] received
2024-02-24T01:42:01.306403287Z [2024-02-24 01:42:01,305: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1ff6b890-2c99-450f-8d7d-d69e524c1e19] received
2024-02-24T01:42:01.317158258Z [2024-02-24 01:42:01,316: INFO/ForkPoolWorker-16] [25e1d1f0-ee2d-49c5-86c7-41da5724e2cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:42:01.321851347Z [2024-02-24 01:42:01,318: INFO/ForkPoolWorker-1] [cf787226-692e-43c5-ae7c-b6df9cdaa04f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:42:01.329903590Z [2024-02-24 01:42:01,327: INFO/ForkPoolWorker-2] [1ff6b890-2c99-450f-8d7d-d69e524c1e19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:42:01.716721260Z [2024-02-24 01:42:01,711: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:42:01.717580698Z [2024-02-24 01:42:01,714: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:42:01.746671319Z [2024-02-24 01:42:01,742: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:42:01.805242872Z [2024-02-24 01:42:01,799: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:42:01.936372249Z [2024-02-24 01:42:01,935: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:42:01.940840790Z [2024-02-24 01:42:01,940: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:42:01.972231612Z [2024-02-24 01:42:01,971: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:42:01.974233832Z [2024-02-24 01:42:01,973: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:42:01.974472025Z [2024-02-24 01:42:01,974: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:42:01.974641953Z [2024-02-24 01:42:01,974: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:42:01.974970547Z [2024-02-24 01:42:01,974: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:42:02.088547698Z [2024-02-24 01:42:02,088: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:42:02.182390085Z [2024-02-24 01:42:02,182: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:42:02.883066992Z [2024-02-24 01:42:02,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[25e1d1f0-ee2d-49c5-86c7-41da5724e2cc] succeeded in 1.5989896430000954s: None
2024-02-24T01:42:02.884029462Z [2024-02-24 01:42:02,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0f04a4c-c97d-4025-bc41-f0a096cf4002] succeeded in 1.6115178870004456s: None
2024-02-24T01:42:03.344801919Z [2024-02-24 01:42:03,344: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:42:03.348251608Z [2024-02-24 01:42:03,347: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:42:03.359725060Z [2024-02-24 01:42:03,359: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:42:03.363689503Z [2024-02-24 01:42:03,363: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:42:03.367270916Z [2024-02-24 01:42:03,367: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:42:03.368421037Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:42:03.368435914Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:42:03.368633327Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:42:03.368660387Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:42:03.368959321Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:42:03.369052604Z [2024-02-24 01:42:03,368: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:42:03.385923296Z [2024-02-24 01:42:03,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:42:03.387220663Z [2024-02-24 01:42:03,386: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:42:03.387427604Z [2024-02-24 01:42:03,387: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:42:03.387451130Z [2024-02-24 01:42:03,387: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:42:03.387465125Z [2024-02-24 01:42:03,387: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:42:03.387855427Z [2024-02-24 01:42:03,387: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:42:03.387916440Z [2024-02-24 01:42:03,387: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:42:03.496877922Z [2024-02-24 01:42:03,496: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:42:03.498959832Z [2024-02-24 01:42:03,498: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:42:05.390774715Z [2024-02-24 01:42:05,390: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cf787226-692e-43c5-ae7c-b6df9cdaa04f] succeeded in 4.0908338940007525s: None
2024-02-24T01:42:06.469838774Z [2024-02-24 01:42:06,468: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1ff6b890-2c99-450f-8d7d-d69e524c1e19] succeeded in 5.160029036000196s: None
2024-02-24T01:43:01.275970928Z [2024-02-24 01:43:01,267: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ddfc5d6-182d-4174-91aa-3d7babe09e52] received
2024-02-24T01:43:01.275995925Z [2024-02-24 01:43:01,270: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cc3c76-140b-4544-9bd6-0392b6bad403] received
2024-02-24T01:43:01.289998446Z [2024-02-24 01:43:01,289: INFO/ForkPoolWorker-15] [9ddfc5d6-182d-4174-91aa-3d7babe09e52] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:43:01.293302868Z [2024-02-24 01:43:01,293: INFO/ForkPoolWorker-16] [c3cc3c76-140b-4544-9bd6-0392b6bad403] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:43:01.309912781Z [2024-02-24 01:43:01,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ca938698-4d7d-4db3-8669-6500eb3f1a7f] received
2024-02-24T01:43:01.323423188Z [2024-02-24 01:43:01,323: INFO/ForkPoolWorker-1] [ca938698-4d7d-4db3-8669-6500eb3f1a7f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:43:01.709896702Z [2024-02-24 01:43:01,697: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:43:01.732282313Z [2024-02-24 01:43:01,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:43:01.808241178Z [2024-02-24 01:43:01,804: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:43:01.895972344Z [2024-02-24 01:43:01,895: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:43:01.900090528Z [2024-02-24 01:43:01,899: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:43:01.920817612Z [2024-02-24 01:43:01,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:43:01.922032514Z [2024-02-24 01:43:01,921: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:43:01.922136564Z [2024-02-24 01:43:01,921: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:43:01.922237596Z [2024-02-24 01:43:01,922: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:43:01.922503474Z [2024-02-24 01:43:01,922: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:43:02.049179178Z [2024-02-24 01:43:02,048: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:43:02.728091701Z [2024-02-24 01:43:02,727: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ddfc5d6-182d-4174-91aa-3d7babe09e52] succeeded in 1.4566990170005738s: None
2024-02-24T01:43:03.088240854Z [2024-02-24 01:43:03,087: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:43:03.096121276Z [2024-02-24 01:43:03,095: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:43:03.128509222Z [2024-02-24 01:43:03,128: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:43:03.129766247Z [2024-02-24 01:43:03,129: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:43:03.129917453Z [2024-02-24 01:43:03,129: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:43:03.130317560Z [2024-02-24 01:43:03,129: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:43:03.130375425Z [2024-02-24 01:43:03,130: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:43:03.130631627Z [2024-02-24 01:43:03,130: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:43:03.131013093Z [2024-02-24 01:43:03,130: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:43:03.164308783Z [2024-02-24 01:43:03,163: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:43:03.168275804Z [2024-02-24 01:43:03,167: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:43:03.196906151Z [2024-02-24 01:43:03,196: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:43:03.198319661Z [2024-02-24 01:43:03,198: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:43:03.198561844Z [2024-02-24 01:43:03,198: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:43:03.198786876Z [2024-02-24 01:43:03,198: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:43:03.199581814Z [2024-02-24 01:43:03,199: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:43:03.199897548Z [2024-02-24 01:43:03,199: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:43:03.199951436Z [2024-02-24 01:43:03,199: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:43:03.217092107Z [2024-02-24 01:43:03,216: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:43:03.298028976Z [2024-02-24 01:43:03,297: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:43:05.494571849Z [2024-02-24 01:43:05,494: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ca938698-4d7d-4db3-8669-6500eb3f1a7f] succeeded in 4.182165297999745s: None
2024-02-24T01:43:06.774692931Z [2024-02-24 01:43:06,774: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c3cc3c76-140b-4544-9bd6-0392b6bad403] succeeded in 5.497773884000708s: None
2024-02-24T01:44:00.398112535Z [2024-02-24 01:44:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f38bebcd-aa6d-44bb-a30c-c19e11f71401] received
2024-02-24T01:44:00.405252867Z [2024-02-24 01:44:00,404: INFO/ForkPoolWorker-15] [f38bebcd-aa6d-44bb-a30c-c19e11f71401] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:44:00.406286715Z [2024-02-24 01:44:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c1e18fff-156c-42e3-ac16-226fe19c04a1] received
2024-02-24T01:44:00.408437609Z [2024-02-24 01:44:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d6a79d4d-2059-466b-9f10-e192e37a6fee] received
2024-02-24T01:44:00.410284983Z [2024-02-24 01:44:00,410: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0016367-86b2-443e-b8d4-fa07975e9f9b] received
2024-02-24T01:44:00.421215464Z [2024-02-24 01:44:00,420: INFO/ForkPoolWorker-1] [d6a79d4d-2059-466b-9f10-e192e37a6fee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:44:00.424685229Z [2024-02-24 01:44:00,424: INFO/ForkPoolWorker-16] [c1e18fff-156c-42e3-ac16-226fe19c04a1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:44:00.431397994Z [2024-02-24 01:44:00,431: INFO/ForkPoolWorker-2] [c0016367-86b2-443e-b8d4-fa07975e9f9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:44:00.696376314Z [2024-02-24 01:44:00,693: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:44:00.774524401Z [2024-02-24 01:44:00,770: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:44:00.849546707Z [2024-02-24 01:44:00,844: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:44:00.943643545Z [2024-02-24 01:44:00,943: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:44:00.949449982Z [2024-02-24 01:44:00,946: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:44:01.119566601Z [2024-02-24 01:44:01,119: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:44:01.123658785Z [2024-02-24 01:44:01,123: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:44:01.183211924Z [2024-02-24 01:44:01,182: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:44:01.185214741Z [2024-02-24 01:44:01,184: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:44:01.185289672Z [2024-02-24 01:44:01,185: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:44:01.185297920Z [2024-02-24 01:44:01,185: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:44:01.185493233Z [2024-02-24 01:44:01,185: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:44:01.353312936Z [2024-02-24 01:44:01,352: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:44:01.619627850Z [2024-02-24 01:44:01,619: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f38bebcd-aa6d-44bb-a30c-c19e11f71401] succeeded in 1.2200413639984617s: None
2024-02-24T01:44:01.956581831Z [2024-02-24 01:44:01,956: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c1e18fff-156c-42e3-ac16-226fe19c04a1] succeeded in 1.5487302590008767s: None
2024-02-24T01:44:02.131796980Z [2024-02-24 01:44:02,131: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:44:02.135003525Z [2024-02-24 01:44:02,134: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:44:02.159466754Z [2024-02-24 01:44:02,159: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:44:02.161063998Z [2024-02-24 01:44:02,160: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:44:02.161119861Z [2024-02-24 01:44:02,160: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:44:02.161159022Z [2024-02-24 01:44:02,160: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:44:02.161222711Z [2024-02-24 01:44:02,161: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:44:02.161538426Z [2024-02-24 01:44:02,161: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:44:02.161586485Z [2024-02-24 01:44:02,161: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:44:02.163284839Z [2024-02-24 01:44:02,162: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:44:02.166822395Z [2024-02-24 01:44:02,166: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:44:02.186842815Z [2024-02-24 01:44:02,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:44:02.188204668Z [2024-02-24 01:44:02,187: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:44:02.188424794Z [2024-02-24 01:44:02,188: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:44:02.188680006Z [2024-02-24 01:44:02,188: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:44:02.188860218Z [2024-02-24 01:44:02,188: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:44:02.189206717Z [2024-02-24 01:44:02,189: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:44:02.189403753Z [2024-02-24 01:44:02,189: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:44:02.269187913Z [2024-02-24 01:44:02,268: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:44:02.278273432Z [2024-02-24 01:44:02,277: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:44:03.916106496Z [2024-02-24 01:44:03,913: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d6a79d4d-2059-466b-9f10-e192e37a6fee] succeeded in 3.504137673000514s: None
2024-02-24T01:44:04.913365457Z [2024-02-24 01:44:04,912: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c0016367-86b2-443e-b8d4-fa07975e9f9b] succeeded in 4.5010056480005005s: None
2024-02-24T01:44:50.132965201Z [2024-02-24 01:44:50,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da40bf00-fc70-4f41-b7b2-98201b20e92e] received
2024-02-24T01:44:50.142367378Z [2024-02-24 01:44:50,142: INFO/ForkPoolWorker-15] [da40bf00-fc70-4f41-b7b2-98201b20e92e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:44:50.417285158Z [2024-02-24 01:44:50,404: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:44:50.618276725Z [2024-02-24 01:44:50,617: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:44:50.622811561Z [2024-02-24 01:44:50,622: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:44:50.673878993Z [2024-02-24 01:44:50,673: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:44:50.675595133Z [2024-02-24 01:44:50,675: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:44:50.675637833Z [2024-02-24 01:44:50,675: INFO/ForkPoolWorker-15] Read SDNC 86b61849-0d0f-4d22-aa41-c35c0e51fb6a (epa_03)
2024-02-24T01:44:50.675774546Z [2024-02-24 01:44:50,675: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-02-24T01:44:50.675858501Z [2024-02-24 01:44:50,675: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:44:50.676192974Z [2024-02-24 01:44:50,676: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:44:50.683380269Z [2024-02-24 01:44:50,683: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a
2024-02-24T01:44:50.760017098Z [2024-02-24 01:44:50,759: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:44:51.420676100Z [2024-02-24 01:44:51,419: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da40bf00-fc70-4f41-b7b2-98201b20e92e] succeeded in 1.2829052329998376s: None
2024-02-24T01:45:00.539894586Z [2024-02-24 01:45:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a01b7746-0415-4e8e-b527-63d0b8fc53fe] received
2024-02-24T01:45:00.542178881Z [2024-02-24 01:45:00,541: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26b16a53-95a7-4da0-9a5c-e1b8f357125b] received
2024-02-24T01:45:00.549117983Z [2024-02-24 01:45:00,548: INFO/ForkPoolWorker-15] [a01b7746-0415-4e8e-b527-63d0b8fc53fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:45:00.549800830Z [2024-02-24 01:45:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9daba11-4c34-4694-bc77-86b9ced25507] received
2024-02-24T01:45:00.550745956Z [2024-02-24 01:45:00,550: INFO/ForkPoolWorker-16] [26b16a53-95a7-4da0-9a5c-e1b8f357125b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:45:00.558459205Z [2024-02-24 01:45:00,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[896bb107-465a-4e1e-929e-cd9efab2f62f] received
2024-02-24T01:45:00.564013385Z [2024-02-24 01:45:00,563: INFO/ForkPoolWorker-2] [896bb107-465a-4e1e-929e-cd9efab2f62f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:45:00.564738639Z [2024-02-24 01:45:00,564: INFO/ForkPoolWorker-1] [b9daba11-4c34-4694-bc77-86b9ced25507] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:45:00.572683475Z [2024-02-24 01:45:00,572: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[29abf659-7eef-4ec2-9ee8-8053ab227416] received
2024-02-24T01:45:00.590699730Z [2024-02-24 01:45:00,590: INFO/ForkPoolWorker-3] [29abf659-7eef-4ec2-9ee8-8053ab227416] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:45:00.899023096Z [2024-02-24 01:45:00,895: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:45:00.926487335Z [2024-02-24 01:45:00,923: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:45:01.001226562Z [2024-02-24 01:45:00,997: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:45:01.214028111Z [2024-02-24 01:45:01,204: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:45:01.403112096Z [2024-02-24 01:45:01,391: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:45:01.412008831Z [2024-02-24 01:45:01,411: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T01:45:01.416004584Z [2024-02-24 01:45:01,415: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:01.459759659Z [2024-02-24 01:45:01,459: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:45:01.462242253Z [2024-02-24 01:45:01,461: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:45:01.462271217Z [2024-02-24 01:45:01,462: INFO/ForkPoolWorker-3] Read SDNC 86b61849-0d0f-4d22-aa41-c35c0e51fb6a (epa_03)
2024-02-24T01:45:01.462858931Z [2024-02-24 01:45:01,462: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-02-24T01:45:01.462931749Z [2024-02-24 01:45:01,462: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T01:45:01.463177531Z [2024-02-24 01:45:01,463: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:45:01.470647082Z [2024-02-24 01:45:01,470: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a
2024-02-24T01:45:01.585684603Z [2024-02-24 01:45:01,584: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:45:01.589972066Z [2024-02-24 01:45:01,589: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:01.590628503Z [2024-02-24 01:45:01,590: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:01.620810769Z [2024-02-24 01:45:01,620: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:45:01.629424669Z [2024-02-24 01:45:01,629: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:45:01.635453131Z [2024-02-24 01:45:01,635: INFO/ForkPoolWorker-2] Read SDNC 86b61849-0d0f-4d22-aa41-c35c0e51fb6a (epa_03)
2024-02-24T01:45:01.636174424Z [2024-02-24 01:45:01,635: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}, {'_id': '86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'name': 'epa_03', 'type': 'onos_vpls'}]
2024-02-24T01:45:01.636512599Z [2024-02-24 01:45:01,636: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:45:01.636901580Z [2024-02-24 01:45:01,636: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:45:01.648907925Z [2024-02-24 01:45:01,648: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a
2024-02-24T01:45:01.786233795Z [2024-02-24 01:45:01,785: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:02.515229039Z [2024-02-24 01:45:02,514: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[29abf659-7eef-4ec2-9ee8-8053ab227416] succeeded in 1.9372332299990376s: None
2024-02-24T01:45:02.583233783Z [2024-02-24 01:45:02,582: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[896bb107-465a-4e1e-929e-cd9efab2f62f] succeeded in 2.0233326100005797s: None
2024-02-24T01:45:02.604599151Z [2024-02-24 01:45:02,604: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:45:02.608187755Z [2024-02-24 01:45:02,607: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:02.639518196Z [2024-02-24 01:45:02,639: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:45:02.640667922Z [2024-02-24 01:45:02,640: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:02.640685712Z [2024-02-24 01:45:02,640: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:02.640812365Z [2024-02-24 01:45:02,640: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:02.640852617Z [2024-02-24 01:45:02,640: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:45:02.641248865Z [2024-02-24 01:45:02,640: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:45:02.641277609Z [2024-02-24 01:45:02,641: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:02.817732953Z [2024-02-24 01:45:02,817: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:45:02.821537769Z [2024-02-24 01:45:02,821: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:02.828905765Z [2024-02-24 01:45:02,828: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:02.847365700Z [2024-02-24 01:45:02,847: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:45:02.848721083Z [2024-02-24 01:45:02,848: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:02.848739338Z [2024-02-24 01:45:02,848: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:02.848869414Z [2024-02-24 01:45:02,848: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:02.848903503Z [2024-02-24 01:45:02,848: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:45:02.849188504Z [2024-02-24 01:45:02,849: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:45:02.849195526Z [2024-02-24 01:45:02,849: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:02.933274039Z [2024-02-24 01:45:02,933: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:03.085949547Z [2024-02-24 01:45:03,085: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:45:03.089525304Z [2024-02-24 01:45:03,089: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:03.120097805Z [2024-02-24 01:45:03,119: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:45:03.126159461Z [2024-02-24 01:45:03,125: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:03.126358333Z [2024-02-24 01:45:03,126: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:03.126648483Z [2024-02-24 01:45:03,126: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:03.126835822Z [2024-02-24 01:45:03,126: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:45:03.127270949Z [2024-02-24 01:45:03,127: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:45:03.127393030Z [2024-02-24 01:45:03,127: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:03.225264458Z [2024-02-24 01:45:03,224: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:03.561995376Z [2024-02-24 01:45:03,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9daba11-4c34-4694-bc77-86b9ced25507] succeeded in 3.008528098998795s: None
2024-02-24T01:45:03.721490442Z [2024-02-24 01:45:03,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a392d9a-dcee-418f-887e-a5070aa3d808] received
2024-02-24T01:45:03.739852331Z [2024-02-24 01:45:03,738: INFO/ForkPoolWorker-1] [4a392d9a-dcee-418f-887e-a5070aa3d808] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:45:04.057943807Z [2024-02-24 01:45:04,054: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:45:04.512052417Z [2024-02-24 01:45:04,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a01b7746-0415-4e8e-b527-63d0b8fc53fe] succeeded in 3.968870243999845s: None
2024-02-24T01:45:04.750140918Z [2024-02-24 01:45:04,749: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[26b16a53-95a7-4da0-9a5c-e1b8f357125b] succeeded in 4.205639066000003s: None
2024-02-24T01:45:05.246305992Z [2024-02-24 01:45:05,245: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:45:05.249892695Z [2024-02-24 01:45:05,249: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:05.278124642Z [2024-02-24 01:45:05,277: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:45:05.280053431Z [2024-02-24 01:45:05,279: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:05.280328432Z [2024-02-24 01:45:05,279: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:05.280689577Z [2024-02-24 01:45:05,280: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:05.280824833Z [2024-02-24 01:45:05,280: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:45:05.281223192Z [2024-02-24 01:45:05,281: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:45:05.281506473Z [2024-02-24 01:45:05,281: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:05.378272830Z [2024-02-24 01:45:05,377: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:06.127087198Z [2024-02-24 01:45:06,126: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a392d9a-dcee-418f-887e-a5070aa3d808] succeeded in 2.404275389000759s: None
2024-02-24T01:45:06.802307978Z [2024-02-24 01:45:06,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d81c8824-bda8-4840-8941-1044ad8cb81e] received
2024-02-24T01:45:06.811896449Z [2024-02-24 01:45:06,811: INFO/ForkPoolWorker-15] [d81c8824-bda8-4840-8941-1044ad8cb81e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:45:07.097100894Z [2024-02-24 01:45:07,093: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:45:08.213228353Z [2024-02-24 01:45:08,212: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:45:08.217227510Z [2024-02-24 01:45:08,216: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:08.239644980Z [2024-02-24 01:45:08,239: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:45:08.241146208Z [2024-02-24 01:45:08,240: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:08.241164674Z [2024-02-24 01:45:08,241: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:08.241290993Z [2024-02-24 01:45:08,241: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:08.241307584Z [2024-02-24 01:45:08,241: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:45:08.241904891Z [2024-02-24 01:45:08,241: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:45:08.241925773Z [2024-02-24 01:45:08,241: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:08.339927306Z [2024-02-24 01:45:08,339: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:08.878850322Z [2024-02-24 01:45:08,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d81c8824-bda8-4840-8941-1044ad8cb81e] succeeded in 2.0738441299999977s: None
2024-02-24T01:45:09.767166594Z [2024-02-24 01:45:09,766: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86bb99ca-32c4-4c0e-be4c-97dded35e99e] received
2024-02-24T01:45:09.775824865Z [2024-02-24 01:45:09,775: INFO/ForkPoolWorker-15] [86bb99ca-32c4-4c0e-be4c-97dded35e99e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:45:10.043403359Z [2024-02-24 01:45:10,040: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:45:11.118096832Z [2024-02-24 01:45:11,117: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:45:11.121518185Z [2024-02-24 01:45:11,121: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:45:11.145492384Z [2024-02-24 01:45:11,145: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:45:11.147914226Z [2024-02-24 01:45:11,147: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:45:11.147932913Z [2024-02-24 01:45:11,147: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:45:11.148004710Z [2024-02-24 01:45:11,147: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:45:11.148046851Z [2024-02-24 01:45:11,147: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:45:11.148399582Z [2024-02-24 01:45:11,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:45:11.148445941Z [2024-02-24 01:45:11,148: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:45:11.246883467Z [2024-02-24 01:45:11,246: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:45:11.795195468Z [2024-02-24 01:45:11,794: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[86bb99ca-32c4-4c0e-be4c-97dded35e99e] succeeded in 2.0246335609990638s: None
2024-02-24T01:46:00.588391133Z [2024-02-24 01:46:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38da50a4-9ea5-46d3-8a90-a3ab540ac887] received
2024-02-24T01:46:00.592228765Z [2024-02-24 01:46:00,592: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e7a69c4-6361-4039-9a32-e99a5a3ace16] received
2024-02-24T01:46:00.599991070Z [2024-02-24 01:46:00,599: INFO/ForkPoolWorker-16] [9e7a69c4-6361-4039-9a32-e99a5a3ace16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:46:00.600218731Z [2024-02-24 01:46:00,600: INFO/ForkPoolWorker-15] [38da50a4-9ea5-46d3-8a90-a3ab540ac887] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:46:00.600579100Z [2024-02-24 01:46:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[431505df-88b5-4a26-b6fa-bdf03b0da3b7] received
2024-02-24T01:46:00.605119281Z [2024-02-24 01:46:00,604: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8c506c7-a7a4-40d2-b7d9-cd2722501ee9] received
2024-02-24T01:46:00.608223042Z [2024-02-24 01:46:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be1b456a-6631-4bbd-8c1a-c55d0cb6bdf4] received
2024-02-24T01:46:00.610206200Z [2024-02-24 01:46:00,609: INFO/ForkPoolWorker-1] [431505df-88b5-4a26-b6fa-bdf03b0da3b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:46:00.610388059Z [2024-02-24 01:46:00,610: INFO/ForkPoolWorker-2] [c8c506c7-a7a4-40d2-b7d9-cd2722501ee9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:46:00.621441009Z [2024-02-24 01:46:00,621: INFO/ForkPoolWorker-3] [be1b456a-6631-4bbd-8c1a-c55d0cb6bdf4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:46:01.035680924Z [2024-02-24 01:46:01,030: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:01.041222811Z [2024-02-24 01:46:01,038: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:01.087074571Z [2024-02-24 01:46:01,079: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:46:01.152056256Z [2024-02-24 01:46:01,135: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:46:01.205838517Z [2024-02-24 01:46:01,205: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:46:01.211491119Z [2024-02-24 01:46:01,209: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:01.253878096Z [2024-02-24 01:46:01,251: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:46:01.261854398Z [2024-02-24 01:46:01,260: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:01.308605841Z [2024-02-24 01:46:01,308: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:46:01.309510354Z [2024-02-24 01:46:01,309: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:46:01.309558132Z [2024-02-24 01:46:01,309: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:46:01.309616083Z [2024-02-24 01:46:01,309: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:46:01.309867041Z [2024-02-24 01:46:01,309: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:46:01.321146650Z [2024-02-24 01:46:01,320: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:46:01.322657344Z [2024-02-24 01:46:01,322: WARNING/ForkPoolWorker-1] Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:01.326632399Z [2024-02-24 01:46:01,326: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:01.326793861Z [2024-02-24 01:46:01,326: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:46:01.326992383Z [2024-02-24 01:46:01,326: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:46:01.327113446Z [2024-02-24 01:46:01,326: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:46:01.327429403Z [2024-02-24 01:46:01,327: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:46:01.329082472Z [2024-02-24 01:46:01,328: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:46:01.342798970Z [2024-02-24 01:46:01,342: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:01.391237916Z [2024-02-24 01:46:01,387: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:46:01.399016904Z [2024-02-24 01:46:01,398: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:46:01.403008126Z [2024-02-24 01:46:01,402: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:46:01.403307740Z [2024-02-24 01:46:01,402: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:46:01.403470668Z [2024-02-24 01:46:01,403: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:46:01.403910926Z [2024-02-24 01:46:01,403: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:46:01.410278863Z [2024-02-24 01:46:01,409: ERROR/ForkPoolWorker-1] [431505df-88b5-4a26-b6fa-bdf03b0da3b7] Failed to execute task Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' could not be found; either it does not exist or it failed to parse..
2024-02-24T01:46:01.410303968Z Traceback (most recent call last):
2024-02-24T01:46:01.410308550Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T01:46:01.410313324Z     args.func(args)
2024-02-24T01:46:01.410317188Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T01:46:01.410320913Z     return func(*args, **kwargs)
2024-02-24T01:46:01.410323926Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T01:46:01.410327469Z     return f(*args, **kwargs)
2024-02-24T01:46:01.410330599Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T01:46:01.410333676Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T01:46:01.410336756Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T01:46:01.410344166Z     raise AirflowException(
2024-02-24T01:46:01.410348167Z airflow.exceptions.AirflowException: Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' could not be found; either it does not exist or it failed to parse.
2024-02-24T01:46:01.474007545Z [2024-02-24 01:46:01,473: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:46:01.474125862Z [2024-02-24 01:46:01,470: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[431505df-88b5-4a26-b6fa-bdf03b0da3b7] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 431505df-88b5-4a26-b6fa-bdf03b0da3b7')
2024-02-24T01:46:01.474133710Z Traceback (most recent call last):
2024-02-24T01:46:01.474138040Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T01:46:01.474141364Z     R = retval = fun(*args, **kwargs)
2024-02-24T01:46:01.474144555Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T01:46:01.474147757Z     return self.run(*args, **kwargs)
2024-02-24T01:46:01.474151475Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T01:46:01.474155192Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T01:46:01.474158296Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T01:46:01.474174529Z     raise AirflowException(msg)
2024-02-24T01:46:01.474179406Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 431505df-88b5-4a26-b6fa-bdf03b0da3b7
2024-02-24T01:46:01.646609289Z [2024-02-24 01:46:01,646: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:46:02.085217144Z [2024-02-24 01:46:02,084: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c8c506c7-a7a4-40d2-b7d9-cd2722501ee9] succeeded in 1.478616525999314s: None
2024-02-24T01:46:02.288363109Z [2024-02-24 01:46:02,287: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38da50a4-9ea5-46d3-8a90-a3ab540ac887] succeeded in 1.694895523998639s: None
2024-02-24T01:46:02.606327105Z [2024-02-24 01:46:02,605: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:46:02.610145474Z [2024-02-24 01:46:02,609: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:02.640476151Z [2024-02-24 01:46:02,640: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:46:02.642000081Z [2024-02-24 01:46:02,641: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:46:02.643849468Z [2024-02-24 01:46:02,641: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:46:02.643863886Z [2024-02-24 01:46:02,642: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:46:02.643868592Z [2024-02-24 01:46:02,642: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:46:02.643871913Z [2024-02-24 01:46:02,642: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:46:02.643875656Z [2024-02-24 01:46:02,642: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:46:02.747910208Z [2024-02-24 01:46:02,747: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:46:02.865948115Z [2024-02-24 01:46:02,865: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T01:46:02.871870795Z [2024-02-24 01:46:02,871: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:02.893497718Z [2024-02-24 01:46:02,893: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:46:02.895433669Z [2024-02-24 01:46:02,895: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:46:02.895449483Z [2024-02-24 01:46:02,895: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:46:02.895849931Z [2024-02-24 01:46:02,895: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:46:02.895861848Z [2024-02-24 01:46:02,895: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T01:46:02.896337945Z [2024-02-24 01:46:02,896: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:46:02.896928715Z [2024-02-24 01:46:02,896: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:46:02.983430123Z [2024-02-24 01:46:02,983: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:46:04.556066376Z [2024-02-24 01:46:04,555: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[be1b456a-6631-4bbd-8c1a-c55d0cb6bdf4] succeeded in 3.9443732670006284s: None
2024-02-24T01:46:04.639031649Z [2024-02-24 01:46:04,638: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9e7a69c4-6361-4039-9a32-e99a5a3ace16] succeeded in 4.0450707799991505s: None
2024-02-24T01:46:12.965726676Z [2024-02-24 01:46:12,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f6d39a6-1125-408c-9a28-83946678e40d] received
2024-02-24T01:46:12.972516421Z [2024-02-24 01:46:12,972: INFO/ForkPoolWorker-15] [1f6d39a6-1125-408c-9a28-83946678e40d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:46:13.243458892Z [2024-02-24 01:46:13,240: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:13.391548016Z [2024-02-24 01:46:13,390: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:46:13.396241837Z [2024-02-24 01:46:13,395: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:13.416470345Z [2024-02-24 01:46:13,416: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:46:13.418159394Z [2024-02-24 01:46:13,417: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:46:13.418403068Z [2024-02-24 01:46:13,418: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:46:13.418585349Z [2024-02-24 01:46:13,418: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:46:13.418901071Z [2024-02-24 01:46:13,418: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:46:13.434595411Z [2024-02-24 01:46:13,434: WARNING/ForkPoolWorker-15] Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:13.434952418Z [2024-02-24 01:46:13,434: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:46:13.435870907Z [2024-02-24 01:46:13,435: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:46:13.439263746Z [2024-02-24 01:46:13,438: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:46:13.452718908Z [2024-02-24 01:46:13,452: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:46:13.453572206Z [2024-02-24 01:46:13,453: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:46:13.453637549Z [2024-02-24 01:46:13,453: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:46:13.453722648Z [2024-02-24 01:46:13,453: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:46:13.454006480Z [2024-02-24 01:46:13,453: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:46:13.457249861Z [2024-02-24 01:46:13,456: ERROR/ForkPoolWorker-15] [1f6d39a6-1125-408c-9a28-83946678e40d] Failed to execute task Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' could not be found; either it does not exist or it failed to parse..
2024-02-24T01:46:13.457280215Z Traceback (most recent call last):
2024-02-24T01:46:13.457290511Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T01:46:13.457299614Z     args.func(args)
2024-02-24T01:46:13.457309219Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T01:46:13.457318649Z     return func(*args, **kwargs)
2024-02-24T01:46:13.457327513Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T01:46:13.457335873Z     return f(*args, **kwargs)
2024-02-24T01:46:13.457344201Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T01:46:13.457352952Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T01:46:13.457361410Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T01:46:13.457369840Z     raise AirflowException(
2024-02-24T01:46:13.457379408Z airflow.exceptions.AirflowException: Dag 'sdnc_status_86b61849-0d0f-4d22-aa41-c35c0e51fb6a' could not be found; either it does not exist or it failed to parse.
2024-02-24T01:46:13.481398690Z [2024-02-24 01:46:13,480: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1f6d39a6-1125-408c-9a28-83946678e40d] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f6d39a6-1125-408c-9a28-83946678e40d')
2024-02-24T01:46:13.481417863Z Traceback (most recent call last):
2024-02-24T01:46:13.481421995Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T01:46:13.481425549Z     R = retval = fun(*args, **kwargs)
2024-02-24T01:46:13.481428667Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T01:46:13.481431895Z     return self.run(*args, **kwargs)
2024-02-24T01:46:13.481435796Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T01:46:13.481439427Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T01:46:13.481442795Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T01:46:13.481446227Z     raise AirflowException(msg)
2024-02-24T01:46:13.481450100Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 1f6d39a6-1125-408c-9a28-83946678e40d
2024-02-24T01:47:00.425342900Z [2024-02-24 01:47:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f30ac8fe-0eb4-40f6-b0c1-bc08b24aa8bb] received
2024-02-24T01:47:00.430912585Z [2024-02-24 01:47:00,430: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0800fbbf-539b-4b37-91c6-a49bb79c9e87] received
2024-02-24T01:47:00.436223993Z [2024-02-24 01:47:00,435: INFO/ForkPoolWorker-15] [f30ac8fe-0eb4-40f6-b0c1-bc08b24aa8bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:47:00.441278691Z [2024-02-24 01:47:00,441: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8576e771-687b-44b0-8d7b-9358879312ed] received
2024-02-24T01:47:00.456647079Z [2024-02-24 01:47:00,456: INFO/ForkPoolWorker-1] [8576e771-687b-44b0-8d7b-9358879312ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:47:00.458374683Z [2024-02-24 01:47:00,458: INFO/ForkPoolWorker-16] [0800fbbf-539b-4b37-91c6-a49bb79c9e87] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:47:00.768993356Z [2024-02-24 01:47:00,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:47:00.806910189Z [2024-02-24 01:47:00,802: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:47:00.835735128Z [2024-02-24 01:47:00,832: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:47:00.965236066Z [2024-02-24 01:47:00,964: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:47:00.969574874Z [2024-02-24 01:47:00,969: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:47:00.992764190Z [2024-02-24 01:47:00,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:47:00.994298126Z [2024-02-24 01:47:00,994: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:47:00.994491410Z [2024-02-24 01:47:00,994: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:47:00.994643182Z [2024-02-24 01:47:00,994: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:47:00.994941848Z [2024-02-24 01:47:00,994: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:47:01.117384058Z [2024-02-24 01:47:01,117: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:47:01.710730860Z [2024-02-24 01:47:01,710: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0800fbbf-539b-4b37-91c6-a49bb79c9e87] succeeded in 1.2759313240003394s: None
2024-02-24T01:47:02.035735781Z [2024-02-24 01:47:02,035: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:47:02.039096153Z [2024-02-24 01:47:02,038: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:47:02.055242606Z [2024-02-24 01:47:02,055: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:47:02.056417309Z [2024-02-24 01:47:02,056: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:47:02.056547400Z [2024-02-24 01:47:02,056: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:47:02.056723384Z [2024-02-24 01:47:02,056: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:47:02.056865072Z [2024-02-24 01:47:02,056: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:47:02.057153728Z [2024-02-24 01:47:02,057: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:47:02.057285979Z [2024-02-24 01:47:02,057: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:47:02.130024816Z [2024-02-24 01:47:02,129: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:47:02.171592809Z [2024-02-24 01:47:02,171: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:47:02.175684184Z [2024-02-24 01:47:02,175: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:47:02.196173306Z [2024-02-24 01:47:02,195: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:47:02.197809510Z [2024-02-24 01:47:02,197: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:47:02.197943959Z [2024-02-24 01:47:02,197: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:47:02.198169564Z [2024-02-24 01:47:02,197: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:47:02.198260580Z [2024-02-24 01:47:02,198: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:47:02.198577346Z [2024-02-24 01:47:02,198: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:47:02.198704711Z [2024-02-24 01:47:02,198: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:47:02.315251872Z [2024-02-24 01:47:02,314: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:47:04.051930755Z [2024-02-24 01:47:04,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f30ac8fe-0eb4-40f6-b0c1-bc08b24aa8bb] succeeded in 3.624306687999706s: None
2024-02-24T01:47:04.082816724Z [2024-02-24 01:47:04,082: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8576e771-687b-44b0-8d7b-9358879312ed] succeeded in 3.638741366999966s: None
2024-02-24T01:48:00.312771322Z [2024-02-24 01:48:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e897e34b-1ef9-4f35-b897-6bb22485916d] received
2024-02-24T01:48:00.314718415Z [2024-02-24 01:48:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e5c7365-4a26-4a6e-b592-324424173534] received
2024-02-24T01:48:00.316893859Z [2024-02-24 01:48:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12bc69f8-a842-4003-94d5-b4bb9620410e] received
2024-02-24T01:48:00.324039355Z [2024-02-24 01:48:00,323: INFO/ForkPoolWorker-15] [e897e34b-1ef9-4f35-b897-6bb22485916d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:48:00.325590283Z [2024-02-24 01:48:00,325: INFO/ForkPoolWorker-1] [12bc69f8-a842-4003-94d5-b4bb9620410e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:48:00.330977463Z [2024-02-24 01:48:00,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95ca52d0-2477-4080-9884-6fa9224252cd] received
2024-02-24T01:48:00.338633217Z [2024-02-24 01:48:00,338: INFO/ForkPoolWorker-16] [7e5c7365-4a26-4a6e-b592-324424173534] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:48:00.341483997Z [2024-02-24 01:48:00,340: INFO/ForkPoolWorker-2] [95ca52d0-2477-4080-9884-6fa9224252cd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:48:00.649140444Z [2024-02-24 01:48:00,645: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:48:00.656401847Z [2024-02-24 01:48:00,653: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:48:00.666555407Z [2024-02-24 01:48:00,663: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:48:00.704809834Z [2024-02-24 01:48:00,700: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:48:00.888607435Z [2024-02-24 01:48:00,887: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:48:00.896018520Z [2024-02-24 01:48:00,895: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:48:00.926967633Z [2024-02-24 01:48:00,926: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:48:00.927805572Z [2024-02-24 01:48:00,927: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:48:00.927841626Z [2024-02-24 01:48:00,927: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:48:00.927912388Z [2024-02-24 01:48:00,927: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:48:00.928060910Z [2024-02-24 01:48:00,927: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:48:00.957031028Z [2024-02-24 01:48:00,956: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:48:01.030666538Z [2024-02-24 01:48:01,030: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:48:01.630980875Z [2024-02-24 01:48:01,630: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e897e34b-1ef9-4f35-b897-6bb22485916d] succeeded in 1.3149022460002016s: None
2024-02-24T01:48:01.633555360Z [2024-02-24 01:48:01,633: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[12bc69f8-a842-4003-94d5-b4bb9620410e] succeeded in 1.315047322999817s: None
2024-02-24T01:48:01.962699101Z [2024-02-24 01:48:01,962: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:48:01.966193412Z [2024-02-24 01:48:01,965: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:48:01.992660776Z [2024-02-24 01:48:01,992: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:48:01.993865352Z [2024-02-24 01:48:01,993: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:48:01.993879967Z [2024-02-24 01:48:01,993: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:48:01.993993331Z [2024-02-24 01:48:01,993: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:48:01.994003457Z [2024-02-24 01:48:01,993: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:48:01.994233894Z [2024-02-24 01:48:01,994: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:48:01.994378396Z [2024-02-24 01:48:01,994: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:48:02.088202180Z [2024-02-24 01:48:02,087: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:48:02.174542043Z [2024-02-24 01:48:02,174: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:48:02.177710868Z [2024-02-24 01:48:02,177: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:48:02.208212469Z [2024-02-24 01:48:02,208: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:48:02.209314033Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:48:02.209345683Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:48:02.209419702Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:48:02.209451116Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:48:02.209683760Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:48:02.209687521Z [2024-02-24 01:48:02,209: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:48:02.299001627Z [2024-02-24 01:48:02,298: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:48:04.086514016Z [2024-02-24 01:48:04,086: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[95ca52d0-2477-4080-9884-6fa9224252cd] succeeded in 3.7521316620004654s: None
2024-02-24T01:48:04.106533065Z [2024-02-24 01:48:04,106: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7e5c7365-4a26-4a6e-b592-324424173534] succeeded in 3.7875286220005364s: None
2024-02-24T01:49:01.022572327Z [2024-02-24 01:49:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17635b28-bd9d-4743-893e-b42e277f1fbe] received
2024-02-24T01:49:01.030292647Z [2024-02-24 01:49:01,029: INFO/ForkPoolWorker-15] [17635b28-bd9d-4743-893e-b42e277f1fbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:49:01.046716212Z [2024-02-24 01:49:01,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df3cdc14-701a-4024-aa4b-8ee9ddecfc32] received
2024-02-24T01:49:01.054654811Z [2024-02-24 01:49:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[963229e5-2671-4361-8f23-385a9e50bb56] received
2024-02-24T01:49:01.065319443Z [2024-02-24 01:49:01,064: INFO/ForkPoolWorker-16] [df3cdc14-701a-4024-aa4b-8ee9ddecfc32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:49:01.067777206Z [2024-02-24 01:49:01,067: INFO/ForkPoolWorker-1] [963229e5-2671-4361-8f23-385a9e50bb56] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:49:01.479867547Z [2024-02-24 01:49:01,475: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:49:01.527832402Z [2024-02-24 01:49:01,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:49:01.550984535Z [2024-02-24 01:49:01,547: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:49:01.638984796Z [2024-02-24 01:49:01,638: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:49:01.643518006Z [2024-02-24 01:49:01,643: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:49:01.690716667Z [2024-02-24 01:49:01,690: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:49:01.692721688Z [2024-02-24 01:49:01,692: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:49:01.693055126Z [2024-02-24 01:49:01,692: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:49:01.693284433Z [2024-02-24 01:49:01,693: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:49:01.693608983Z [2024-02-24 01:49:01,693: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:49:01.794983198Z [2024-02-24 01:49:01,792: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:49:02.387500625Z [2024-02-24 01:49:02,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[963229e5-2671-4361-8f23-385a9e50bb56] succeeded in 1.3307139569988067s: None
2024-02-24T01:49:02.859759949Z [2024-02-24 01:49:02,859: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:49:02.864028305Z [2024-02-24 01:49:02,863: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:49:02.890863244Z [2024-02-24 01:49:02,890: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:49:02.892357112Z [2024-02-24 01:49:02,892: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:49:02.892414326Z [2024-02-24 01:49:02,892: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:49:02.892642776Z [2024-02-24 01:49:02,892: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:49:02.892800764Z [2024-02-24 01:49:02,892: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:49:02.893262115Z [2024-02-24 01:49:02,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:49:02.893335357Z [2024-02-24 01:49:02,893: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:49:02.930404135Z [2024-02-24 01:49:02,929: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:49:02.933676895Z [2024-02-24 01:49:02,933: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:49:02.962714434Z [2024-02-24 01:49:02,962: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:49:02.964645365Z [2024-02-24 01:49:02,964: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:49:02.964742242Z [2024-02-24 01:49:02,964: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:49:02.964911024Z [2024-02-24 01:49:02,964: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:49:02.964999034Z [2024-02-24 01:49:02,964: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:49:02.965301799Z [2024-02-24 01:49:02,965: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:49:02.965414010Z [2024-02-24 01:49:02,965: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:49:02.982440435Z [2024-02-24 01:49:02,982: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:49:03.049348554Z [2024-02-24 01:49:03,049: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:49:04.622273146Z [2024-02-24 01:49:04,621: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df3cdc14-701a-4024-aa4b-8ee9ddecfc32] succeeded in 3.5709667039991473s: None
2024-02-24T01:49:05.742731894Z [2024-02-24 01:49:05,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[17635b28-bd9d-4743-893e-b42e277f1fbe] succeeded in 4.717816014999698s: None
2024-02-24T01:50:01.042190561Z [2024-02-24 01:50:01,041: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ac7d709-7314-440c-a404-efce6262c471] received
2024-02-24T01:50:01.051570715Z [2024-02-24 01:50:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc2073a6-8e82-47e3-baf7-48348afb8a57] received
2024-02-24T01:50:01.053993182Z [2024-02-24 01:50:01,053: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b29c7d5d-c0b7-415a-aa6e-81148e592fb0] received
2024-02-24T01:50:01.056933805Z [2024-02-24 01:50:01,056: INFO/ForkPoolWorker-15] [0ac7d709-7314-440c-a404-efce6262c471] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:50:01.062661458Z [2024-02-24 01:50:01,062: INFO/ForkPoolWorker-1] [b29c7d5d-c0b7-415a-aa6e-81148e592fb0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:50:01.064585987Z [2024-02-24 01:50:01,064: INFO/ForkPoolWorker-16] [dc2073a6-8e82-47e3-baf7-48348afb8a57] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:50:01.068140134Z [2024-02-24 01:50:01,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ac0ada3-5086-4a4a-bf83-f3247b1ccb21] received
2024-02-24T01:50:01.078000530Z [2024-02-24 01:50:01,077: INFO/ForkPoolWorker-2] [9ac0ada3-5086-4a4a-bf83-f3247b1ccb21] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:50:01.103884011Z [2024-02-24 01:50:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[743baeb4-f68c-4226-aa7a-498b98645ec9] received
2024-02-24T01:50:01.132737160Z [2024-02-24 01:50:01,132: INFO/ForkPoolWorker-3] [743baeb4-f68c-4226-aa7a-498b98645ec9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:50:01.452759750Z [2024-02-24 01:50:01,449: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:50:01.561365535Z [2024-02-24 01:50:01,558: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:50:01.730567992Z [2024-02-24 01:50:01,727: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:50:01.781227199Z [2024-02-24 01:50:01,770: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:50:01.873532585Z [2024-02-24 01:50:01,870: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:50:02.013862467Z [2024-02-24 01:50:02,013: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:02.048748126Z [2024-02-24 01:50:02,048: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T01:50:02.054556773Z [2024-02-24 01:50:02,054: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:02.093625853Z [2024-02-24 01:50:02,093: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T01:50:02.095786929Z [2024-02-24 01:50:02,095: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:50:02.096101952Z [2024-02-24 01:50:02,095: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:50:02.096247927Z [2024-02-24 01:50:02,096: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T01:50:02.096676338Z [2024-02-24 01:50:02,096: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:50:02.359578859Z [2024-02-24 01:50:02,359: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:02.883812802Z [2024-02-24 01:50:02,883: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9ac0ada3-5086-4a4a-bf83-f3247b1ccb21] succeeded in 1.813555685999745s: None
2024-02-24T01:50:03.383611790Z [2024-02-24 01:50:03,383: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[743baeb4-f68c-4226-aa7a-498b98645ec9] succeeded in 2.277568285999223s: None
2024-02-24T01:50:03.681903422Z [2024-02-24 01:50:03,680: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:50:03.685275132Z [2024-02-24 01:50:03,684: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:03.723015569Z [2024-02-24 01:50:03,722: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:50:03.727260694Z [2024-02-24 01:50:03,726: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:03.727282444Z [2024-02-24 01:50:03,727: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:03.727360294Z [2024-02-24 01:50:03,727: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:03.727399339Z [2024-02-24 01:50:03,727: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:50:03.727623719Z [2024-02-24 01:50:03,727: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:50:03.727663838Z [2024-02-24 01:50:03,727: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:03.820315606Z [2024-02-24 01:50:03,817: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:50:03.821463668Z [2024-02-24 01:50:03,820: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:03.823269416Z [2024-02-24 01:50:03,822: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:50:03.830438867Z [2024-02-24 01:50:03,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:03.850987208Z [2024-02-24 01:50:03,850: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:50:03.855414992Z [2024-02-24 01:50:03,855: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:03.855558853Z [2024-02-24 01:50:03,855: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:03.855763434Z [2024-02-24 01:50:03,855: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:03.856091184Z [2024-02-24 01:50:03,855: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:03.856917428Z [2024-02-24 01:50:03,856: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:50:03.857918457Z [2024-02-24 01:50:03,857: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:50:03.858411881Z [2024-02-24 01:50:03,858: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:03.861131182Z [2024-02-24 01:50:03,860: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:50:03.863648242Z [2024-02-24 01:50:03,863: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:03.863726966Z [2024-02-24 01:50:03,863: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:03.863735080Z [2024-02-24 01:50:03,863: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:03.863739478Z [2024-02-24 01:50:03,863: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:50:03.864077055Z [2024-02-24 01:50:03,863: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:50:03.864211342Z [2024-02-24 01:50:03,864: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:04.001195105Z [2024-02-24 01:50:04,000: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:04.024677245Z [2024-02-24 01:50:04,024: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:04.735583048Z [2024-02-24 01:50:04,735: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc2073a6-8e82-47e3-baf7-48348afb8a57] succeeded in 3.679156812000656s: None
2024-02-24T01:50:05.285508407Z [2024-02-24 01:50:05,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[513b54a7-2c8c-447e-b3ee-0e3cfe243999] received
2024-02-24T01:50:05.294476877Z [2024-02-24 01:50:05,294: INFO/ForkPoolWorker-16] [513b54a7-2c8c-447e-b3ee-0e3cfe243999] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:50:05.381249919Z [2024-02-24 01:50:05,380: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b29c7d5d-c0b7-415a-aa6e-81148e592fb0] succeeded in 4.324580210000931s: None
2024-02-24T01:50:05.586305458Z [2024-02-24 01:50:05,583: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:50:05.895665861Z [2024-02-24 01:50:05,895: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0ac7d709-7314-440c-a404-efce6262c471] succeeded in 4.846268975999919s: None
2024-02-24T01:50:06.842819894Z [2024-02-24 01:50:06,842: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:50:06.846298284Z [2024-02-24 01:50:06,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:06.869610551Z [2024-02-24 01:50:06,869: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:50:06.871031353Z [2024-02-24 01:50:06,870: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:06.871066357Z [2024-02-24 01:50:06,870: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:06.871210157Z [2024-02-24 01:50:06,871: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:06.871246582Z [2024-02-24 01:50:06,871: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:50:06.871549481Z [2024-02-24 01:50:06,871: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:50:06.871583725Z [2024-02-24 01:50:06,871: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:06.956164585Z [2024-02-24 01:50:06,955: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:07.643216173Z [2024-02-24 01:50:07,642: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[513b54a7-2c8c-447e-b3ee-0e3cfe243999] succeeded in 2.3545830410002964s: None
2024-02-24T01:50:07.774640316Z [2024-02-24 01:50:07,774: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2be22b0-3097-4822-bc01-d8c22bdaf34f] received
2024-02-24T01:50:07.783262614Z [2024-02-24 01:50:07,782: INFO/ForkPoolWorker-15] [c2be22b0-3097-4822-bc01-d8c22bdaf34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:50:08.082166237Z [2024-02-24 01:50:08,078: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:50:09.190673509Z [2024-02-24 01:50:09,190: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:50:09.194010221Z [2024-02-24 01:50:09,193: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:09.222226750Z [2024-02-24 01:50:09,221: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:50:09.224045642Z [2024-02-24 01:50:09,223: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:09.224223466Z [2024-02-24 01:50:09,224: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:09.224560965Z [2024-02-24 01:50:09,224: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:09.224671990Z [2024-02-24 01:50:09,224: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:50:09.225063626Z [2024-02-24 01:50:09,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:50:09.225228451Z [2024-02-24 01:50:09,225: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:09.325261169Z [2024-02-24 01:50:09,324: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:09.930420767Z [2024-02-24 01:50:09,929: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c2be22b0-3097-4822-bc01-d8c22bdaf34f] succeeded in 2.153759501001332s: None
2024-02-24T01:50:10.314788244Z [2024-02-24 01:50:10,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b70bb5a4-df73-4544-bedf-b524149f58a3] received
2024-02-24T01:50:10.332496085Z [2024-02-24 01:50:10,332: INFO/ForkPoolWorker-15] [b70bb5a4-df73-4544-bedf-b524149f58a3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:50:10.623945446Z [2024-02-24 01:50:10,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:50:11.721831691Z [2024-02-24 01:50:11,721: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:50:11.725384523Z [2024-02-24 01:50:11,724: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:50:11.749288824Z [2024-02-24 01:50:11,749: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:50:11.750910182Z [2024-02-24 01:50:11,750: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:50:11.750953261Z [2024-02-24 01:50:11,750: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:50:11.751059296Z [2024-02-24 01:50:11,750: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:50:11.751105266Z [2024-02-24 01:50:11,751: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:50:11.751449066Z [2024-02-24 01:50:11,751: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:50:11.751522957Z [2024-02-24 01:50:11,751: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:50:11.843459937Z [2024-02-24 01:50:11,843: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:50:12.527692131Z [2024-02-24 01:50:12,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b70bb5a4-df73-4544-bedf-b524149f58a3] succeeded in 2.207237691998671s: None
2024-02-24T01:51:01.223595214Z [2024-02-24 01:51:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[800a4a3b-80b4-4bf8-bf42-f10822e9c1b9] received
2024-02-24T01:51:01.223628574Z [2024-02-24 01:51:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4967e070-c6ac-4d27-9d3f-1630714a2c91] received
2024-02-24T01:51:01.228078877Z [2024-02-24 01:51:01,227: INFO/ForkPoolWorker-15] [800a4a3b-80b4-4bf8-bf42-f10822e9c1b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:51:01.236455959Z [2024-02-24 01:51:01,230: INFO/ForkPoolWorker-16] [4967e070-c6ac-4d27-9d3f-1630714a2c91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:51:01.241747585Z [2024-02-24 01:51:01,240: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[10a92056-e73c-429e-8878-e33f8647bff2] received
2024-02-24T01:51:01.269410441Z [2024-02-24 01:51:01,269: INFO/ForkPoolWorker-1] [10a92056-e73c-429e-8878-e33f8647bff2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:51:01.558464440Z [2024-02-24 01:51:01,555: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:51:01.583807409Z [2024-02-24 01:51:01,580: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:51:01.614072656Z [2024-02-24 01:51:01,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:51:01.777463401Z [2024-02-24 01:51:01,777: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:51:01.782161500Z [2024-02-24 01:51:01,781: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:51:01.810943592Z [2024-02-24 01:51:01,810: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:51:01.812260899Z [2024-02-24 01:51:01,812: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:51:01.812455659Z [2024-02-24 01:51:01,812: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:51:01.812753761Z [2024-02-24 01:51:01,812: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:51:01.813091524Z [2024-02-24 01:51:01,812: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:51:01.911328326Z [2024-02-24 01:51:01,911: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:51:02.551405907Z [2024-02-24 01:51:02,550: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[10a92056-e73c-429e-8878-e33f8647bff2] succeeded in 1.2908327029999782s: None
2024-02-24T01:51:02.873329960Z [2024-02-24 01:51:02,872: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:51:02.878294597Z [2024-02-24 01:51:02,877: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:51:02.879659132Z [2024-02-24 01:51:02,878: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:51:02.881701352Z [2024-02-24 01:51:02,881: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:51:02.906638885Z [2024-02-24 01:51:02,906: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:51:02.908579321Z [2024-02-24 01:51:02,908: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:51:02.908610818Z [2024-02-24 01:51:02,908: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:51:02.908736226Z [2024-02-24 01:51:02,908: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:51:02.908751944Z [2024-02-24 01:51:02,908: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:51:02.909149435Z [2024-02-24 01:51:02,908: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:51:02.909168552Z [2024-02-24 01:51:02,909: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:51:02.921276491Z [2024-02-24 01:51:02,920: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:51:02.923708347Z [2024-02-24 01:51:02,923: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:51:02.924143553Z [2024-02-24 01:51:02,923: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:51:02.924754653Z [2024-02-24 01:51:02,924: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:51:02.925300543Z [2024-02-24 01:51:02,925: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:51:02.926452838Z [2024-02-24 01:51:02,926: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:51:02.926791710Z [2024-02-24 01:51:02,926: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:51:03.011576944Z [2024-02-24 01:51:03,011: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:51:03.049085493Z [2024-02-24 01:51:03,048: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:51:04.890764603Z [2024-02-24 01:51:04,890: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4967e070-c6ac-4d27-9d3f-1630714a2c91] succeeded in 3.6656916800002364s: None
2024-02-24T01:51:05.772813358Z [2024-02-24 01:51:05,772: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[800a4a3b-80b4-4bf8-bf42-f10822e9c1b9] succeeded in 4.54972449700108s: None
2024-02-24T01:52:01.072906650Z [2024-02-24 01:52:01,072: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[090fb86a-b65d-4247-95f2-7b454a636cb9] received
2024-02-24T01:52:01.080036701Z [2024-02-24 01:52:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0883c0cd-166f-4755-adf0-91ecc8c57cd7] received
2024-02-24T01:52:01.082187602Z [2024-02-24 01:52:01,081: INFO/ForkPoolWorker-15] [090fb86a-b65d-4247-95f2-7b454a636cb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:52:01.090673973Z [2024-02-24 01:52:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[794d421d-827a-4f8a-ad45-7f3d07df2429] received
2024-02-24T01:52:01.098117541Z [2024-02-24 01:52:01,097: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2e0fc6c-e6fb-40a0-89e7-f729e06509ea] received
2024-02-24T01:52:01.105339807Z [2024-02-24 01:52:01,104: INFO/ForkPoolWorker-1] [794d421d-827a-4f8a-ad45-7f3d07df2429] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:52:01.106474585Z [2024-02-24 01:52:01,106: INFO/ForkPoolWorker-16] [0883c0cd-166f-4755-adf0-91ecc8c57cd7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:52:01.108592060Z [2024-02-24 01:52:01,108: INFO/ForkPoolWorker-2] [f2e0fc6c-e6fb-40a0-89e7-f729e06509ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:52:01.476006158Z [2024-02-24 01:52:01,472: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:52:01.485262144Z [2024-02-24 01:52:01,481: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:52:01.512562799Z [2024-02-24 01:52:01,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:52:01.548951581Z [2024-02-24 01:52:01,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:52:01.731915037Z [2024-02-24 01:52:01,731: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:52:01.744330650Z [2024-02-24 01:52:01,743: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T01:52:01.749147992Z [2024-02-24 01:52:01,748: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:52:01.788881878Z [2024-02-24 01:52:01,788: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:52:01.791583258Z [2024-02-24 01:52:01,790: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:52:01.791840451Z [2024-02-24 01:52:01,791: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:52:01.792143548Z [2024-02-24 01:52:01,791: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T01:52:01.794489115Z [2024-02-24 01:52:01,793: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:52:01.892746918Z [2024-02-24 01:52:01,892: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:52:02.323919932Z [2024-02-24 01:52:02,323: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[090fb86a-b65d-4247-95f2-7b454a636cb9] succeeded in 1.2485694450006122s: None
2024-02-24T01:52:02.541954337Z [2024-02-24 01:52:02,541: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2e0fc6c-e6fb-40a0-89e7-f729e06509ea] succeeded in 1.4411635390006268s: None
2024-02-24T01:52:03.041716871Z [2024-02-24 01:52:03,040: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:52:03.044879766Z [2024-02-24 01:52:03,044: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:52:03.068919658Z [2024-02-24 01:52:03,068: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:52:03.072248919Z [2024-02-24 01:52:03,071: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:52:03.072422150Z [2024-02-24 01:52:03,072: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:52:03.072835587Z [2024-02-24 01:52:03,072: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:52:03.073091054Z [2024-02-24 01:52:03,072: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:52:03.073895418Z [2024-02-24 01:52:03,073: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:52:03.074221863Z [2024-02-24 01:52:03,074: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:52:03.176385823Z [2024-02-24 01:52:03,175: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T01:52:03.181455315Z [2024-02-24 01:52:03,179: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:52:03.183188521Z [2024-02-24 01:52:03,182: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:52:03.206352582Z [2024-02-24 01:52:03,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:52:03.207878836Z [2024-02-24 01:52:03,207: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:52:03.208042510Z [2024-02-24 01:52:03,207: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:52:03.208169979Z [2024-02-24 01:52:03,208: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:52:03.208263076Z [2024-02-24 01:52:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T01:52:03.208632039Z [2024-02-24 01:52:03,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:52:03.208767467Z [2024-02-24 01:52:03,208: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:52:03.299292642Z [2024-02-24 01:52:03,298: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:52:04.865391408Z [2024-02-24 01:52:04,864: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0883c0cd-166f-4755-adf0-91ecc8c57cd7] succeeded in 3.771325978999812s: None
2024-02-24T01:52:05.116091614Z [2024-02-24 01:52:05,115: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[794d421d-827a-4f8a-ad45-7f3d07df2429] succeeded in 4.022089117001087s: None
2024-02-24T01:53:01.023294061Z [2024-02-24 01:53:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1497b1e1-b92d-43c5-a238-ab5c154031b7] received
2024-02-24T01:53:01.031026671Z [2024-02-24 01:53:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39201c41-2d5d-41b3-b894-29c649364836] received
2024-02-24T01:53:01.033957916Z [2024-02-24 01:53:01,033: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[752609a4-857b-4505-b80e-6ffcbb6dbf3f] received
2024-02-24T01:53:01.037810832Z [2024-02-24 01:53:01,037: INFO/ForkPoolWorker-15] [1497b1e1-b92d-43c5-a238-ab5c154031b7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:53:01.040633221Z [2024-02-24 01:53:01,040: INFO/ForkPoolWorker-1] [752609a4-857b-4505-b80e-6ffcbb6dbf3f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:53:01.044705381Z [2024-02-24 01:53:01,044: INFO/ForkPoolWorker-16] [39201c41-2d5d-41b3-b894-29c649364836] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:53:01.375061630Z [2024-02-24 01:53:01,369: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:53:01.441287425Z [2024-02-24 01:53:01,437: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:53:01.564771302Z [2024-02-24 01:53:01,560: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:53:01.641620020Z [2024-02-24 01:53:01,639: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:53:01.646042469Z [2024-02-24 01:53:01,643: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:53:01.708199583Z [2024-02-24 01:53:01,707: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:53:01.716870824Z [2024-02-24 01:53:01,710: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:53:01.716900017Z [2024-02-24 01:53:01,710: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:53:01.716904221Z [2024-02-24 01:53:01,710: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:53:01.716907734Z [2024-02-24 01:53:01,711: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:53:01.823326477Z [2024-02-24 01:53:01,823: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:53:02.430247117Z [2024-02-24 01:53:02,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[39201c41-2d5d-41b3-b894-29c649364836] succeeded in 1.393183238000347s: None
2024-02-24T01:53:02.779503603Z [2024-02-24 01:53:02,777: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:53:02.783276969Z [2024-02-24 01:53:02,782: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:53:02.839491120Z [2024-02-24 01:53:02,839: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:53:02.842498839Z [2024-02-24 01:53:02,842: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:53:02.842547126Z [2024-02-24 01:53:02,842: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:53:02.842688819Z [2024-02-24 01:53:02,842: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:53:02.842751212Z [2024-02-24 01:53:02,842: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:53:02.843109293Z [2024-02-24 01:53:02,842: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:53:02.843200750Z [2024-02-24 01:53:02,843: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:53:02.939082625Z [2024-02-24 01:53:02,938: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:53:02.968397515Z [2024-02-24 01:53:02,968: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:53:02.971677641Z [2024-02-24 01:53:02,971: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:53:03.004434104Z [2024-02-24 01:53:03,004: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:53:03.006080743Z [2024-02-24 01:53:03,005: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:53:03.006176071Z [2024-02-24 01:53:03,006: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:53:03.006283602Z [2024-02-24 01:53:03,006: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:53:03.006354567Z [2024-02-24 01:53:03,006: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:53:03.006624402Z [2024-02-24 01:53:03,006: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:53:03.006698348Z [2024-02-24 01:53:03,006: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:53:03.094190824Z [2024-02-24 01:53:03,093: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:53:04.859688199Z [2024-02-24 01:53:04,859: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1497b1e1-b92d-43c5-a238-ab5c154031b7] succeeded in 3.8341441819993634s: None
2024-02-24T01:53:05.631929228Z [2024-02-24 01:53:05,631: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[752609a4-857b-4505-b80e-6ffcbb6dbf3f] succeeded in 4.59694378399945s: None
2024-02-24T01:54:00.584167299Z [2024-02-24 01:54:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b463466-4b7b-4e80-8bff-7df2f6b1639f] received
2024-02-24T01:54:00.587559961Z [2024-02-24 01:54:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ebd4ba6-7df9-4412-9bdc-727de09d6aa3] received
2024-02-24T01:54:00.590455447Z [2024-02-24 01:54:00,590: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b9e31f48-a6e9-49b9-9a71-66d6c6c3c1cc] received
2024-02-24T01:54:00.592534960Z [2024-02-24 01:54:00,591: INFO/ForkPoolWorker-15] [3b463466-4b7b-4e80-8bff-7df2f6b1639f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:54:00.595620473Z [2024-02-24 01:54:00,595: INFO/ForkPoolWorker-16] [5ebd4ba6-7df9-4412-9bdc-727de09d6aa3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:54:00.597687625Z [2024-02-24 01:54:00,597: INFO/ForkPoolWorker-1] [b9e31f48-a6e9-49b9-9a71-66d6c6c3c1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:54:00.608960685Z [2024-02-24 01:54:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f665a5f6-ab37-4e1f-a58d-a09565a584e7] received
2024-02-24T01:54:00.622660395Z [2024-02-24 01:54:00,622: INFO/ForkPoolWorker-2] [f665a5f6-ab37-4e1f-a58d-a09565a584e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:54:01.020611487Z [2024-02-24 01:54:01,017: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:54:01.108150848Z [2024-02-24 01:54:01,104: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:54:01.146967372Z [2024-02-24 01:54:01,127: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:54:01.342601198Z [2024-02-24 01:54:01,342: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T01:54:01.346433435Z [2024-02-24 01:54:01,345: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:54:01.382486036Z [2024-02-24 01:54:01,382: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:54:01.391291242Z [2024-02-24 01:54:01,391: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:54:01.391380746Z [2024-02-24 01:54:01,391: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:54:01.391463381Z [2024-02-24 01:54:01,391: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T01:54:01.391728077Z [2024-02-24 01:54:01,391: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:54:01.394745665Z [2024-02-24 01:54:01,390: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:54:01.539907813Z [2024-02-24 01:54:01,539: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:54:01.713880009Z [2024-02-24 01:54:01,713: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:54:02.298910132Z [2024-02-24 01:54:02,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3b463466-4b7b-4e80-8bff-7df2f6b1639f] succeeded in 1.7127653289990121s: None
2024-02-24T01:54:02.375461333Z [2024-02-24 01:54:02,374: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ebd4ba6-7df9-4412-9bdc-727de09d6aa3] succeeded in 1.7859558039999683s: None
2024-02-24T01:54:02.941598859Z [2024-02-24 01:54:02,941: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:54:02.944949441Z [2024-02-24 01:54:02,944: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:54:02.967766069Z [2024-02-24 01:54:02,967: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:54:02.969237177Z [2024-02-24 01:54:02,968: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:54:02.969402724Z [2024-02-24 01:54:02,969: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:54:02.969625921Z [2024-02-24 01:54:02,969: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:54:02.969730680Z [2024-02-24 01:54:02,969: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:54:02.970395737Z [2024-02-24 01:54:02,970: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:54:02.970523028Z [2024-02-24 01:54:02,970: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:54:02.978858465Z [2024-02-24 01:54:02,978: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:54:02.982495867Z [2024-02-24 01:54:02,982: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:54:03.005383014Z [2024-02-24 01:54:03,005: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:54:03.006677345Z [2024-02-24 01:54:03,006: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:54:03.006692055Z [2024-02-24 01:54:03,006: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:54:03.006853956Z [2024-02-24 01:54:03,006: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:54:03.006892420Z [2024-02-24 01:54:03,006: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:54:03.007226109Z [2024-02-24 01:54:03,007: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:54:03.007343288Z [2024-02-24 01:54:03,007: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:54:03.089147425Z [2024-02-24 01:54:03,088: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:54:03.103200548Z [2024-02-24 01:54:03,102: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:54:06.314382046Z [2024-02-24 01:54:06,313: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f665a5f6-ab37-4e1f-a58d-a09565a584e7] succeeded in 5.701889984000445s: None
2024-02-24T01:54:06.517756253Z [2024-02-24 01:54:06,517: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b9e31f48-a6e9-49b9-9a71-66d6c6c3c1cc] succeeded in 5.925483808001445s: None
2024-02-24T01:55:01.093863111Z [2024-02-24 01:55:01,093: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4aeaf45-563f-4764-8f70-96c2cbe684f5] received
2024-02-24T01:55:01.100908867Z [2024-02-24 01:55:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5943bfc-b37b-4ab0-b46b-b8dafab8f348] received
2024-02-24T01:55:01.103681232Z [2024-02-24 01:55:01,103: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[56b143d2-d15a-42c0-ad1b-dd97242bbffa] received
2024-02-24T01:55:01.104228102Z [2024-02-24 01:55:01,103: INFO/ForkPoolWorker-15] [e4aeaf45-563f-4764-8f70-96c2cbe684f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:55:01.117798008Z [2024-02-24 01:55:01,117: INFO/ForkPoolWorker-16] [e5943bfc-b37b-4ab0-b46b-b8dafab8f348] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:55:01.122959633Z [2024-02-24 01:55:01,122: INFO/ForkPoolWorker-1] [56b143d2-d15a-42c0-ad1b-dd97242bbffa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:55:01.134685668Z [2024-02-24 01:55:01,134: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[59bf4df5-d73c-45f2-a767-5ae86d37285e] received
2024-02-24T01:55:01.187046876Z [2024-02-24 01:55:01,186: INFO/ForkPoolWorker-2] [59bf4df5-d73c-45f2-a767-5ae86d37285e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:55:01.557989060Z [2024-02-24 01:55:01,554: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:55:01.600361223Z [2024-02-24 01:55:01,596: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:55:01.669235938Z [2024-02-24 01:55:01,664: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:55:01.754922794Z [2024-02-24 01:55:01,751: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:55:01.848671880Z [2024-02-24 01:55:01,848: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:55:01.855154804Z [2024-02-24 01:55:01,854: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:01.899312193Z [2024-02-24 01:55:01,898: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:55:01.903603806Z [2024-02-24 01:55:01,903: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:55:01.903966270Z [2024-02-24 01:55:01,903: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:55:01.904271608Z [2024-02-24 01:55:01,904: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:55:01.904886207Z [2024-02-24 01:55:01,904: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:55:02.036469450Z [2024-02-24 01:55:02,036: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:03.028680859Z [2024-02-24 01:55:03,028: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5943bfc-b37b-4ab0-b46b-b8dafab8f348] succeeded in 1.9232338800011348s: None
2024-02-24T01:55:03.184304348Z [2024-02-24 01:55:03,183: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:55:03.191649707Z [2024-02-24 01:55:03,191: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:03.239784771Z [2024-02-24 01:55:03,239: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:55:03.241672252Z [2024-02-24 01:55:03,241: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:03.241709228Z [2024-02-24 01:55:03,241: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:03.248762852Z [2024-02-24 01:55:03,241: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:03.248848680Z [2024-02-24 01:55:03,248: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:55:03.249302706Z [2024-02-24 01:55:03,249: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:55:03.249414312Z [2024-02-24 01:55:03,249: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:03.396013669Z [2024-02-24 01:55:03,395: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:03.446317849Z [2024-02-24 01:55:03,445: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:55:03.450260031Z [2024-02-24 01:55:03,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:03.496328422Z [2024-02-24 01:55:03,496: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:55:03.501928238Z [2024-02-24 01:55:03,500: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:03.501958005Z [2024-02-24 01:55:03,500: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:03.501963915Z [2024-02-24 01:55:03,500: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:03.501969622Z [2024-02-24 01:55:03,501: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:55:03.501974601Z [2024-02-24 01:55:03,501: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:55:03.501996893Z [2024-02-24 01:55:03,501: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:03.721343979Z [2024-02-24 01:55:03,720: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:03.848851932Z [2024-02-24 01:55:03,847: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:55:03.857946827Z [2024-02-24 01:55:03,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:03.933279131Z [2024-02-24 01:55:03,932: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:55:03.954891140Z [2024-02-24 01:55:03,954: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:03.954988278Z [2024-02-24 01:55:03,954: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:03.955023527Z [2024-02-24 01:55:03,954: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:03.955034725Z [2024-02-24 01:55:03,954: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:55:03.955228950Z [2024-02-24 01:55:03,955: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:55:03.955286410Z [2024-02-24 01:55:03,955: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:04.178730836Z [2024-02-24 01:55:04,178: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:04.866501404Z [2024-02-24 01:55:04,866: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4aeaf45-563f-4764-8f70-96c2cbe684f5] succeeded in 3.7699947750006686s: None
2024-02-24T01:55:05.250195186Z [2024-02-24 01:55:05,248: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[59bf4df5-d73c-45f2-a767-5ae86d37285e] succeeded in 4.105823539999619s: None
2024-02-24T01:55:05.374805204Z [2024-02-24 01:55:05,374: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c63772b-af3d-4e6b-9004-d43b8547f2c2] received
2024-02-24T01:55:05.383839760Z [2024-02-24 01:55:05,383: INFO/ForkPoolWorker-15] [2c63772b-af3d-4e6b-9004-d43b8547f2c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:55:05.679734650Z [2024-02-24 01:55:05,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:55:05.936709293Z [2024-02-24 01:55:05,936: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[56b143d2-d15a-42c0-ad1b-dd97242bbffa] succeeded in 4.831173170001421s: None
2024-02-24T01:55:06.884508399Z [2024-02-24 01:55:06,883: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:55:06.887907372Z [2024-02-24 01:55:06,887: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:06.910067949Z [2024-02-24 01:55:06,909: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:55:06.911658211Z [2024-02-24 01:55:06,911: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:06.911702418Z [2024-02-24 01:55:06,911: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:06.912006345Z [2024-02-24 01:55:06,911: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:06.912114752Z [2024-02-24 01:55:06,911: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:55:06.912443511Z [2024-02-24 01:55:06,912: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:55:06.912967885Z [2024-02-24 01:55:06,912: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:06.995139725Z [2024-02-24 01:55:06,994: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:07.614456745Z [2024-02-24 01:55:07,613: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c63772b-af3d-4e6b-9004-d43b8547f2c2] succeeded in 2.2371220020013425s: None
2024-02-24T01:55:07.774255374Z [2024-02-24 01:55:07,772: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21cfd391-28f8-40df-b64e-02097d91d665] received
2024-02-24T01:55:07.790878954Z [2024-02-24 01:55:07,790: INFO/ForkPoolWorker-15] [21cfd391-28f8-40df-b64e-02097d91d665] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T01:55:08.109112244Z [2024-02-24 01:55:08,105: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:55:09.179501691Z [2024-02-24 01:55:09,179: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:55:09.182817967Z [2024-02-24 01:55:09,182: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:09.200185401Z [2024-02-24 01:55:09,199: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:55:09.201317380Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:09.201333607Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:09.201452475Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:09.201466799Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:55:09.201764090Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:55:09.201827548Z [2024-02-24 01:55:09,201: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:09.316005136Z [2024-02-24 01:55:09,315: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:09.875513682Z [2024-02-24 01:55:09,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21cfd391-28f8-40df-b64e-02097d91d665] succeeded in 2.0994286100012687s: None
2024-02-24T01:55:09.907913286Z [2024-02-24 01:55:09,907: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7a93654-705f-4148-a3fc-ae9687386869] received
2024-02-24T01:55:09.913891112Z [2024-02-24 01:55:09,913: INFO/ForkPoolWorker-15] [f7a93654-705f-4148-a3fc-ae9687386869] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T01:55:10.199974290Z [2024-02-24 01:55:10,196: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T01:55:11.460719413Z [2024-02-24 01:55:11,460: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:55:11.464362636Z [2024-02-24 01:55:11,463: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:55:11.484442645Z [2024-02-24 01:55:11,484: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:55:11.485839435Z [2024-02-24 01:55:11,485: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:55:11.485982495Z [2024-02-24 01:55:11,485: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:55:11.486188036Z [2024-02-24 01:55:11,485: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:55:11.486286326Z [2024-02-24 01:55:11,486: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:55:11.486620359Z [2024-02-24 01:55:11,486: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T01:55:11.486686672Z [2024-02-24 01:55:11,486: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:55:11.571445781Z [2024-02-24 01:55:11,571: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:55:12.246403348Z [2024-02-24 01:55:12,245: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7a93654-705f-4148-a3fc-ae9687386869] succeeded in 2.3362700449997647s: None
2024-02-24T01:56:00.490273020Z [2024-02-24 01:56:00,489: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0ab7d68-435c-486a-8cfb-3b18ff81d4aa] received
2024-02-24T01:56:00.494012395Z [2024-02-24 01:56:00,493: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4afdb27d-74ac-43ce-a3ff-261f80bf2e88] received
2024-02-24T01:56:00.498961149Z [2024-02-24 01:56:00,498: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81e314fa-1a80-475b-b92a-8e52d2ec4b7e] received
2024-02-24T01:56:00.501072704Z [2024-02-24 01:56:00,500: INFO/ForkPoolWorker-16] [4afdb27d-74ac-43ce-a3ff-261f80bf2e88] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:56:00.501886022Z [2024-02-24 01:56:00,501: INFO/ForkPoolWorker-15] [a0ab7d68-435c-486a-8cfb-3b18ff81d4aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:56:00.504976757Z [2024-02-24 01:56:00,504: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d6a345f-5226-4606-bbef-271b613d7879] received
2024-02-24T01:56:00.519190941Z [2024-02-24 01:56:00,518: INFO/ForkPoolWorker-1] [81e314fa-1a80-475b-b92a-8e52d2ec4b7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:56:00.529543944Z [2024-02-24 01:56:00,529: INFO/ForkPoolWorker-2] [1d6a345f-5226-4606-bbef-271b613d7879] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:56:00.791563666Z [2024-02-24 01:56:00,786: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:56:00.819637264Z [2024-02-24 01:56:00,815: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:56:00.890085095Z [2024-02-24 01:56:00,885: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:56:00.992005592Z [2024-02-24 01:56:00,978: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:56:01.086063600Z [2024-02-24 01:56:01,085: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T01:56:01.090309424Z [2024-02-24 01:56:01,089: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:56:01.119704293Z [2024-02-24 01:56:01,119: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:56:01.126521197Z [2024-02-24 01:56:01,126: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:56:01.130027585Z [2024-02-24 01:56:01,129: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:56:01.130458274Z [2024-02-24 01:56:01,130: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:56:01.130553176Z [2024-02-24 01:56:01,130: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T01:56:01.132838843Z [2024-02-24 01:56:01,132: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:56:01.265876824Z [2024-02-24 01:56:01,259: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:56:01.759663144Z [2024-02-24 01:56:01,759: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4afdb27d-74ac-43ce-a3ff-261f80bf2e88] succeeded in 1.2642509370016342s: None
2024-02-24T01:56:01.875117246Z [2024-02-24 01:56:01,874: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81e314fa-1a80-475b-b92a-8e52d2ec4b7e] succeeded in 1.3732593819986505s: None
2024-02-24T01:56:02.228898316Z [2024-02-24 01:56:02,228: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:56:02.232525048Z [2024-02-24 01:56:02,232: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:56:02.258965092Z [2024-02-24 01:56:02,258: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:56:02.261735750Z [2024-02-24 01:56:02,261: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:56:02.266371643Z [2024-02-24 01:56:02,265: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:56:02.266652658Z [2024-02-24 01:56:02,266: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:56:02.266777810Z [2024-02-24 01:56:02,266: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:56:02.267415083Z [2024-02-24 01:56:02,266: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:56:02.267599246Z [2024-02-24 01:56:02,267: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:56:02.405862462Z [2024-02-24 01:56:02,399: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:56:02.420465061Z [2024-02-24 01:56:02,419: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:56:02.424429805Z [2024-02-24 01:56:02,423: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:56:02.451606126Z [2024-02-24 01:56:02,451: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:56:02.453117260Z [2024-02-24 01:56:02,452: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:56:02.453193408Z [2024-02-24 01:56:02,453: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:56:02.453334913Z [2024-02-24 01:56:02,453: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:56:02.453405279Z [2024-02-24 01:56:02,453: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:56:02.453625609Z [2024-02-24 01:56:02,453: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:56:02.453697198Z [2024-02-24 01:56:02,453: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:56:02.563315104Z [2024-02-24 01:56:02,562: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:56:04.164343806Z [2024-02-24 01:56:04,163: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0ab7d68-435c-486a-8cfb-3b18ff81d4aa] succeeded in 3.6685508499995194s: None
2024-02-24T01:56:04.930200143Z [2024-02-24 01:56:04,929: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1d6a345f-5226-4606-bbef-271b613d7879] succeeded in 4.422557792000589s: None
2024-02-24T01:57:00.316354694Z [2024-02-24 01:57:00,316: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b3ead9b-c846-44f7-a59f-1b6215529c10] received
2024-02-24T01:57:00.318912357Z [2024-02-24 01:57:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f435b71-df67-4652-8305-7ec504e9436f] received
2024-02-24T01:57:00.331570265Z [2024-02-24 01:57:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c8455882-b121-4da9-a975-033718baca1b] received
2024-02-24T01:57:00.335101691Z [2024-02-24 01:57:00,334: INFO/ForkPoolWorker-15] [1b3ead9b-c846-44f7-a59f-1b6215529c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:57:00.335178541Z [2024-02-24 01:57:00,334: INFO/ForkPoolWorker-16] [9f435b71-df67-4652-8305-7ec504e9436f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:57:00.343664416Z [2024-02-24 01:57:00,343: INFO/ForkPoolWorker-1] [c8455882-b121-4da9-a975-033718baca1b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:57:00.614222252Z [2024-02-24 01:57:00,610: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:57:00.637301090Z [2024-02-24 01:57:00,634: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:57:00.675980355Z [2024-02-24 01:57:00,672: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:57:00.869278088Z [2024-02-24 01:57:00,868: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:57:00.873151482Z [2024-02-24 01:57:00,872: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:57:00.920204003Z [2024-02-24 01:57:00,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:57:00.926177408Z [2024-02-24 01:57:00,925: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:57:00.926477451Z [2024-02-24 01:57:00,926: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:57:00.926646328Z [2024-02-24 01:57:00,926: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:57:00.926981511Z [2024-02-24 01:57:00,926: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:57:01.042748590Z [2024-02-24 01:57:01,042: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:57:01.787509872Z [2024-02-24 01:57:01,787: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f435b71-df67-4652-8305-7ec504e9436f] succeeded in 1.4652782720004325s: None
2024-02-24T01:57:01.977081909Z [2024-02-24 01:57:01,976: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:57:01.980477375Z [2024-02-24 01:57:01,980: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:57:02.001062150Z [2024-02-24 01:57:02,000: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:57:02.005589045Z [2024-02-24 01:57:02,005: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:57:02.014311255Z [2024-02-24 01:57:02,014: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:57:02.016086403Z [2024-02-24 01:57:02,015: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:57:02.016199036Z [2024-02-24 01:57:02,016: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:57:02.016390365Z [2024-02-24 01:57:02,016: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:57:02.016446635Z [2024-02-24 01:57:02,016: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:57:02.016802979Z [2024-02-24 01:57:02,016: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:57:02.017164162Z [2024-02-24 01:57:02,016: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:57:02.038222467Z [2024-02-24 01:57:02,037: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:57:02.039799749Z [2024-02-24 01:57:02,039: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:57:02.039907034Z [2024-02-24 01:57:02,039: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:57:02.040097179Z [2024-02-24 01:57:02,039: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:57:02.040216224Z [2024-02-24 01:57:02,040: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:57:02.040501043Z [2024-02-24 01:57:02,040: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:57:02.040623602Z [2024-02-24 01:57:02,040: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:57:02.108385019Z [2024-02-24 01:57:02,108: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:57:02.148760168Z [2024-02-24 01:57:02,148: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:57:04.189961959Z [2024-02-24 01:57:04,188: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1b3ead9b-c846-44f7-a59f-1b6215529c10] succeeded in 3.868707142000858s: None
2024-02-24T01:57:04.283010742Z [2024-02-24 01:57:04,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c8455882-b121-4da9-a975-033718baca1b] succeeded in 3.949460370999077s: None
2024-02-24T01:58:00.365594918Z [2024-02-24 01:58:00,364: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[540ab50c-3a51-49a3-bce2-81046f020812] received
2024-02-24T01:58:00.369270978Z [2024-02-24 01:58:00,368: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[072d67e2-5b3f-49d0-a30d-acf36aedff64] received
2024-02-24T01:58:00.381720046Z [2024-02-24 01:58:00,381: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c688ee7-4529-4ac6-99b3-e27146fcce18] received
2024-02-24T01:58:00.385503572Z [2024-02-24 01:58:00,385: INFO/ForkPoolWorker-15] [540ab50c-3a51-49a3-bce2-81046f020812] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T01:58:00.391824564Z [2024-02-24 01:58:00,391: INFO/ForkPoolWorker-1] [5c688ee7-4529-4ac6-99b3-e27146fcce18] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:58:00.392287143Z [2024-02-24 01:58:00,392: INFO/ForkPoolWorker-16] [072d67e2-5b3f-49d0-a30d-acf36aedff64] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:58:00.397515240Z [2024-02-24 01:58:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee96006f-d9c2-4216-9d83-30b5c0f3dab4] received
2024-02-24T01:58:00.429146621Z [2024-02-24 01:58:00,428: INFO/ForkPoolWorker-2] [ee96006f-d9c2-4216-9d83-30b5c0f3dab4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:58:00.820770341Z [2024-02-24 01:58:00,817: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:58:00.822392885Z [2024-02-24 01:58:00,817: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T01:58:00.993118451Z [2024-02-24 01:58:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:58:00.997421257Z [2024-02-24 01:58:00,994: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:58:01.177815612Z [2024-02-24 01:58:01,177: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:58:01.181628165Z [2024-02-24 01:58:01,181: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:58:01.224230616Z [2024-02-24 01:58:01,223: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:58:01.233842521Z [2024-02-24 01:58:01,228: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:58:01.233850980Z [2024-02-24 01:58:01,228: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:58:01.233854895Z [2024-02-24 01:58:01,228: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:58:01.233858011Z [2024-02-24 01:58:01,228: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:58:01.253848711Z [2024-02-24 01:58:01,252: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:58:01.416388592Z [2024-02-24 01:58:01,415: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:58:02.030317930Z [2024-02-24 01:58:02,029: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[540ab50c-3a51-49a3-bce2-81046f020812] succeeded in 1.6551464290005242s: None
2024-02-24T01:58:02.049731191Z [2024-02-24 01:58:02,049: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[072d67e2-5b3f-49d0-a30d-acf36aedff64] succeeded in 1.6715449700004683s: None
2024-02-24T01:58:02.247664187Z [2024-02-24 01:58:02,247: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:58:02.250980103Z [2024-02-24 01:58:02,250: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:58:02.271052482Z [2024-02-24 01:58:02,270: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:58:02.272436397Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:58:02.272454178Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:58:02.272608474Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:58:02.272633790Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:58:02.272895089Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:58:02.272971989Z [2024-02-24 01:58:02,272: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:58:02.367327395Z [2024-02-24 01:58:02,366: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T01:58:02.375504892Z [2024-02-24 01:58:02,374: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:58:02.379201823Z [2024-02-24 01:58:02,378: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:58:02.421546313Z [2024-02-24 01:58:02,421: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T01:58:02.432509653Z [2024-02-24 01:58:02,429: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:58:02.432715349Z [2024-02-24 01:58:02,432: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:58:02.432918478Z [2024-02-24 01:58:02,432: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:58:02.432990402Z [2024-02-24 01:58:02,432: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T01:58:02.433489101Z [2024-02-24 01:58:02,433: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:58:02.433600581Z [2024-02-24 01:58:02,433: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:58:02.524686407Z [2024-02-24 01:58:02,524: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:58:04.097196071Z [2024-02-24 01:58:04,096: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ee96006f-d9c2-4216-9d83-30b5c0f3dab4] succeeded in 3.6908261440003116s: None
2024-02-24T01:58:04.348401169Z [2024-02-24 01:58:04,347: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c688ee7-4529-4ac6-99b3-e27146fcce18] succeeded in 3.9636094969991973s: None
2024-02-24T01:59:01.050771088Z [2024-02-24 01:59:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[732a51dc-73ce-4d1c-ad15-a933643da7db] received
2024-02-24T01:59:01.054826124Z [2024-02-24 01:59:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c606f54-6785-449a-9bd2-cb38d659b1c5] received
2024-02-24T01:59:01.057669838Z [2024-02-24 01:59:01,057: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[88d7656c-3221-4e6d-8ae5-f1c0f5807077] received
2024-02-24T01:59:01.065597065Z [2024-02-24 01:59:01,065: INFO/ForkPoolWorker-15] [732a51dc-73ce-4d1c-ad15-a933643da7db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T01:59:01.071312745Z [2024-02-24 01:59:01,070: INFO/ForkPoolWorker-1] [88d7656c-3221-4e6d-8ae5-f1c0f5807077] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T01:59:01.071914577Z [2024-02-24 01:59:01,071: INFO/ForkPoolWorker-16] [0c606f54-6785-449a-9bd2-cb38d659b1c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T01:59:01.453573767Z [2024-02-24 01:59:01,448: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T01:59:01.491238169Z [2024-02-24 01:59:01,486: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T01:59:01.510642655Z [2024-02-24 01:59:01,507: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T01:59:01.712016942Z [2024-02-24 01:59:01,711: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T01:59:01.716918445Z [2024-02-24 01:59:01,716: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:59:01.753563298Z [2024-02-24 01:59:01,753: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T01:59:01.756646902Z [2024-02-24 01:59:01,756: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T01:59:01.756836271Z [2024-02-24 01:59:01,756: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T01:59:01.756977642Z [2024-02-24 01:59:01,756: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T01:59:01.757341988Z [2024-02-24 01:59:01,757: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T01:59:01.898378204Z [2024-02-24 01:59:01,898: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:59:02.598862034Z [2024-02-24 01:59:02,598: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c606f54-6785-449a-9bd2-cb38d659b1c5] succeeded in 1.540919209999629s: None
2024-02-24T01:59:03.098800204Z [2024-02-24 01:59:03,098: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T01:59:03.103488633Z [2024-02-24 01:59:03,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:59:03.114094533Z [2024-02-24 01:59:03,113: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T01:59:03.117678555Z [2024-02-24 01:59:03,117: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T01:59:03.142274618Z [2024-02-24 01:59:03,141: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T01:59:03.146863706Z [2024-02-24 01:59:03,146: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:59:03.147157995Z [2024-02-24 01:59:03,146: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:59:03.147500854Z [2024-02-24 01:59:03,147: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:59:03.147716586Z [2024-02-24 01:59:03,147: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T01:59:03.148331300Z [2024-02-24 01:59:03,148: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T01:59:03.148573571Z [2024-02-24 01:59:03,148: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:59:03.163095156Z [2024-02-24 01:59:03,162: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T01:59:03.165657510Z [2024-02-24 01:59:03,165: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T01:59:03.165727041Z [2024-02-24 01:59:03,165: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T01:59:03.165936867Z [2024-02-24 01:59:03,165: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T01:59:03.166100284Z [2024-02-24 01:59:03,165: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T01:59:03.166452373Z [2024-02-24 01:59:03,166: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T01:59:03.166985748Z [2024-02-24 01:59:03,166: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T01:59:03.280237453Z [2024-02-24 01:59:03,279: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:59:03.310242821Z [2024-02-24 01:59:03,309: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T01:59:05.086926021Z [2024-02-24 01:59:05,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[732a51dc-73ce-4d1c-ad15-a933643da7db] succeeded in 4.031592106999597s: None
2024-02-24T01:59:05.416221819Z [2024-02-24 01:59:05,415: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[88d7656c-3221-4e6d-8ae5-f1c0f5807077] succeeded in 4.3561201880002045s: None
2024-02-24T02:00:00.377456165Z [2024-02-24 02:00:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c9acce40-2ed0-4ed8-938b-e2099b284b03] received
2024-02-24T02:00:00.380674261Z [2024-02-24 02:00:00,380: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32e3dcea-cf8b-4a99-b77f-327ff311efd8] received
2024-02-24T02:00:00.391984815Z [2024-02-24 02:00:00,391: INFO/ForkPoolWorker-15] [c9acce40-2ed0-4ed8-938b-e2099b284b03] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:00:00.392305102Z [2024-02-24 02:00:00,391: INFO/ForkPoolWorker-16] [32e3dcea-cf8b-4a99-b77f-327ff311efd8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T01:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:00:00.397298404Z [2024-02-24 02:00:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ab09ebf-665f-4a67-97de-f459cf9d5796] received
2024-02-24T02:00:00.400191759Z [2024-02-24 02:00:00,399: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f0aa829-1b21-4265-9b9d-c3846315dce3] received
2024-02-24T02:00:00.407520274Z [2024-02-24 02:00:00,407: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3537fca-69f0-4faa-b89d-e16e39a64fef] received
2024-02-24T02:00:00.409601405Z [2024-02-24 02:00:00,409: INFO/ForkPoolWorker-2] [8f0aa829-1b21-4265-9b9d-c3846315dce3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:00:00.411299345Z [2024-02-24 02:00:00,411: INFO/ForkPoolWorker-1] [5ab09ebf-665f-4a67-97de-f459cf9d5796] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:00:00.428026291Z [2024-02-24 02:00:00,427: INFO/ForkPoolWorker-3] [c3537fca-69f0-4faa-b89d-e16e39a64fef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T01:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:00:00.729304826Z [2024-02-24 02:00:00,723: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:00:00.797202565Z [2024-02-24 02:00:00,793: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:00:00.832450923Z [2024-02-24 02:00:00,826: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:00:00.963944613Z [2024-02-24 02:00:00,960: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:00:01.019138170Z [2024-02-24 02:00:01,015: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:00:01.052348909Z [2024-02-24 02:00:01,052: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T01:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:01.430803600Z [2024-02-24 02:00:01,430: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:00:01.441838502Z [2024-02-24 02:00:01,441: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:01.491113576Z [2024-02-24 02:00:01,490: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:00:01.495339346Z [2024-02-24 02:00:01,495: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:00:01.495607137Z [2024-02-24 02:00:01,495: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:00:01.495730029Z [2024-02-24 02:00:01,495: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:00:01.496122450Z [2024-02-24 02:00:01,495: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:00:01.629847208Z [2024-02-24 02:00:01,629: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:01.811357123Z [2024-02-24 02:00:01,810: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[32e3dcea-cf8b-4a99-b77f-327ff311efd8] succeeded in 1.4284681099998124s: None
2024-02-24T02:00:02.290014887Z [2024-02-24 02:00:02,289: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ab09ebf-665f-4a67-97de-f459cf9d5796] succeeded in 1.8908527089988638s: None
2024-02-24T02:00:02.597873510Z [2024-02-24 02:00:02,597: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:00:02.601677137Z [2024-02-24 02:00:02,601: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:02.622148433Z [2024-02-24 02:00:02,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:00:02.623901068Z [2024-02-24 02:00:02,623: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:02.623998454Z [2024-02-24 02:00:02,623: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:02.624159867Z [2024-02-24 02:00:02,623: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:02.624226423Z [2024-02-24 02:00:02,624: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:00:02.624932059Z [2024-02-24 02:00:02,624: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:00:02.625565178Z [2024-02-24 02:00:02,624: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:02.683303132Z [2024-02-24 02:00:02,682: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:00:02.687939976Z [2024-02-24 02:00:02,687: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:02.801719075Z [2024-02-24 02:00:02,801: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:00:02.812754522Z [2024-02-24 02:00:02,812: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:02.812772171Z [2024-02-24 02:00:02,812: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:02.812985868Z [2024-02-24 02:00:02,812: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:02.813049709Z [2024-02-24 02:00:02,812: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:02.813155544Z [2024-02-24 02:00:02,812: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:00:02.813498254Z [2024-02-24 02:00:02,813: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:00:02.813620484Z [2024-02-24 02:00:02,813: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:02.814123469Z [2024-02-24 02:00:02,813: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T02:00:02.817571114Z [2024-02-24 02:00:02,817: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:02.842469759Z [2024-02-24 02:00:02,842: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T02:00:02.847056497Z [2024-02-24 02:00:02,846: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:02.847079699Z [2024-02-24 02:00:02,846: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:02.847228112Z [2024-02-24 02:00:02,847: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:02.847316699Z [2024-02-24 02:00:02,847: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T02:00:02.847613349Z [2024-02-24 02:00:02,847: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:00:02.847681374Z [2024-02-24 02:00:02,847: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:02.930550573Z [2024-02-24 02:00:02,930: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:02.956106119Z [2024-02-24 02:00:02,955: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T01:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:03.511237784Z [2024-02-24 02:00:03,510: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c9acce40-2ed0-4ed8-938b-e2099b284b03] succeeded in 3.1311444210004993s: None
2024-02-24T02:00:03.684372948Z [2024-02-24 02:00:03,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[97302ce5-5c41-4119-aae4-13ad659c5f06] received
2024-02-24T02:00:03.693900690Z [2024-02-24 02:00:03,693: INFO/ForkPoolWorker-15] [97302ce5-5c41-4119-aae4-13ad659c5f06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:00:04.003621709Z [2024-02-24 02:00:03,997: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:00:04.449029988Z [2024-02-24 02:00:04,448: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8f0aa829-1b21-4265-9b9d-c3846315dce3] succeeded in 4.046811885998977s: None
2024-02-24T02:00:04.885520917Z [2024-02-24 02:00:04,884: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c3537fca-69f0-4faa-b89d-e16e39a64fef] succeeded in 4.474727761000395s: None
2024-02-24T02:00:05.177386533Z [2024-02-24 02:00:05,176: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:00:05.180900499Z [2024-02-24 02:00:05,180: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:05.200297983Z [2024-02-24 02:00:05,200: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:00:05.202368105Z [2024-02-24 02:00:05,202: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:05.202482506Z [2024-02-24 02:00:05,202: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:05.202711177Z [2024-02-24 02:00:05,202: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:05.202791058Z [2024-02-24 02:00:05,202: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:00:05.203318993Z [2024-02-24 02:00:05,202: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:00:05.203446346Z [2024-02-24 02:00:05,203: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:05.307899701Z [2024-02-24 02:00:05,307: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:05.973166447Z [2024-02-24 02:00:05,972: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[97302ce5-5c41-4119-aae4-13ad659c5f06] succeeded in 2.2842996799990942s: None
2024-02-24T02:00:06.184352446Z [2024-02-24 02:00:06,183: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5aa94d6-42a0-44c2-b2fa-f4d0fb5674cc] received
2024-02-24T02:00:06.197042421Z [2024-02-24 02:00:06,196: INFO/ForkPoolWorker-15] [e5aa94d6-42a0-44c2-b2fa-f4d0fb5674cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:00:06.495958466Z [2024-02-24 02:00:06,492: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:00:07.616169788Z [2024-02-24 02:00:07,615: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:00:07.619771693Z [2024-02-24 02:00:07,619: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:07.645252129Z [2024-02-24 02:00:07,645: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:00:07.646674927Z [2024-02-24 02:00:07,646: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:07.646895764Z [2024-02-24 02:00:07,646: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:07.647099047Z [2024-02-24 02:00:07,646: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:07.647239784Z [2024-02-24 02:00:07,647: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:00:07.647570787Z [2024-02-24 02:00:07,647: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:00:07.647728323Z [2024-02-24 02:00:07,647: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:07.734841953Z [2024-02-24 02:00:07,734: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T01:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:08.288892226Z [2024-02-24 02:00:08,288: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e5aa94d6-42a0-44c2-b2fa-f4d0fb5674cc] succeeded in 2.1013612469996588s: None
2024-02-24T02:00:08.501902178Z [2024-02-24 02:00:08,501: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e79f6c9c-a1a1-4ada-bfde-36458d1793eb] received
2024-02-24T02:00:08.512846380Z [2024-02-24 02:00:08,512: INFO/ForkPoolWorker-15] [e79f6c9c-a1a1-4ada-bfde-36458d1793eb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T01:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:00:08.875367209Z [2024-02-24 02:00:08,872: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:00:10.026544541Z [2024-02-24 02:00:10,026: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:00:10.029719480Z [2024-02-24 02:00:10,029: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:00:10.050210531Z [2024-02-24 02:00:10,049: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:00:10.053536265Z [2024-02-24 02:00:10,053: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:00:10.053763000Z [2024-02-24 02:00:10,053: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:00:10.054175805Z [2024-02-24 02:00:10,053: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:00:10.054698013Z [2024-02-24 02:00:10,054: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:00:10.055928336Z [2024-02-24 02:00:10,055: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:00:10.056194710Z [2024-02-24 02:00:10,056: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:00:10.153118560Z [2024-02-24 02:00:10,152: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T01:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:00:10.702923462Z [2024-02-24 02:00:10,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e79f6c9c-a1a1-4ada-bfde-36458d1793eb] succeeded in 2.197275221999007s: None
2024-02-24T02:01:00.701038857Z [2024-02-24 02:01:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[990cc3a2-5984-4325-8019-e5ae5afd1c0b] received
2024-02-24T02:01:00.707571255Z [2024-02-24 02:01:00,707: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f924d88-84fb-4da9-a4b8-f4cdfe46d2c8] received
2024-02-24T02:01:00.709934697Z [2024-02-24 02:01:00,709: INFO/ForkPoolWorker-15] [990cc3a2-5984-4325-8019-e5ae5afd1c0b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:01:00.718635049Z [2024-02-24 02:01:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4a6e64d-9383-4afa-b6f4-0afb19534ac3] received
2024-02-24T02:01:00.726830983Z [2024-02-24 02:01:00,726: INFO/ForkPoolWorker-16] [6f924d88-84fb-4da9-a4b8-f4cdfe46d2c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:01:00.728020214Z [2024-02-24 02:01:00,727: INFO/ForkPoolWorker-1] [c4a6e64d-9383-4afa-b6f4-0afb19534ac3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:01:01.035956880Z [2024-02-24 02:01:01,031: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:01:01.047519389Z [2024-02-24 02:01:01,042: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:01:01.056046884Z [2024-02-24 02:01:01,052: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:01:01.216495480Z [2024-02-24 02:01:01,216: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:01:01.220325894Z [2024-02-24 02:01:01,219: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:01:01.243085452Z [2024-02-24 02:01:01,242: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:01:01.244845546Z [2024-02-24 02:01:01,244: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:01:01.245068173Z [2024-02-24 02:01:01,244: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:01:01.245293984Z [2024-02-24 02:01:01,245: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:01:01.245577497Z [2024-02-24 02:01:01,245: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:01:01.403653667Z [2024-02-24 02:01:01,403: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:01:02.011817316Z [2024-02-24 02:01:02,011: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6f924d88-84fb-4da9-a4b8-f4cdfe46d2c8] succeeded in 1.2911015630015754s: None
2024-02-24T02:01:02.226137027Z [2024-02-24 02:01:02,225: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:01:02.229646331Z [2024-02-24 02:01:02,229: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:01:02.249969448Z [2024-02-24 02:01:02,249: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:01:02.252175063Z [2024-02-24 02:01:02,251: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:01:02.252198622Z [2024-02-24 02:01:02,252: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:01:02.252294988Z [2024-02-24 02:01:02,252: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:01:02.252346353Z [2024-02-24 02:01:02,252: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:01:02.252600448Z [2024-02-24 02:01:02,252: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:01:02.252617903Z [2024-02-24 02:01:02,252: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:01:02.265638198Z [2024-02-24 02:01:02,265: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:01:02.268931037Z [2024-02-24 02:01:02,268: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:01:02.290096681Z [2024-02-24 02:01:02,289: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:01:02.291316413Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:01:02.291338902Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:01:02.291502543Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:01:02.291566758Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:01:02.291797784Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:01:02.291849562Z [2024-02-24 02:01:02,291: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:01:02.388495556Z [2024-02-24 02:01:02,388: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:01:02.420007941Z [2024-02-24 02:01:02,419: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:01:04.015951882Z [2024-02-24 02:01:04,015: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[990cc3a2-5984-4325-8019-e5ae5afd1c0b] succeeded in 3.3128064310003538s: None
2024-02-24T02:01:04.297767343Z [2024-02-24 02:01:04,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c4a6e64d-9383-4afa-b6f4-0afb19534ac3] succeeded in 3.5774513899996236s: None
2024-02-24T02:02:00.581930759Z [2024-02-24 02:02:00,581: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0b0f2ea-9708-43ef-8908-e05b74dc492b] received
2024-02-24T02:02:00.585264163Z [2024-02-24 02:02:00,584: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8f9b8383-eb15-41ae-b3a9-ea2d258f544d] received
2024-02-24T02:02:00.598561503Z [2024-02-24 02:02:00,598: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6323f3ec-ffdc-4c19-8e45-1365ae99e0f1] received
2024-02-24T02:02:00.601162018Z [2024-02-24 02:02:00,600: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9548d361-1554-4698-af51-8ea7cec0c1f4] received
2024-02-24T02:02:00.616520867Z [2024-02-24 02:02:00,616: INFO/ForkPoolWorker-15] [f0b0f2ea-9708-43ef-8908-e05b74dc492b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:02:00.619986054Z [2024-02-24 02:02:00,619: INFO/ForkPoolWorker-1] [6323f3ec-ffdc-4c19-8e45-1365ae99e0f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:02:00.622257875Z [2024-02-24 02:02:00,621: INFO/ForkPoolWorker-2] [9548d361-1554-4698-af51-8ea7cec0c1f4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:02:00.626419490Z [2024-02-24 02:02:00,626: INFO/ForkPoolWorker-16] [8f9b8383-eb15-41ae-b3a9-ea2d258f544d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:02:00.916886529Z [2024-02-24 02:02:00,913: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:02:00.967600712Z [2024-02-24 02:02:00,964: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:02:00.978142815Z [2024-02-24 02:02:00,974: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:02:01.020632547Z [2024-02-24 02:02:01,009: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:02:01.241932592Z [2024-02-24 02:02:01,239: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:02:01.249900307Z [2024-02-24 02:02:01,244: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:02:01.298644571Z [2024-02-24 02:02:01,298: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:02:01.304084536Z [2024-02-24 02:02:01,303: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:02:01.305687280Z [2024-02-24 02:02:01,305: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:02:01.306020627Z [2024-02-24 02:02:01,305: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:02:01.306187076Z [2024-02-24 02:02:01,306: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:02:01.306601580Z [2024-02-24 02:02:01,306: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:02:01.415703830Z [2024-02-24 02:02:01,415: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:02:01.850081194Z [2024-02-24 02:02:01,849: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f0b0f2ea-9708-43ef-8908-e05b74dc492b] succeeded in 1.2629164979989582s: None
2024-02-24T02:02:02.041890260Z [2024-02-24 02:02:02,041: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6323f3ec-ffdc-4c19-8e45-1365ae99e0f1] succeeded in 1.4333500789998652s: None
2024-02-24T02:02:02.274972404Z [2024-02-24 02:02:02,274: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:02:02.278592895Z [2024-02-24 02:02:02,278: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:02:02.295371689Z [2024-02-24 02:02:02,295: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:02:02.296316280Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:02:02.296344059Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:02:02.296466640Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:02:02.296495049Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:02:02.296766442Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:02:02.296808854Z [2024-02-24 02:02:02,296: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:02:02.384524975Z [2024-02-24 02:02:02,383: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:02:02.483759864Z [2024-02-24 02:02:02,483: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:02:02.487204558Z [2024-02-24 02:02:02,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:02:02.519356466Z [2024-02-24 02:02:02,519: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:02:02.520465532Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:02:02.520542858Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:02:02.520572874Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:02:02.520643073Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:02:02.520901933Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:02:02.520906942Z [2024-02-24 02:02:02,520: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:02:02.599570705Z [2024-02-24 02:02:02,599: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:02:03.972492419Z [2024-02-24 02:02:03,972: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9548d361-1554-4698-af51-8ea7cec0c1f4] succeeded in 3.3629093090003153s: None
2024-02-24T02:02:04.559825585Z [2024-02-24 02:02:04,559: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8f9b8383-eb15-41ae-b3a9-ea2d258f544d] succeeded in 3.959782676998657s: None
2024-02-24T02:03:01.030950952Z [2024-02-24 02:03:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f94caa2e-a67b-4b94-b4b2-6be6707b152e] received
2024-02-24T02:03:01.032615504Z [2024-02-24 02:03:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73849494-97a4-48e8-8bbd-63563fbb3a88] received
2024-02-24T02:03:01.035706999Z [2024-02-24 02:03:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e9e658fc-3cd2-4337-b5e5-4c8b104e5d03] received
2024-02-24T02:03:01.044129410Z [2024-02-24 02:03:01,043: INFO/ForkPoolWorker-15] [f94caa2e-a67b-4b94-b4b2-6be6707b152e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:03:01.053548240Z [2024-02-24 02:03:01,053: INFO/ForkPoolWorker-1] [e9e658fc-3cd2-4337-b5e5-4c8b104e5d03] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:03:01.054156187Z [2024-02-24 02:03:01,053: INFO/ForkPoolWorker-16] [73849494-97a4-48e8-8bbd-63563fbb3a88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:03:01.475659112Z [2024-02-24 02:03:01,469: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:03:01.508321461Z [2024-02-24 02:03:01,504: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:03:01.542122638Z [2024-02-24 02:03:01,538: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:03:01.719603043Z [2024-02-24 02:03:01,719: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:03:01.724001757Z [2024-02-24 02:03:01,723: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:03:01.744529402Z [2024-02-24 02:03:01,744: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:03:01.745987356Z [2024-02-24 02:03:01,745: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:03:01.746251638Z [2024-02-24 02:03:01,746: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:03:01.746648801Z [2024-02-24 02:03:01,746: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:03:01.747163141Z [2024-02-24 02:03:01,747: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:03:01.839205558Z [2024-02-24 02:03:01,838: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:03:02.556130481Z [2024-02-24 02:03:02,555: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e9e658fc-3cd2-4337-b5e5-4c8b104e5d03] succeeded in 1.5150521929990646s: None
2024-02-24T02:03:02.740607918Z [2024-02-24 02:03:02,740: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:03:02.744182098Z [2024-02-24 02:03:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:03:02.780604684Z [2024-02-24 02:03:02,780: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:03:02.786690742Z [2024-02-24 02:03:02,785: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:03:02.806362679Z [2024-02-24 02:03:02,806: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:03:02.807606651Z [2024-02-24 02:03:02,807: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:03:02.807740482Z [2024-02-24 02:03:02,807: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:03:02.808352968Z [2024-02-24 02:03:02,807: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:03:02.808547362Z [2024-02-24 02:03:02,808: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:03:02.808866608Z [2024-02-24 02:03:02,808: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:03:02.809431583Z [2024-02-24 02:03:02,809: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:03:02.810103018Z [2024-02-24 02:03:02,808: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:03:02.811960438Z [2024-02-24 02:03:02,811: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:03:02.812086922Z [2024-02-24 02:03:02,811: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:03:02.812264239Z [2024-02-24 02:03:02,812: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:03:02.812375810Z [2024-02-24 02:03:02,812: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:03:02.812700788Z [2024-02-24 02:03:02,812: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:03:02.812850280Z [2024-02-24 02:03:02,812: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:03:02.932553681Z [2024-02-24 02:03:02,932: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:03:02.946419317Z [2024-02-24 02:03:02,946: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:03:04.483292306Z [2024-02-24 02:03:04,482: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73849494-97a4-48e8-8bbd-63563fbb3a88] succeeded in 3.4491736149993812s: None
2024-02-24T02:03:04.726362527Z [2024-02-24 02:03:04,725: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f94caa2e-a67b-4b94-b4b2-6be6707b152e] succeeded in 3.691551640000398s: None
2024-02-24T02:04:01.337554628Z [2024-02-24 02:04:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3e0d23fc-0058-4da6-a21d-a33e72650e42] received
2024-02-24T02:04:01.340150496Z [2024-02-24 02:04:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff78ff8a-71d7-4414-9ff2-3d9b722e0942] received
2024-02-24T02:04:01.348031882Z [2024-02-24 02:04:01,346: INFO/ForkPoolWorker-16] [ff78ff8a-71d7-4414-9ff2-3d9b722e0942] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:04:01.350876773Z [2024-02-24 02:04:01,350: INFO/ForkPoolWorker-15] [3e0d23fc-0058-4da6-a21d-a33e72650e42] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:04:01.357706642Z [2024-02-24 02:04:01,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e80d8fdf-a0e3-4a97-baf3-c578571409b4] received
2024-02-24T02:04:01.361428483Z [2024-02-24 02:04:01,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ef75871-8a78-40a1-bb05-f6ca08e872d6] received
2024-02-24T02:04:01.364816644Z [2024-02-24 02:04:01,364: INFO/ForkPoolWorker-1] [e80d8fdf-a0e3-4a97-baf3-c578571409b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:04:01.371334120Z [2024-02-24 02:04:01,371: INFO/ForkPoolWorker-2] [6ef75871-8a78-40a1-bb05-f6ca08e872d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:04:01.699968923Z [2024-02-24 02:04:01,695: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:04:01.767617809Z [2024-02-24 02:04:01,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:04:01.772819706Z [2024-02-24 02:04:01,767: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:04:01.783931517Z [2024-02-24 02:04:01,780: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:04:01.992095527Z [2024-02-24 02:04:01,991: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:04:01.996031244Z [2024-02-24 02:04:01,995: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:04:02.017417652Z [2024-02-24 02:04:02,017: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:04:02.043183663Z [2024-02-24 02:04:02,042: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:04:02.044311832Z [2024-02-24 02:04:02,044: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:04:02.044357187Z [2024-02-24 02:04:02,044: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:04:02.044425124Z [2024-02-24 02:04:02,044: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:04:02.046197228Z [2024-02-24 02:04:02,045: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:04:02.219092618Z [2024-02-24 02:04:02,218: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:04:02.681915802Z [2024-02-24 02:04:02,677: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3e0d23fc-0058-4da6-a21d-a33e72650e42] succeeded in 1.3370714699995006s: None
2024-02-24T02:04:03.019446160Z [2024-02-24 02:04:03,018: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff78ff8a-71d7-4414-9ff2-3d9b722e0942] succeeded in 1.677176701999997s: None
2024-02-24T02:04:03.234808638Z [2024-02-24 02:04:03,234: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:04:03.238191447Z [2024-02-24 02:04:03,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:04:03.262088059Z [2024-02-24 02:04:03,261: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:04:03.263978949Z [2024-02-24 02:04:03,263: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:04:03.264156225Z [2024-02-24 02:04:03,263: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:04:03.264427853Z [2024-02-24 02:04:03,264: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:04:03.264595262Z [2024-02-24 02:04:03,264: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:04:03.265025743Z [2024-02-24 02:04:03,264: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:04:03.265251092Z [2024-02-24 02:04:03,264: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:04:03.334838567Z [2024-02-24 02:04:03,334: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:04:03.338092755Z [2024-02-24 02:04:03,337: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:04:03.375288137Z [2024-02-24 02:04:03,375: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:04:03.386175659Z [2024-02-24 02:04:03,376: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:04:03.386201985Z [2024-02-24 02:04:03,376: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:04:03.386206648Z [2024-02-24 02:04:03,376: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:04:03.386210730Z [2024-02-24 02:04:03,377: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:04:03.386213971Z [2024-02-24 02:04:03,377: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:04:03.386217318Z [2024-02-24 02:04:03,377: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:04:03.394984753Z [2024-02-24 02:04:03,394: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:04:03.484622100Z [2024-02-24 02:04:03,484: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:04:05.194495056Z [2024-02-24 02:04:05,193: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e80d8fdf-a0e3-4a97-baf3-c578571409b4] succeeded in 3.8348912310011656s: None
2024-02-24T02:04:06.497963078Z [2024-02-24 02:04:06,497: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6ef75871-8a78-40a1-bb05-f6ca08e872d6] succeeded in 5.1320031189989095s: None
2024-02-24T02:05:00.551855341Z [2024-02-24 02:05:00,551: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[629f68bd-c4f6-4821-84e8-433093bc26fe] received
2024-02-24T02:05:00.554419656Z [2024-02-24 02:05:00,554: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[34b02159-3a47-49db-a854-b8216f52b107] received
2024-02-24T02:05:00.560659700Z [2024-02-24 02:05:00,560: INFO/ForkPoolWorker-15] [629f68bd-c4f6-4821-84e8-433093bc26fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:05:00.563297116Z [2024-02-24 02:05:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[732c2616-c4d0-43be-a770-67833f5fddc1] received
2024-02-24T02:05:00.571328216Z [2024-02-24 02:05:00,570: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3801276-b895-4d40-b2b2-9507dab220a0] received
2024-02-24T02:05:00.581880123Z [2024-02-24 02:05:00,581: INFO/ForkPoolWorker-16] [34b02159-3a47-49db-a854-b8216f52b107] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:05:00.582134278Z [2024-02-24 02:05:00,581: INFO/ForkPoolWorker-2] [d3801276-b895-4d40-b2b2-9507dab220a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:05:00.592091811Z [2024-02-24 02:05:00,591: INFO/ForkPoolWorker-1] [732c2616-c4d0-43be-a770-67833f5fddc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:05:00.862625960Z [2024-02-24 02:05:00,859: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:05:00.930202808Z [2024-02-24 02:05:00,927: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:05:00.947032441Z [2024-02-24 02:05:00,943: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:05:00.992645760Z [2024-02-24 02:05:00,988: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:05:01.121632948Z [2024-02-24 02:05:01,121: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:05:01.125865880Z [2024-02-24 02:05:01,125: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:01.186698723Z [2024-02-24 02:05:01,186: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:05:01.189378348Z [2024-02-24 02:05:01,189: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:05:01.189571101Z [2024-02-24 02:05:01,189: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:05:01.189941983Z [2024-02-24 02:05:01,189: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:05:01.190190187Z [2024-02-24 02:05:01,190: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:05:01.339783117Z [2024-02-24 02:05:01,339: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:01.971008486Z [2024-02-24 02:05:01,970: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[732c2616-c4d0-43be-a770-67833f5fddc1] succeeded in 1.4001872040007584s: None
2024-02-24T02:05:02.252968897Z [2024-02-24 02:05:02,252: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:05:02.256377951Z [2024-02-24 02:05:02,255: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:02.261525772Z [2024-02-24 02:05:02,261: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:05:02.265091921Z [2024-02-24 02:05:02,264: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:02.276331217Z [2024-02-24 02:05:02,276: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:05:02.277911320Z [2024-02-24 02:05:02,277: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:02.277935949Z [2024-02-24 02:05:02,277: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:02.278076843Z [2024-02-24 02:05:02,277: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:02.278109164Z [2024-02-24 02:05:02,278: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:05:02.278374456Z [2024-02-24 02:05:02,278: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:05:02.278395763Z [2024-02-24 02:05:02,278: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:02.285504653Z [2024-02-24 02:05:02,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:05:02.289195770Z [2024-02-24 02:05:02,288: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:02.289338169Z [2024-02-24 02:05:02,289: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:02.289571764Z [2024-02-24 02:05:02,289: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:02.289702964Z [2024-02-24 02:05:02,289: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:05:02.290079970Z [2024-02-24 02:05:02,289: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:05:02.290212729Z [2024-02-24 02:05:02,290: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:02.356820048Z [2024-02-24 02:05:02,356: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:02.413884495Z [2024-02-24 02:05:02,402: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:02.413906676Z [2024-02-24 02:05:02,404: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:05:02.414485911Z [2024-02-24 02:05:02,414: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:02.483545066Z [2024-02-24 02:05:02,483: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:05:02.486772494Z [2024-02-24 02:05:02,486: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:02.487793209Z [2024-02-24 02:05:02,487: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:02.487994427Z [2024-02-24 02:05:02,487: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:02.488113646Z [2024-02-24 02:05:02,488: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:05:02.492405715Z [2024-02-24 02:05:02,488: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:05:02.492674913Z [2024-02-24 02:05:02,492: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:02.606431791Z [2024-02-24 02:05:02,606: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:03.111331341Z [2024-02-24 02:05:03,110: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[629f68bd-c4f6-4821-84e8-433093bc26fe] succeeded in 2.5571642619997874s: None
2024-02-24T02:05:03.729765500Z [2024-02-24 02:05:03,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70210b4b-05a9-45b2-ace7-e6eb2243942d] received
2024-02-24T02:05:03.749212102Z [2024-02-24 02:05:03,748: INFO/ForkPoolWorker-15] [70210b4b-05a9-45b2-ace7-e6eb2243942d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:05:04.019155685Z [2024-02-24 02:05:04,016: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:05:04.327395009Z [2024-02-24 02:05:04,326: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d3801276-b895-4d40-b2b2-9507dab220a0] succeeded in 3.7530077190003794s: None
2024-02-24T02:05:04.625660433Z [2024-02-24 02:05:04,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[34b02159-3a47-49db-a854-b8216f52b107] succeeded in 4.067084743999658s: None
2024-02-24T02:05:05.220776437Z [2024-02-24 02:05:05,220: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:05:05.224304310Z [2024-02-24 02:05:05,223: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:05.244799642Z [2024-02-24 02:05:05,244: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:05:05.246975195Z [2024-02-24 02:05:05,246: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:05.247339001Z [2024-02-24 02:05:05,247: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:05.247642575Z [2024-02-24 02:05:05,247: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:05.247965964Z [2024-02-24 02:05:05,247: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:05:05.248701066Z [2024-02-24 02:05:05,248: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:05:05.249292707Z [2024-02-24 02:05:05,249: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:05.344033170Z [2024-02-24 02:05:05,343: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:06.071300221Z [2024-02-24 02:05:06,070: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[70210b4b-05a9-45b2-ace7-e6eb2243942d] succeeded in 2.334418389000348s: None
2024-02-24T02:05:06.295230570Z [2024-02-24 02:05:06,294: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e0b03ce4-34c8-487d-8c7e-78a07b1432c8] received
2024-02-24T02:05:06.309326199Z [2024-02-24 02:05:06,308: INFO/ForkPoolWorker-15] [e0b03ce4-34c8-487d-8c7e-78a07b1432c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:05:06.654490616Z [2024-02-24 02:05:06,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:05:07.848179357Z [2024-02-24 02:05:07,847: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:05:07.851456720Z [2024-02-24 02:05:07,851: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:07.870531400Z [2024-02-24 02:05:07,870: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:05:07.871861915Z [2024-02-24 02:05:07,871: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:07.871882924Z [2024-02-24 02:05:07,871: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:07.872048604Z [2024-02-24 02:05:07,871: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:07.872089718Z [2024-02-24 02:05:07,871: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:05:07.872520566Z [2024-02-24 02:05:07,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:05:07.872529793Z [2024-02-24 02:05:07,872: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:07.960675115Z [2024-02-24 02:05:07,960: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:08.575162479Z [2024-02-24 02:05:08,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e0b03ce4-34c8-487d-8c7e-78a07b1432c8] succeeded in 2.274095522998323s: None
2024-02-24T02:05:08.702595463Z [2024-02-24 02:05:08,702: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aecd442b-a1ac-4fc0-ba12-8aa8d2b2a309] received
2024-02-24T02:05:08.712277249Z [2024-02-24 02:05:08,711: INFO/ForkPoolWorker-15] [aecd442b-a1ac-4fc0-ba12-8aa8d2b2a309] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:05:08.984171062Z [2024-02-24 02:05:08,980: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:05:10.055364507Z [2024-02-24 02:05:10,054: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:05:10.058798178Z [2024-02-24 02:05:10,058: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:05:10.081893466Z [2024-02-24 02:05:10,081: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:05:10.083776426Z [2024-02-24 02:05:10,083: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:05:10.083907500Z [2024-02-24 02:05:10,083: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:05:10.084304833Z [2024-02-24 02:05:10,084: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:05:10.084461663Z [2024-02-24 02:05:10,084: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:05:10.085300181Z [2024-02-24 02:05:10,084: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:05:10.085331859Z [2024-02-24 02:05:10,084: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:05:10.176548462Z [2024-02-24 02:05:10,176: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:05:10.822136922Z [2024-02-24 02:05:10,821: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aecd442b-a1ac-4fc0-ba12-8aa8d2b2a309] succeeded in 2.1159379629989417s: None
2024-02-24T02:06:01.294095876Z [2024-02-24 02:06:01,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b390ccdd-1fbe-40b4-a124-40788faf6e5b] received
2024-02-24T02:06:01.297082821Z [2024-02-24 02:06:01,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1851cce5-e9d5-4d19-860c-d99ae6517b58] received
2024-02-24T02:06:01.308797238Z [2024-02-24 02:06:01,308: INFO/ForkPoolWorker-15] [b390ccdd-1fbe-40b4-a124-40788faf6e5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:06:01.310679656Z [2024-02-24 02:06:01,310: INFO/ForkPoolWorker-16] [1851cce5-e9d5-4d19-860c-d99ae6517b58] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:06:01.320456661Z [2024-02-24 02:06:01,320: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[183fa54e-134b-46e3-b3cd-0afb1ab0338e] received
2024-02-24T02:06:01.327889182Z [2024-02-24 02:06:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1cb3c164-c49a-4cb6-9d52-eb0cb2159f90] received
2024-02-24T02:06:01.338920703Z [2024-02-24 02:06:01,338: INFO/ForkPoolWorker-1] [183fa54e-134b-46e3-b3cd-0afb1ab0338e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:06:01.344523326Z [2024-02-24 02:06:01,344: INFO/ForkPoolWorker-2] [1cb3c164-c49a-4cb6-9d52-eb0cb2159f90] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:06:01.599236151Z [2024-02-24 02:06:01,594: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:06:01.669733634Z [2024-02-24 02:06:01,666: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:06:01.736562314Z [2024-02-24 02:06:01,730: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:06:01.775490013Z [2024-02-24 02:06:01,772: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:06:01.865160587Z [2024-02-24 02:06:01,864: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:06:01.869281466Z [2024-02-24 02:06:01,868: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:06:01.919532834Z [2024-02-24 02:06:01,919: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:06:01.922318864Z [2024-02-24 02:06:01,921: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:06:01.922643079Z [2024-02-24 02:06:01,922: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:06:01.922972200Z [2024-02-24 02:06:01,922: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:06:01.923537023Z [2024-02-24 02:06:01,923: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:06:02.055338100Z [2024-02-24 02:06:02,053: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:06:02.085522701Z [2024-02-24 02:06:02,085: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:06:02.741591008Z [2024-02-24 02:06:02,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b390ccdd-1fbe-40b4-a124-40788faf6e5b] succeeded in 1.443140573999699s: None
2024-02-24T02:06:02.862709859Z [2024-02-24 02:06:02,862: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1cb3c164-c49a-4cb6-9d52-eb0cb2159f90] succeeded in 1.5292129359986575s: None
2024-02-24T02:06:03.087452400Z [2024-02-24 02:06:03,087: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:06:03.091463161Z [2024-02-24 02:06:03,090: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:06:03.109189940Z [2024-02-24 02:06:03,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:06:03.110423781Z [2024-02-24 02:06:03,110: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:06:03.110470777Z [2024-02-24 02:06:03,110: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:06:03.110615628Z [2024-02-24 02:06:03,110: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:06:03.110692974Z [2024-02-24 02:06:03,110: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:06:03.111079569Z [2024-02-24 02:06:03,110: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:06:03.111208119Z [2024-02-24 02:06:03,111: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:06:03.206538137Z [2024-02-24 02:06:03,206: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:06:03.447080944Z [2024-02-24 02:06:03,446: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:06:03.450314581Z [2024-02-24 02:06:03,449: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:06:03.479322925Z [2024-02-24 02:06:03,479: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:06:03.480790912Z [2024-02-24 02:06:03,480: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:06:03.480810968Z [2024-02-24 02:06:03,480: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:06:03.481067176Z [2024-02-24 02:06:03,480: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:06:03.481075419Z [2024-02-24 02:06:03,480: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:06:03.481368907Z [2024-02-24 02:06:03,481: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:06:03.481416583Z [2024-02-24 02:06:03,481: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:06:03.572122132Z [2024-02-24 02:06:03,571: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:06:05.933450668Z [2024-02-24 02:06:05,932: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[183fa54e-134b-46e3-b3cd-0afb1ab0338e] succeeded in 4.610252993999893s: None
2024-02-24T02:06:06.100695711Z [2024-02-24 02:06:06,100: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1851cce5-e9d5-4d19-860c-d99ae6517b58] succeeded in 4.802268965000621s: None
2024-02-24T02:07:00.395109769Z [2024-02-24 02:07:00,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a385d26-6e25-4931-b0bb-9c1b8feb7bed] received
2024-02-24T02:07:00.396432932Z [2024-02-24 02:07:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9a002a0b-ca55-499e-bee3-ee7f921c3581] received
2024-02-24T02:07:00.398549462Z [2024-02-24 02:07:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f564eeb-9cb9-4ea9-890b-9f23b2827c64] received
2024-02-24T02:07:00.402898484Z [2024-02-24 02:07:00,402: INFO/ForkPoolWorker-15] [8a385d26-6e25-4931-b0bb-9c1b8feb7bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:07:00.403399662Z [2024-02-24 02:07:00,402: INFO/ForkPoolWorker-16] [9a002a0b-ca55-499e-bee3-ee7f921c3581] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:07:00.404663259Z [2024-02-24 02:07:00,404: INFO/ForkPoolWorker-1] [7f564eeb-9cb9-4ea9-890b-9f23b2827c64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:07:00.693374486Z [2024-02-24 02:07:00,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:07:00.715091355Z [2024-02-24 02:07:00,711: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:07:00.790353380Z [2024-02-24 02:07:00,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:07:00.867567061Z [2024-02-24 02:07:00,861: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:07:00.871352600Z [2024-02-24 02:07:00,870: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:07:00.914863044Z [2024-02-24 02:07:00,914: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:07:00.918883732Z [2024-02-24 02:07:00,918: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:07:00.918973637Z [2024-02-24 02:07:00,918: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:07:00.919112292Z [2024-02-24 02:07:00,918: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:07:00.919507159Z [2024-02-24 02:07:00,919: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:07:01.064181687Z [2024-02-24 02:07:01,063: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:07:01.711974951Z [2024-02-24 02:07:01,711: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9a002a0b-ca55-499e-bee3-ee7f921c3581] succeeded in 1.3142999640003836s: None
2024-02-24T02:07:02.045909670Z [2024-02-24 02:07:02,045: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:07:02.049351812Z [2024-02-24 02:07:02,048: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:07:02.049541618Z [2024-02-24 02:07:02,049: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:07:02.052964103Z [2024-02-24 02:07:02,052: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:07:02.069924159Z [2024-02-24 02:07:02,069: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:07:02.069970189Z [2024-02-24 02:07:02,069: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:07:02.071575425Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:07:02.071592324Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:07:02.071617753Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:07:02.071721769Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:07:02.071738092Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:07:02.071847520Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:07:02.072038244Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:07:02.072047465Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:07:02.072186820Z [2024-02-24 02:07:02,071: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:07:02.072389472Z [2024-02-24 02:07:02,072: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:07:02.072697150Z [2024-02-24 02:07:02,072: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:07:02.072867739Z [2024-02-24 02:07:02,072: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:07:02.148459854Z [2024-02-24 02:07:02,148: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:07:02.155406288Z [2024-02-24 02:07:02,155: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:07:03.928470409Z [2024-02-24 02:07:03,928: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f564eeb-9cb9-4ea9-890b-9f23b2827c64] succeeded in 3.528676195999651s: None
2024-02-24T02:07:04.090158280Z [2024-02-24 02:07:04,089: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8a385d26-6e25-4931-b0bb-9c1b8feb7bed] succeeded in 3.691994422000789s: None
2024-02-24T02:08:00.307158089Z [2024-02-24 02:08:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b63e36-5947-4a40-b8d9-6030be117b6b] received
2024-02-24T02:08:00.312707701Z [2024-02-24 02:08:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e8e82a5-9602-4dfa-a62c-bf99c5c7d545] received
2024-02-24T02:08:00.315003651Z [2024-02-24 02:08:00,313: INFO/ForkPoolWorker-15] [c7b63e36-5947-4a40-b8d9-6030be117b6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:08:00.325436025Z [2024-02-24 02:08:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a5d0961-8fc1-4b23-bc48-2a6cfb5408e8] received
2024-02-24T02:08:00.327193908Z [2024-02-24 02:08:00,326: INFO/ForkPoolWorker-16] [6e8e82a5-9602-4dfa-a62c-bf99c5c7d545] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:08:00.331255381Z [2024-02-24 02:08:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e50cd58-e904-4e6b-aaaa-63069945c435] received
2024-02-24T02:08:00.339916988Z [2024-02-24 02:08:00,339: INFO/ForkPoolWorker-1] [0a5d0961-8fc1-4b23-bc48-2a6cfb5408e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:08:00.341268386Z [2024-02-24 02:08:00,341: INFO/ForkPoolWorker-2] [1e50cd58-e904-4e6b-aaaa-63069945c435] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:08:00.673878759Z [2024-02-24 02:08:00,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:08:00.686536563Z [2024-02-24 02:08:00,682: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:08:00.717802464Z [2024-02-24 02:08:00,714: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:08:00.800848672Z [2024-02-24 02:08:00,797: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:08:00.871256601Z [2024-02-24 02:08:00,870: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:08:00.875507718Z [2024-02-24 02:08:00,875: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:08:00.908625848Z [2024-02-24 02:08:00,908: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:08:00.910965355Z [2024-02-24 02:08:00,910: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:08:00.911415924Z [2024-02-24 02:08:00,910: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:08:00.911584488Z [2024-02-24 02:08:00,911: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:08:00.911984733Z [2024-02-24 02:08:00,911: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:08:00.973644903Z [2024-02-24 02:08:00,973: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:08:01.011900681Z [2024-02-24 02:08:01,011: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:08:01.742445627Z [2024-02-24 02:08:01,742: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c7b63e36-5947-4a40-b8d9-6030be117b6b] succeeded in 1.4333444669991877s: None
2024-02-24T02:08:01.922033209Z [2024-02-24 02:08:01,921: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1e50cd58-e904-4e6b-aaaa-63069945c435] succeeded in 1.5888856470010069s: None
2024-02-24T02:08:02.464557401Z [2024-02-24 02:08:02,464: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:08:02.468090359Z [2024-02-24 02:08:02,467: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:08:02.494825819Z [2024-02-24 02:08:02,494: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:08:02.496551755Z [2024-02-24 02:08:02,496: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:08:02.496664163Z [2024-02-24 02:08:02,496: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:08:02.496990425Z [2024-02-24 02:08:02,496: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:08:02.497138075Z [2024-02-24 02:08:02,496: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:08:02.497672715Z [2024-02-24 02:08:02,497: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:08:02.497869913Z [2024-02-24 02:08:02,497: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:08:02.522991949Z [2024-02-24 02:08:02,522: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:08:02.526332107Z [2024-02-24 02:08:02,525: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:08:02.546549562Z [2024-02-24 02:08:02,546: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:08:02.548022755Z [2024-02-24 02:08:02,547: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:08:02.548226533Z [2024-02-24 02:08:02,548: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:08:02.548466530Z [2024-02-24 02:08:02,548: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:08:02.548646100Z [2024-02-24 02:08:02,548: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:08:02.549138758Z [2024-02-24 02:08:02,548: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:08:02.549336453Z [2024-02-24 02:08:02,549: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:08:02.608919330Z [2024-02-24 02:08:02,608: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:08:02.644619795Z [2024-02-24 02:08:02,643: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:08:04.246456503Z [2024-02-24 02:08:04,246: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a5d0961-8fc1-4b23-bc48-2a6cfb5408e8] succeeded in 3.918613441999696s: None
2024-02-24T02:08:04.758948111Z [2024-02-24 02:08:04,758: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e8e82a5-9602-4dfa-a62c-bf99c5c7d545] succeeded in 4.441917060999913s: None
2024-02-24T02:09:00.306717076Z [2024-02-24 02:09:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25af9536-114b-482f-bf13-4f3cc4fa9cc2] received
2024-02-24T02:09:00.311910987Z [2024-02-24 02:09:00,311: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e9508f6-1fd5-4d54-9d5e-3f4c1b00174b] received
2024-02-24T02:09:00.314777067Z [2024-02-24 02:09:00,314: INFO/ForkPoolWorker-15] [25af9536-114b-482f-bf13-4f3cc4fa9cc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:09:00.317426275Z [2024-02-24 02:09:00,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04ee5816-df22-47c4-9c2d-e293f3bda736] received
2024-02-24T02:09:00.320553204Z [2024-02-24 02:09:00,320: INFO/ForkPoolWorker-16] [0e9508f6-1fd5-4d54-9d5e-3f4c1b00174b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:09:00.331236348Z [2024-02-24 02:09:00,330: INFO/ForkPoolWorker-1] [04ee5816-df22-47c4-9c2d-e293f3bda736] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:09:00.604343069Z [2024-02-24 02:09:00,601: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:09:00.640327077Z [2024-02-24 02:09:00,637: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:09:00.680269307Z [2024-02-24 02:09:00,676: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:09:00.805723386Z [2024-02-24 02:09:00,805: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:09:00.810039099Z [2024-02-24 02:09:00,809: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:09:00.845478807Z [2024-02-24 02:09:00,845: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:09:00.847819231Z [2024-02-24 02:09:00,847: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:09:00.848003466Z [2024-02-24 02:09:00,847: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:09:00.848084778Z [2024-02-24 02:09:00,847: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:09:00.848401583Z [2024-02-24 02:09:00,848: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:09:00.973160331Z [2024-02-24 02:09:00,972: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:09:01.732361287Z [2024-02-24 02:09:01,728: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04ee5816-df22-47c4-9c2d-e293f3bda736] succeeded in 1.4090555869988748s: None
2024-02-24T02:09:01.935019112Z [2024-02-24 02:09:01,934: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:09:01.938651033Z [2024-02-24 02:09:01,938: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:09:01.964596669Z [2024-02-24 02:09:01,964: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:09:01.966630956Z [2024-02-24 02:09:01,966: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:09:01.966930576Z [2024-02-24 02:09:01,966: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:09:01.967161701Z [2024-02-24 02:09:01,966: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:09:01.967310170Z [2024-02-24 02:09:01,967: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:09:01.967764112Z [2024-02-24 02:09:01,967: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:09:01.967897380Z [2024-02-24 02:09:01,967: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:09:01.970985362Z [2024-02-24 02:09:01,970: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:09:01.975033873Z [2024-02-24 02:09:01,974: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:09:02.007946364Z [2024-02-24 02:09:02,007: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:09:02.009165315Z [2024-02-24 02:09:02,008: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:09:02.009179505Z [2024-02-24 02:09:02,009: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:09:02.009262482Z [2024-02-24 02:09:02,009: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:09:02.009324367Z [2024-02-24 02:09:02,009: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:09:02.009665663Z [2024-02-24 02:09:02,009: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:09:02.009768226Z [2024-02-24 02:09:02,009: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:09:02.075045216Z [2024-02-24 02:09:02,074: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:09:02.099477677Z [2024-02-24 02:09:02,099: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:09:03.639331975Z [2024-02-24 02:09:03,638: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e9508f6-1fd5-4d54-9d5e-3f4c1b00174b] succeeded in 3.325445935000971s: None
2024-02-24T02:09:04.307086478Z [2024-02-24 02:09:04,306: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25af9536-114b-482f-bf13-4f3cc4fa9cc2] succeeded in 3.9981221220004954s: None
2024-02-24T02:10:00.297962993Z [2024-02-24 02:10:00,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[592b4bae-4a8d-455e-9186-215d6cce7542] received
2024-02-24T02:10:00.301402234Z [2024-02-24 02:10:00,301: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0302342-747f-4fb5-908a-643fbae9e7e0] received
2024-02-24T02:10:00.316160150Z [2024-02-24 02:10:00,315: INFO/ForkPoolWorker-16] [f0302342-747f-4fb5-908a-643fbae9e7e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:10:00.319509628Z [2024-02-24 02:10:00,319: INFO/ForkPoolWorker-15] [592b4bae-4a8d-455e-9186-215d6cce7542] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:10:00.325197042Z [2024-02-24 02:10:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06abb934-60d7-424f-a7f4-09149407f1f0] received
2024-02-24T02:10:00.332502146Z [2024-02-24 02:10:00,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[455d4635-aa56-46a3-a8e2-810c7f9de390] received
2024-02-24T02:10:00.334468275Z [2024-02-24 02:10:00,332: INFO/ForkPoolWorker-1] [06abb934-60d7-424f-a7f4-09149407f1f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:10:00.335400222Z [2024-02-24 02:10:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c87b5f13-f125-4f83-bfb9-88416a623e8b] received
2024-02-24T02:10:00.350380312Z [2024-02-24 02:10:00,350: INFO/ForkPoolWorker-2] [455d4635-aa56-46a3-a8e2-810c7f9de390] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:10:00.362620403Z [2024-02-24 02:10:00,362: INFO/ForkPoolWorker-3] [c87b5f13-f125-4f83-bfb9-88416a623e8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:10:00.631520965Z [2024-02-24 02:10:00,628: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:10:00.641350477Z [2024-02-24 02:10:00,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:10:00.651602871Z [2024-02-24 02:10:00,648: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:10:00.862764895Z [2024-02-24 02:10:00,859: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:10:00.923546374Z [2024-02-24 02:10:00,919: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:10:00.942764221Z [2024-02-24 02:10:00,942: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:01.378754956Z [2024-02-24 02:10:01,374: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:10:01.385362439Z [2024-02-24 02:10:01,382: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:01.445525606Z [2024-02-24 02:10:01,445: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:10:01.447070785Z [2024-02-24 02:10:01,446: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:10:01.447213203Z [2024-02-24 02:10:01,447: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:10:01.447288851Z [2024-02-24 02:10:01,447: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:10:01.447541902Z [2024-02-24 02:10:01,447: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:10:01.599433635Z [2024-02-24 02:10:01,599: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:01.846977288Z [2024-02-24 02:10:01,846: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0302342-747f-4fb5-908a-643fbae9e7e0] succeeded in 1.5431873540001106s: None
2024-02-24T02:10:02.241874554Z [2024-02-24 02:10:02,241: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:10:02.257308264Z [2024-02-24 02:10:02,256: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:02.298728869Z [2024-02-24 02:10:02,298: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:10:02.300231580Z [2024-02-24 02:10:02,299: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:02.300428469Z [2024-02-24 02:10:02,300: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:02.300701935Z [2024-02-24 02:10:02,300: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:02.300852821Z [2024-02-24 02:10:02,300: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:10:02.301208381Z [2024-02-24 02:10:02,301: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:10:02.301347920Z [2024-02-24 02:10:02,301: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:02.391959578Z [2024-02-24 02:10:02,390: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[06abb934-60d7-424f-a7f4-09149407f1f0] succeeded in 2.0618459790002817s: None
2024-02-24T02:10:02.457550948Z [2024-02-24 02:10:02,457: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:02.495733058Z [2024-02-24 02:10:02,495: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T02:10:02.499307912Z [2024-02-24 02:10:02,498: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:02.524359785Z [2024-02-24 02:10:02,524: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T02:10:02.526232756Z [2024-02-24 02:10:02,525: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:02.526249246Z [2024-02-24 02:10:02,526: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:02.526523116Z [2024-02-24 02:10:02,526: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:02.526751878Z [2024-02-24 02:10:02,526: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T02:10:02.527127568Z [2024-02-24 02:10:02,526: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:10:02.527313887Z [2024-02-24 02:10:02,527: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:02.621431964Z [2024-02-24 02:10:02,620: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:02.647427480Z [2024-02-24 02:10:02,647: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:10:02.652775807Z [2024-02-24 02:10:02,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:02.712538131Z [2024-02-24 02:10:02,712: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:10:02.714585389Z [2024-02-24 02:10:02,714: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:02.714813898Z [2024-02-24 02:10:02,714: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:02.715010114Z [2024-02-24 02:10:02,714: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:02.715125484Z [2024-02-24 02:10:02,714: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:10:02.715562626Z [2024-02-24 02:10:02,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:10:02.715694939Z [2024-02-24 02:10:02,715: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:02.854570957Z [2024-02-24 02:10:02,852: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:03.631780687Z [2024-02-24 02:10:03,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[592b4bae-4a8d-455e-9186-215d6cce7542] succeeded in 3.3313012510006956s: None
2024-02-24T02:10:04.150467006Z [2024-02-24 02:10:04,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec5c260a-0948-4774-9a3b-2523e2155837] received
2024-02-24T02:10:04.160797489Z [2024-02-24 02:10:04,160: INFO/ForkPoolWorker-15] [ec5c260a-0948-4774-9a3b-2523e2155837] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:10:04.365082454Z [2024-02-24 02:10:04,364: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c87b5f13-f125-4f83-bfb9-88416a623e8b] succeeded in 4.024885040000299s: None
2024-02-24T02:10:04.476341205Z [2024-02-24 02:10:04,473: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:10:04.626706612Z [2024-02-24 02:10:04,626: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[455d4635-aa56-46a3-a8e2-810c7f9de390] succeeded in 4.292839443000048s: None
2024-02-24T02:10:05.690368628Z [2024-02-24 02:10:05,689: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:10:05.694040157Z [2024-02-24 02:10:05,693: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:05.713570654Z [2024-02-24 02:10:05,713: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:10:05.714866106Z [2024-02-24 02:10:05,714: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:05.714968391Z [2024-02-24 02:10:05,714: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:05.715154665Z [2024-02-24 02:10:05,714: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:05.715232469Z [2024-02-24 02:10:05,715: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:10:05.715536216Z [2024-02-24 02:10:05,715: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:10:05.715630187Z [2024-02-24 02:10:05,715: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:05.802303785Z [2024-02-24 02:10:05,802: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:06.487998205Z [2024-02-24 02:10:06,487: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec5c260a-0948-4774-9a3b-2523e2155837] succeeded in 2.335024832000272s: None
2024-02-24T02:10:07.182591314Z [2024-02-24 02:10:07,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[188786a0-d004-4982-b688-7aeed6923ff6] received
2024-02-24T02:10:07.190204832Z [2024-02-24 02:10:07,189: INFO/ForkPoolWorker-15] [188786a0-d004-4982-b688-7aeed6923ff6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:10:07.467309835Z [2024-02-24 02:10:07,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:10:08.521151470Z [2024-02-24 02:10:08,520: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:10:08.524687606Z [2024-02-24 02:10:08,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:08.547947577Z [2024-02-24 02:10:08,547: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:10:08.549453281Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:08.549468735Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:08.549627923Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:08.549669126Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:10:08.549997327Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:10:08.550130548Z [2024-02-24 02:10:08,549: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:08.661244759Z [2024-02-24 02:10:08,660: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:09.236398696Z [2024-02-24 02:10:09,235: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[188786a0-d004-4982-b688-7aeed6923ff6] succeeded in 2.0510320870016585s: None
2024-02-24T02:10:09.334177384Z [2024-02-24 02:10:09,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f238a87-181e-4857-ad60-5c0afd511f20] received
2024-02-24T02:10:09.346522627Z [2024-02-24 02:10:09,346: INFO/ForkPoolWorker-15] [2f238a87-181e-4857-ad60-5c0afd511f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:10:09.605099767Z [2024-02-24 02:10:09,602: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:10:10.656648012Z [2024-02-24 02:10:10,656: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:10:10.659662456Z [2024-02-24 02:10:10,659: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:10:10.681503387Z [2024-02-24 02:10:10,681: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:10:10.682932598Z [2024-02-24 02:10:10,682: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:10:10.682957679Z [2024-02-24 02:10:10,682: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:10:10.683062714Z [2024-02-24 02:10:10,682: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:10:10.683080487Z [2024-02-24 02:10:10,683: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:10:10.683410119Z [2024-02-24 02:10:10,683: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:10:10.683560522Z [2024-02-24 02:10:10,683: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:10:10.762149278Z [2024-02-24 02:10:10,761: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:10:11.366861430Z [2024-02-24 02:10:11,366: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2f238a87-181e-4857-ad60-5c0afd511f20] succeeded in 2.031261510999684s: None
2024-02-24T02:11:00.455890241Z [2024-02-24 02:11:00,455: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6816a4b2-57b8-4b92-8281-84e017ead44b] received
2024-02-24T02:11:00.457935699Z [2024-02-24 02:11:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d6e2a33-d10d-4f69-8b9a-a4a405b3b640] received
2024-02-24T02:11:00.461607122Z [2024-02-24 02:11:00,461: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13a9ee9a-d7f8-4b22-ab56-5c89783dad56] received
2024-02-24T02:11:00.469820765Z [2024-02-24 02:11:00,469: INFO/ForkPoolWorker-1] [13a9ee9a-d7f8-4b22-ab56-5c89783dad56] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:11:00.473116781Z [2024-02-24 02:11:00,472: INFO/ForkPoolWorker-15] [6816a4b2-57b8-4b92-8281-84e017ead44b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:11:00.473669722Z [2024-02-24 02:11:00,473: INFO/ForkPoolWorker-16] [0d6e2a33-d10d-4f69-8b9a-a4a405b3b640] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:11:00.767564404Z [2024-02-24 02:11:00,764: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:11:00.821181882Z [2024-02-24 02:11:00,818: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:11:00.823159063Z [2024-02-24 02:11:00,820: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:11:00.919070307Z [2024-02-24 02:11:00,918: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:11:00.923249130Z [2024-02-24 02:11:00,922: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:11:00.942606871Z [2024-02-24 02:11:00,942: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:11:00.943832559Z [2024-02-24 02:11:00,943: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:11:00.944000536Z [2024-02-24 02:11:00,943: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:11:00.944139553Z [2024-02-24 02:11:00,944: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:11:00.944411611Z [2024-02-24 02:11:00,944: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:11:01.051452388Z [2024-02-24 02:11:01,051: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:11:01.674472245Z [2024-02-24 02:11:01,673: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0d6e2a33-d10d-4f69-8b9a-a4a405b3b640] succeeded in 1.2139855900004477s: None
2024-02-24T02:11:02.114235120Z [2024-02-24 02:11:02,113: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:11:02.117449493Z [2024-02-24 02:11:02,116: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:11:02.120223748Z [2024-02-24 02:11:02,119: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:11:02.123708791Z [2024-02-24 02:11:02,123: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:11:02.137645958Z [2024-02-24 02:11:02,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:11:02.138873559Z [2024-02-24 02:11:02,138: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:11:02.138950991Z [2024-02-24 02:11:02,138: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:11:02.139069364Z [2024-02-24 02:11:02,138: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:11:02.139112216Z [2024-02-24 02:11:02,139: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:11:02.139446769Z [2024-02-24 02:11:02,139: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:11:02.139494894Z [2024-02-24 02:11:02,139: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:11:02.147280270Z [2024-02-24 02:11:02,147: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:11:02.148604482Z [2024-02-24 02:11:02,148: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:11:02.148723527Z [2024-02-24 02:11:02,148: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:11:02.149017177Z [2024-02-24 02:11:02,148: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:11:02.149192807Z [2024-02-24 02:11:02,148: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:11:02.149541284Z [2024-02-24 02:11:02,149: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:11:02.149709767Z [2024-02-24 02:11:02,149: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:11:02.230286201Z [2024-02-24 02:11:02,229: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:11:02.247760605Z [2024-02-24 02:11:02,247: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:11:03.976624688Z [2024-02-24 02:11:03,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6816a4b2-57b8-4b92-8281-84e017ead44b] succeeded in 3.5191641929995967s: None
2024-02-24T02:11:04.302433335Z [2024-02-24 02:11:04,302: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[13a9ee9a-d7f8-4b22-ab56-5c89783dad56] succeeded in 3.8395824810013437s: None
2024-02-24T02:12:00.332233532Z [2024-02-24 02:12:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4236c495-8c98-46f3-b564-b2b88afc9b9a] received
2024-02-24T02:12:00.340335060Z [2024-02-24 02:12:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3b96b69-f54b-4fb0-b08f-3a24e7101843] received
2024-02-24T02:12:00.343362305Z [2024-02-24 02:12:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c04b491-3992-4113-87d4-256645423d59] received
2024-02-24T02:12:00.346381081Z [2024-02-24 02:12:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[185ce0d6-7f5d-47d8-bf82-a5084e9e46d0] received
2024-02-24T02:12:00.348709672Z [2024-02-24 02:12:00,348: INFO/ForkPoolWorker-15] [4236c495-8c98-46f3-b564-b2b88afc9b9a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:12:00.352845907Z [2024-02-24 02:12:00,352: INFO/ForkPoolWorker-1] [1c04b491-3992-4113-87d4-256645423d59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:12:00.353575009Z [2024-02-24 02:12:00,353: INFO/ForkPoolWorker-16] [a3b96b69-f54b-4fb0-b08f-3a24e7101843] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:12:00.354724486Z [2024-02-24 02:12:00,354: INFO/ForkPoolWorker-2] [185ce0d6-7f5d-47d8-bf82-a5084e9e46d0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:12:00.701175223Z [2024-02-24 02:12:00,697: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:12:00.748385347Z [2024-02-24 02:12:00,744: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:12:00.768376190Z [2024-02-24 02:12:00,765: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:12:00.780746005Z [2024-02-24 02:12:00,777: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:12:00.939169899Z [2024-02-24 02:12:00,938: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:12:00.943233833Z [2024-02-24 02:12:00,942: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:12:00.972812618Z [2024-02-24 02:12:00,972: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:12:00.974326262Z [2024-02-24 02:12:00,974: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:12:00.974530488Z [2024-02-24 02:12:00,974: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:12:00.974764707Z [2024-02-24 02:12:00,974: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:12:00.975034423Z [2024-02-24 02:12:00,974: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:12:01.073393125Z [2024-02-24 02:12:01,073: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:12:01.117110666Z [2024-02-24 02:12:01,116: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:12:01.856649935Z [2024-02-24 02:12:01,856: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[185ce0d6-7f5d-47d8-bf82-a5084e9e46d0] succeeded in 1.5089558660001785s: None
2024-02-24T02:12:01.869493647Z [2024-02-24 02:12:01,869: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4236c495-8c98-46f3-b564-b2b88afc9b9a] succeeded in 1.5274571509999078s: None
2024-02-24T02:12:02.207199843Z [2024-02-24 02:12:02,206: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:12:02.210611317Z [2024-02-24 02:12:02,210: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:12:02.228839095Z [2024-02-24 02:12:02,228: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:12:02.232333500Z [2024-02-24 02:12:02,231: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:12:02.234935534Z [2024-02-24 02:12:02,234: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:12:02.236624834Z [2024-02-24 02:12:02,236: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:12:02.236777795Z [2024-02-24 02:12:02,236: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:12:02.237003058Z [2024-02-24 02:12:02,236: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:12:02.237160259Z [2024-02-24 02:12:02,237: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:12:02.237485827Z [2024-02-24 02:12:02,237: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:12:02.237644864Z [2024-02-24 02:12:02,237: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:12:02.254614318Z [2024-02-24 02:12:02,254: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:12:02.255907548Z [2024-02-24 02:12:02,255: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:12:02.255979964Z [2024-02-24 02:12:02,255: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:12:02.256187425Z [2024-02-24 02:12:02,255: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:12:02.256302861Z [2024-02-24 02:12:02,256: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:12:02.256718950Z [2024-02-24 02:12:02,256: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:12:02.256850681Z [2024-02-24 02:12:02,256: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:12:02.320255903Z [2024-02-24 02:12:02,319: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:12:02.337697531Z [2024-02-24 02:12:02,337: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:12:03.852723683Z [2024-02-24 02:12:03,852: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1c04b491-3992-4113-87d4-256645423d59] succeeded in 3.507255857999553s: None
2024-02-24T02:12:04.776452967Z [2024-02-24 02:12:04,775: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3b96b69-f54b-4fb0-b08f-3a24e7101843] succeeded in 4.433499823000602s: None
2024-02-24T02:13:00.879531127Z [2024-02-24 02:13:00,879: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2883a59f-e924-4f81-9b3d-0574d5f21763] received
2024-02-24T02:13:00.888004747Z [2024-02-24 02:13:00,887: INFO/ForkPoolWorker-15] [2883a59f-e924-4f81-9b3d-0574d5f21763] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:13:00.892620400Z [2024-02-24 02:13:00,892: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ac3b5ab-a9b4-43c6-ac0a-f3791b8dcab9] received
2024-02-24T02:13:00.897114996Z [2024-02-24 02:13:00,896: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0763cfc3-55c9-4285-8906-0671a29573e8] received
2024-02-24T02:13:00.899280979Z [2024-02-24 02:13:00,899: INFO/ForkPoolWorker-16] [3ac3b5ab-a9b4-43c6-ac0a-f3791b8dcab9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:13:00.910516189Z [2024-02-24 02:13:00,910: INFO/ForkPoolWorker-1] [0763cfc3-55c9-4285-8906-0671a29573e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:13:01.256007870Z [2024-02-24 02:13:01,246: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:13:01.328603336Z [2024-02-24 02:13:01,325: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:13:01.363663687Z [2024-02-24 02:13:01,360: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:13:01.526031863Z [2024-02-24 02:13:01,525: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:13:01.529847580Z [2024-02-24 02:13:01,529: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:13:01.559371368Z [2024-02-24 02:13:01,559: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:13:01.563035694Z [2024-02-24 02:13:01,562: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:13:01.563243193Z [2024-02-24 02:13:01,562: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:13:01.563437414Z [2024-02-24 02:13:01,563: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:13:01.563946829Z [2024-02-24 02:13:01,563: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:13:01.708858698Z [2024-02-24 02:13:01,708: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:13:02.383594499Z [2024-02-24 02:13:02,379: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0763cfc3-55c9-4285-8906-0671a29573e8] succeeded in 1.4778092489996197s: None
2024-02-24T02:13:02.464990042Z [2024-02-24 02:13:02,464: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:13:02.468239795Z [2024-02-24 02:13:02,467: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:13:02.495767670Z [2024-02-24 02:13:02,495: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:13:02.497410727Z [2024-02-24 02:13:02,497: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:13:02.497573381Z [2024-02-24 02:13:02,497: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:13:02.497921030Z [2024-02-24 02:13:02,497: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:13:02.498134627Z [2024-02-24 02:13:02,497: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:13:02.498908179Z [2024-02-24 02:13:02,498: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:13:02.499129859Z [2024-02-24 02:13:02,498: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:13:02.578131564Z [2024-02-24 02:13:02,577: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:13:02.581678887Z [2024-02-24 02:13:02,581: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:13:02.603736004Z [2024-02-24 02:13:02,603: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:13:02.614711216Z [2024-02-24 02:13:02,614: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:13:02.616593378Z [2024-02-24 02:13:02,616: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:13:02.616790580Z [2024-02-24 02:13:02,616: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:13:02.617071073Z [2024-02-24 02:13:02,616: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:13:02.617239785Z [2024-02-24 02:13:02,617: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:13:02.617585499Z [2024-02-24 02:13:02,617: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:13:02.617724192Z [2024-02-24 02:13:02,617: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:13:02.742866417Z [2024-02-24 02:13:02,742: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:13:04.961084348Z [2024-02-24 02:13:04,960: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2883a59f-e924-4f81-9b3d-0574d5f21763] succeeded in 4.080264563999663s: None
2024-02-24T02:13:05.012417580Z [2024-02-24 02:13:05,012: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3ac3b5ab-a9b4-43c6-ac0a-f3791b8dcab9] succeeded in 4.1186490550007875s: None
2024-02-24T02:14:01.025899906Z [2024-02-24 02:14:01,025: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4613d098-4e3e-4e8d-a083-90d2b81d4093] received
2024-02-24T02:14:01.028350725Z [2024-02-24 02:14:01,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[41100b77-9d19-4fc8-b625-88d1cbeee23c] received
2024-02-24T02:14:01.039442449Z [2024-02-24 02:14:01,039: INFO/ForkPoolWorker-15] [4613d098-4e3e-4e8d-a083-90d2b81d4093] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:14:01.039804813Z [2024-02-24 02:14:01,039: INFO/ForkPoolWorker-16] [41100b77-9d19-4fc8-b625-88d1cbeee23c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:14:01.054894123Z [2024-02-24 02:14:01,054: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e97be54-7385-4681-a3f6-0e184c45da5b] received
2024-02-24T02:14:01.056856459Z [2024-02-24 02:14:01,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3619696-5326-4124-bbca-caf1697ef258] received
2024-02-24T02:14:01.067252085Z [2024-02-24 02:14:01,066: INFO/ForkPoolWorker-2] [f3619696-5326-4124-bbca-caf1697ef258] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:14:01.067792427Z [2024-02-24 02:14:01,067: INFO/ForkPoolWorker-1] [8e97be54-7385-4681-a3f6-0e184c45da5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:14:01.391320872Z [2024-02-24 02:14:01,388: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:14:01.485255377Z [2024-02-24 02:14:01,482: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:14:01.485325674Z [2024-02-24 02:14:01,481: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:14:01.607251924Z [2024-02-24 02:14:01,604: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:14:01.899089874Z [2024-02-24 02:14:01,898: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:14:01.958912778Z [2024-02-24 02:14:01,958: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:14:01.963327287Z [2024-02-24 02:14:01,962: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:14:02.032105161Z [2024-02-24 02:14:02,031: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:14:02.034038979Z [2024-02-24 02:14:02,033: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:14:02.034127680Z [2024-02-24 02:14:02,033: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:14:02.034153722Z [2024-02-24 02:14:02,034: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:14:02.034338520Z [2024-02-24 02:14:02,034: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:14:02.241461189Z [2024-02-24 02:14:02,241: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:14:02.548299922Z [2024-02-24 02:14:02,547: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4613d098-4e3e-4e8d-a083-90d2b81d4093] succeeded in 1.5175229670003318s: None
2024-02-24T02:14:03.154595986Z [2024-02-24 02:14:03,153: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3619696-5326-4124-bbca-caf1697ef258] succeeded in 2.0952920310010086s: None
2024-02-24T02:14:03.217719543Z [2024-02-24 02:14:03,217: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:14:03.221250463Z [2024-02-24 02:14:03,220: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:14:03.246191213Z [2024-02-24 02:14:03,245: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:14:03.247413803Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:14:03.247466631Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:14:03.247599988Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:14:03.247611186Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:14:03.247865134Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:14:03.248019121Z [2024-02-24 02:14:03,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:14:03.357355238Z [2024-02-24 02:14:03,356: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:14:03.445981336Z [2024-02-24 02:14:03,445: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:14:03.449060503Z [2024-02-24 02:14:03,448: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:14:03.470540195Z [2024-02-24 02:14:03,470: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:14:03.471753532Z [2024-02-24 02:14:03,471: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:14:03.471801011Z [2024-02-24 02:14:03,471: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:14:03.471878366Z [2024-02-24 02:14:03,471: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:14:03.471942997Z [2024-02-24 02:14:03,471: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:14:03.472161713Z [2024-02-24 02:14:03,472: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:14:03.472307182Z [2024-02-24 02:14:03,472: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:14:03.576528214Z [2024-02-24 02:14:03,576: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:14:05.954852339Z [2024-02-24 02:14:05,954: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8e97be54-7385-4681-a3f6-0e184c45da5b] succeeded in 4.896538414999668s: None
2024-02-24T02:14:06.776557576Z [2024-02-24 02:14:06,776: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[41100b77-9d19-4fc8-b625-88d1cbeee23c] succeeded in 5.746562725998956s: None
2024-02-24T02:15:00.966266856Z [2024-02-24 02:15:00,965: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6931a876-0bab-4663-9fbe-4578fd24678c] received
2024-02-24T02:15:00.969526296Z [2024-02-24 02:15:00,969: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d71b8592-9de7-48e7-a0df-b68641f9ada6] received
2024-02-24T02:15:00.972449312Z [2024-02-24 02:15:00,972: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[384a5b33-1798-4a51-94e6-b8899313ee25] received
2024-02-24T02:15:00.973519914Z [2024-02-24 02:15:00,973: INFO/ForkPoolWorker-15] [6931a876-0bab-4663-9fbe-4578fd24678c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:15:00.977180636Z [2024-02-24 02:15:00,976: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[531ecd75-eafd-4bd2-94f0-6b6c5324e99d] received
2024-02-24T02:15:00.988172080Z [2024-02-24 02:15:00,987: INFO/ForkPoolWorker-2] [531ecd75-eafd-4bd2-94f0-6b6c5324e99d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:15:00.989089131Z [2024-02-24 02:15:00,988: INFO/ForkPoolWorker-16] [d71b8592-9de7-48e7-a0df-b68641f9ada6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:15:00.995819776Z [2024-02-24 02:15:00,995: INFO/ForkPoolWorker-1] [384a5b33-1798-4a51-94e6-b8899313ee25] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:15:01.351531353Z [2024-02-24 02:15:01,346: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:15:01.430800996Z [2024-02-24 02:15:01,427: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:15:01.521809140Z [2024-02-24 02:15:01,518: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:15:01.694513707Z [2024-02-24 02:15:01,689: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:15:01.716673266Z [2024-02-24 02:15:01,716: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:15:01.722176528Z [2024-02-24 02:15:01,721: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:01.779362057Z [2024-02-24 02:15:01,779: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:15:01.780640162Z [2024-02-24 02:15:01,780: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:15:01.780752888Z [2024-02-24 02:15:01,780: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:15:01.780848599Z [2024-02-24 02:15:01,780: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:15:01.781159532Z [2024-02-24 02:15:01,781: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:15:01.876590159Z [2024-02-24 02:15:01,876: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:02.567682403Z [2024-02-24 02:15:02,567: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d71b8592-9de7-48e7-a0df-b68641f9ada6] succeeded in 1.5958100789994205s: None
2024-02-24T02:15:02.972809062Z [2024-02-24 02:15:02,972: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:15:02.976324195Z [2024-02-24 02:15:02,975: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:03.043093260Z [2024-02-24 02:15:03,042: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:15:03.045970917Z [2024-02-24 02:15:03,045: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:03.047137603Z [2024-02-24 02:15:03,045: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:03.047554833Z [2024-02-24 02:15:03,047: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:03.048445873Z [2024-02-24 02:15:03,047: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:15:03.048864457Z [2024-02-24 02:15:03,048: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:15:03.049051815Z [2024-02-24 02:15:03,048: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:03.117845248Z [2024-02-24 02:15:03,117: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:15:03.121735910Z [2024-02-24 02:15:03,121: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:03.157487662Z [2024-02-24 02:15:03,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:15:03.160604216Z [2024-02-24 02:15:03,160: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:03.161099546Z [2024-02-24 02:15:03,160: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:03.161324240Z [2024-02-24 02:15:03,161: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:03.162372951Z [2024-02-24 02:15:03,161: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:15:03.162389380Z [2024-02-24 02:15:03,161: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:15:03.162997467Z [2024-02-24 02:15:03,162: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:03.195818885Z [2024-02-24 02:15:03,195: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:03.244627696Z [2024-02-24 02:15:03,244: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:03.689895652Z [2024-02-24 02:15:03,686: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:15:03.693908209Z [2024-02-24 02:15:03,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:03.718333245Z [2024-02-24 02:15:03,717: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:15:03.720599357Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:03.720608923Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:03.720612943Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:03.720616916Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:15:03.720620387Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:15:03.720624198Z [2024-02-24 02:15:03,719: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:03.833029004Z [2024-02-24 02:15:03,832: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:04.639091064Z [2024-02-24 02:15:04,638: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[51cdf256-33b1-4e34-9d28-c5cf8fc32824] received
2024-02-24T02:15:04.649506115Z [2024-02-24 02:15:04,649: INFO/ForkPoolWorker-16] [51cdf256-33b1-4e34-9d28-c5cf8fc32824] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:15:04.655839751Z [2024-02-24 02:15:04,655: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[384a5b33-1798-4a51-94e6-b8899313ee25] succeeded in 3.679382042000725s: None
2024-02-24T02:15:04.954908936Z [2024-02-24 02:15:04,951: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:15:04.959296509Z [2024-02-24 02:15:04,958: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6931a876-0bab-4663-9fbe-4578fd24678c] succeeded in 3.990316363999227s: None
2024-02-24T02:15:05.657522914Z [2024-02-24 02:15:05,657: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[531ecd75-eafd-4bd2-94f0-6b6c5324e99d] succeeded in 4.6787030680006865s: None
2024-02-24T02:15:06.052792856Z [2024-02-24 02:15:06,052: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:15:06.056115654Z [2024-02-24 02:15:06,055: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:06.074670935Z [2024-02-24 02:15:06,074: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:15:06.075895256Z [2024-02-24 02:15:06,075: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:06.075926611Z [2024-02-24 02:15:06,075: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:06.076093918Z [2024-02-24 02:15:06,075: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:06.076139749Z [2024-02-24 02:15:06,075: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:15:06.076205427Z [2024-02-24 02:15:06,076: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:15:06.076237545Z [2024-02-24 02:15:06,076: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:06.153169856Z [2024-02-24 02:15:06,152: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:06.734232909Z [2024-02-24 02:15:06,733: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[51cdf256-33b1-4e34-9d28-c5cf8fc32824] succeeded in 2.093115198000305s: None
2024-02-24T02:15:07.086849843Z [2024-02-24 02:15:07,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55b8155d-dfb5-4d5a-8e26-f166108407f0] received
2024-02-24T02:15:07.094971990Z [2024-02-24 02:15:07,094: INFO/ForkPoolWorker-15] [55b8155d-dfb5-4d5a-8e26-f166108407f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:15:07.370972980Z [2024-02-24 02:15:07,367: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:15:08.461794483Z [2024-02-24 02:15:08,461: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:15:08.464940245Z [2024-02-24 02:15:08,464: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:08.482691680Z [2024-02-24 02:15:08,482: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:15:08.484297257Z [2024-02-24 02:15:08,483: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:08.484319054Z [2024-02-24 02:15:08,484: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:08.484401848Z [2024-02-24 02:15:08,484: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:08.484482262Z [2024-02-24 02:15:08,484: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:15:08.484862864Z [2024-02-24 02:15:08,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:15:08.484943682Z [2024-02-24 02:15:08,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:08.568483792Z [2024-02-24 02:15:08,568: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:09.097203142Z [2024-02-24 02:15:09,096: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55b8155d-dfb5-4d5a-8e26-f166108407f0] succeeded in 2.0084226859999035s: None
2024-02-24T02:15:09.360912571Z [2024-02-24 02:15:09,360: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c0e8eee-abfc-4f4a-a0e0-26fb452867c6] received
2024-02-24T02:15:09.366757734Z [2024-02-24 02:15:09,366: INFO/ForkPoolWorker-15] [5c0e8eee-abfc-4f4a-a0e0-26fb452867c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:15:09.643305696Z [2024-02-24 02:15:09,640: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:15:10.737829911Z [2024-02-24 02:15:10,737: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:15:10.741071186Z [2024-02-24 02:15:10,740: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:15:10.761680133Z [2024-02-24 02:15:10,761: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:15:10.763386516Z [2024-02-24 02:15:10,763: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:15:10.763498858Z [2024-02-24 02:15:10,763: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:15:10.763746266Z [2024-02-24 02:15:10,763: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:15:10.763865162Z [2024-02-24 02:15:10,763: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:15:10.764205967Z [2024-02-24 02:15:10,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:15:10.764343950Z [2024-02-24 02:15:10,764: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:15:10.840502995Z [2024-02-24 02:15:10,840: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:15:11.399439002Z [2024-02-24 02:15:11,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c0e8eee-abfc-4f4a-a0e0-26fb452867c6] succeeded in 2.03700097500041s: None
2024-02-24T02:16:00.660029890Z [2024-02-24 02:16:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cafff40f-4aae-4e3c-a0b4-de05c9dbd08f] received
2024-02-24T02:16:00.663470606Z [2024-02-24 02:16:00,663: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eaf7dcc5-0101-43db-b27e-ffeb6beec24d] received
2024-02-24T02:16:00.666281632Z [2024-02-24 02:16:00,666: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[466d224d-4156-4f41-bcbb-0acdfabfd03d] received
2024-02-24T02:16:00.673541450Z [2024-02-24 02:16:00,673: INFO/ForkPoolWorker-15] [cafff40f-4aae-4e3c-a0b4-de05c9dbd08f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:16:00.673687072Z [2024-02-24 02:16:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da752da4-2d0b-43bc-90c4-a2e412adc0ac] received
2024-02-24T02:16:00.674307726Z [2024-02-24 02:16:00,674: INFO/ForkPoolWorker-16] [eaf7dcc5-0101-43db-b27e-ffeb6beec24d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:16:00.678522302Z [2024-02-24 02:16:00,678: INFO/ForkPoolWorker-1] [466d224d-4156-4f41-bcbb-0acdfabfd03d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:16:00.686437370Z [2024-02-24 02:16:00,686: INFO/ForkPoolWorker-2] [da752da4-2d0b-43bc-90c4-a2e412adc0ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:16:01.016090419Z [2024-02-24 02:16:01,012: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:16:01.053473578Z [2024-02-24 02:16:01,047: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:16:01.085215176Z [2024-02-24 02:16:01,081: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:16:01.087844225Z [2024-02-24 02:16:01,081: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:16:01.191867750Z [2024-02-24 02:16:01,191: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:16:01.195733048Z [2024-02-24 02:16:01,195: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:16:01.258259529Z [2024-02-24 02:16:01,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:16:01.277744208Z [2024-02-24 02:16:01,273: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:16:01.277821271Z [2024-02-24 02:16:01,274: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:16:01.277826358Z [2024-02-24 02:16:01,274: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:16:01.277829619Z [2024-02-24 02:16:01,274: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:16:01.397462999Z [2024-02-24 02:16:01,397: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:16:01.471829695Z [2024-02-24 02:16:01,471: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:16:02.071791249Z [2024-02-24 02:16:02,070: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[da752da4-2d0b-43bc-90c4-a2e412adc0ac] succeeded in 1.3954716959997313s: None
2024-02-24T02:16:02.127883949Z [2024-02-24 02:16:02,127: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cafff40f-4aae-4e3c-a0b4-de05c9dbd08f] succeeded in 1.4661697259998618s: None
2024-02-24T02:16:02.477425223Z [2024-02-24 02:16:02,477: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:16:02.480867810Z [2024-02-24 02:16:02,480: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:16:02.504943638Z [2024-02-24 02:16:02,504: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:16:02.507807428Z [2024-02-24 02:16:02,507: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:16:02.508250973Z [2024-02-24 02:16:02,507: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:16:02.508597816Z [2024-02-24 02:16:02,508: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:16:02.508774255Z [2024-02-24 02:16:02,508: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:16:02.509288646Z [2024-02-24 02:16:02,509: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:16:02.510080998Z [2024-02-24 02:16:02,509: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:16:02.603919033Z [2024-02-24 02:16:02,603: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:16:02.686254810Z [2024-02-24 02:16:02,681: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:16:02.698216580Z [2024-02-24 02:16:02,690: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:16:02.827324342Z [2024-02-24 02:16:02,827: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:16:02.830501076Z [2024-02-24 02:16:02,830: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:16:02.830701316Z [2024-02-24 02:16:02,830: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:16:02.830916640Z [2024-02-24 02:16:02,830: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:16:02.831071181Z [2024-02-24 02:16:02,830: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:16:02.834227073Z [2024-02-24 02:16:02,833: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:16:02.834300038Z [2024-02-24 02:16:02,834: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:16:02.961300310Z [2024-02-24 02:16:02,960: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:16:04.684628790Z [2024-02-24 02:16:04,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[466d224d-4156-4f41-bcbb-0acdfabfd03d] succeeded in 4.016366525000194s: None
2024-02-24T02:16:04.719710283Z [2024-02-24 02:16:04,719: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[eaf7dcc5-0101-43db-b27e-ffeb6beec24d] succeeded in 4.054286184000375s: None
2024-02-24T02:17:01.163721877Z [2024-02-24 02:17:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af77afb2-d911-48db-ae31-19201dbee9ad] received
2024-02-24T02:17:01.167965437Z [2024-02-24 02:17:01,167: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ad871e2-2364-4382-81a0-98577aa60ec9] received
2024-02-24T02:17:01.169814982Z [2024-02-24 02:17:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db4d350d-4115-49db-b942-9f81800472cc] received
2024-02-24T02:17:01.177877381Z [2024-02-24 02:17:01,177: INFO/ForkPoolWorker-15] [af77afb2-d911-48db-ae31-19201dbee9ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:17:01.178510303Z [2024-02-24 02:17:01,178: INFO/ForkPoolWorker-16] [5ad871e2-2364-4382-81a0-98577aa60ec9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:17:01.182078486Z [2024-02-24 02:17:01,181: INFO/ForkPoolWorker-1] [db4d350d-4115-49db-b942-9f81800472cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:17:01.554745948Z [2024-02-24 02:17:01,551: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:17:01.593291286Z [2024-02-24 02:17:01,584: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:17:01.623436406Z [2024-02-24 02:17:01,620: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:17:01.794864727Z [2024-02-24 02:17:01,794: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T02:17:01.798994763Z [2024-02-24 02:17:01,798: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:17:01.837116242Z [2024-02-24 02:17:01,836: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:17:01.838615708Z [2024-02-24 02:17:01,838: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:17:01.839533490Z [2024-02-24 02:17:01,838: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:17:01.841196312Z [2024-02-24 02:17:01,841: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T02:17:01.841531827Z [2024-02-24 02:17:01,841: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:17:01.928394787Z [2024-02-24 02:17:01,928: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:17:02.504944406Z [2024-02-24 02:17:02,504: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af77afb2-d911-48db-ae31-19201dbee9ad] succeeded in 1.338517366000815s: None
2024-02-24T02:17:02.751153110Z [2024-02-24 02:17:02,750: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:17:02.755101812Z [2024-02-24 02:17:02,754: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:17:02.812739589Z [2024-02-24 02:17:02,812: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:17:02.814480607Z [2024-02-24 02:17:02,814: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:17:02.814701523Z [2024-02-24 02:17:02,814: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:17:02.814965588Z [2024-02-24 02:17:02,814: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:17:02.815139881Z [2024-02-24 02:17:02,814: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:17:02.815633335Z [2024-02-24 02:17:02,815: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:17:02.815795031Z [2024-02-24 02:17:02,815: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:17:02.919290524Z [2024-02-24 02:17:02,919: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:17:02.924926009Z [2024-02-24 02:17:02,924: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:17:02.928940904Z [2024-02-24 02:17:02,928: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:17:02.967156310Z [2024-02-24 02:17:02,966: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:17:02.971192601Z [2024-02-24 02:17:02,970: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:17:02.971902999Z [2024-02-24 02:17:02,971: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:17:02.972230489Z [2024-02-24 02:17:02,971: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:17:02.972443561Z [2024-02-24 02:17:02,972: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:17:02.972804617Z [2024-02-24 02:17:02,972: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:17:02.973000209Z [2024-02-24 02:17:02,972: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:17:03.090509464Z [2024-02-24 02:17:03,090: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:17:04.666609751Z [2024-02-24 02:17:04,666: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5ad871e2-2364-4382-81a0-98577aa60ec9] succeeded in 3.4966928619996906s: None
2024-02-24T02:17:04.902968120Z [2024-02-24 02:17:04,902: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[db4d350d-4115-49db-b942-9f81800472cc] succeeded in 3.7309181920008996s: None
2024-02-24T02:18:00.539307829Z [2024-02-24 02:18:00,539: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[871f027b-5463-4f75-ab73-dfe65c0bc75d] received
2024-02-24T02:18:00.540926542Z [2024-02-24 02:18:00,540: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d31af14d-5a53-499f-a9ac-cad494d4bf8f] received
2024-02-24T02:18:00.549920822Z [2024-02-24 02:18:00,549: INFO/ForkPoolWorker-15] [871f027b-5463-4f75-ab73-dfe65c0bc75d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:18:00.553584884Z [2024-02-24 02:18:00,553: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f98c290-3f09-4cd9-b32c-5c5e13b5552f] received
2024-02-24T02:18:00.554330481Z [2024-02-24 02:18:00,554: INFO/ForkPoolWorker-16] [d31af14d-5a53-499f-a9ac-cad494d4bf8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:18:00.555507245Z [2024-02-24 02:18:00,555: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[556bfa78-e975-414e-8369-0d1edc109160] received
2024-02-24T02:18:00.560913236Z [2024-02-24 02:18:00,560: INFO/ForkPoolWorker-1] [9f98c290-3f09-4cd9-b32c-5c5e13b5552f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:18:00.564764384Z [2024-02-24 02:18:00,564: INFO/ForkPoolWorker-2] [556bfa78-e975-414e-8369-0d1edc109160] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:18:00.864941329Z [2024-02-24 02:18:00,862: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:18:00.865367771Z [2024-02-24 02:18:00,862: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:18:00.892477170Z [2024-02-24 02:18:00,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:18:00.911259571Z [2024-02-24 02:18:00,907: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:18:01.076796343Z [2024-02-24 02:18:01,076: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:18:01.081878077Z [2024-02-24 02:18:01,081: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:18:01.130302538Z [2024-02-24 02:18:01,129: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:18:01.136060175Z [2024-02-24 02:18:01,135: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:18:01.136689153Z [2024-02-24 02:18:01,135: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:18:01.137822925Z [2024-02-24 02:18:01,136: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:18:01.139243891Z [2024-02-24 02:18:01,139: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:18:01.264210236Z [2024-02-24 02:18:01,257: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:18:01.326586618Z [2024-02-24 02:18:01,326: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:18:01.872036241Z [2024-02-24 02:18:01,871: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[556bfa78-e975-414e-8369-0d1edc109160] succeeded in 1.3145473490003496s: None
2024-02-24T02:18:01.890986070Z [2024-02-24 02:18:01,890: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[871f027b-5463-4f75-ab73-dfe65c0bc75d] succeeded in 1.350137329000063s: None
2024-02-24T02:18:02.322590686Z [2024-02-24 02:18:02,321: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:18:02.326220936Z [2024-02-24 02:18:02,325: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:18:02.336139018Z [2024-02-24 02:18:02,335: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:18:02.341836642Z [2024-02-24 02:18:02,341: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:18:02.385946427Z [2024-02-24 02:18:02,366: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:18:02.385978069Z [2024-02-24 02:18:02,384: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:18:02.385983803Z [2024-02-24 02:18:02,384: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:18:02.386006974Z [2024-02-24 02:18:02,384: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:18:02.386012311Z [2024-02-24 02:18:02,384: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:18:02.386016730Z [2024-02-24 02:18:02,384: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:18:02.386021310Z [2024-02-24 02:18:02,385: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:18:02.423268619Z [2024-02-24 02:18:02,422: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:18:02.426959326Z [2024-02-24 02:18:02,426: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:18:02.427413208Z [2024-02-24 02:18:02,426: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:18:02.428052938Z [2024-02-24 02:18:02,427: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:18:02.428176570Z [2024-02-24 02:18:02,427: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:18:02.429239817Z [2024-02-24 02:18:02,428: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:18:02.429477307Z [2024-02-24 02:18:02,429: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:18:02.517159238Z [2024-02-24 02:18:02,516: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:18:02.541267806Z [2024-02-24 02:18:02,540: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:18:04.258103682Z [2024-02-24 02:18:04,257: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f98c290-3f09-4cd9-b32c-5c5e13b5552f] succeeded in 3.7029021799990005s: None
2024-02-24T02:18:05.089490814Z [2024-02-24 02:18:05,088: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d31af14d-5a53-499f-a9ac-cad494d4bf8f] succeeded in 4.546548496999094s: None
2024-02-24T02:19:00.908329616Z [2024-02-24 02:19:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[313384c0-f146-4f8d-8747-067c70b74de4] received
2024-02-24T02:19:00.913285960Z [2024-02-24 02:19:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8404a647-3892-493d-a741-45d5b1562d75] received
2024-02-24T02:19:00.922206962Z [2024-02-24 02:19:00,921: INFO/ForkPoolWorker-15] [313384c0-f146-4f8d-8747-067c70b74de4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:19:00.922736541Z [2024-02-24 02:19:00,922: INFO/ForkPoolWorker-16] [8404a647-3892-493d-a741-45d5b1562d75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:19:00.922751182Z [2024-02-24 02:19:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50dd0824-9f76-4621-b7e9-0591081dd1c6] received
2024-02-24T02:19:00.933992863Z [2024-02-24 02:19:00,933: INFO/ForkPoolWorker-1] [50dd0824-9f76-4621-b7e9-0591081dd1c6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:19:01.284601426Z [2024-02-24 02:19:01,273: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:19:01.320913265Z [2024-02-24 02:19:01,305: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:19:01.361535684Z [2024-02-24 02:19:01,356: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:19:01.590248688Z [2024-02-24 02:19:01,589: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:19:01.594635528Z [2024-02-24 02:19:01,594: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:19:01.620674403Z [2024-02-24 02:19:01,620: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:19:01.621863086Z [2024-02-24 02:19:01,621: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:19:01.622268045Z [2024-02-24 02:19:01,621: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:19:01.622393324Z [2024-02-24 02:19:01,622: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:19:01.622614517Z [2024-02-24 02:19:01,622: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:19:01.713092122Z [2024-02-24 02:19:01,712: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:19:02.257659211Z [2024-02-24 02:19:02,257: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[50dd0824-9f76-4621-b7e9-0591081dd1c6] succeeded in 1.3333460960002412s: None
2024-02-24T02:19:02.507187689Z [2024-02-24 02:19:02,506: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:19:02.510869874Z [2024-02-24 02:19:02,510: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:19:02.541809115Z [2024-02-24 02:19:02,541: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:19:02.544366167Z [2024-02-24 02:19:02,544: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:19:02.544579429Z [2024-02-24 02:19:02,544: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:19:02.544976745Z [2024-02-24 02:19:02,544: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:19:02.545250314Z [2024-02-24 02:19:02,545: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:19:02.545857015Z [2024-02-24 02:19:02,545: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:19:02.546877889Z [2024-02-24 02:19:02,546: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:19:02.590044296Z [2024-02-24 02:19:02,589: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:19:02.593552676Z [2024-02-24 02:19:02,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:19:02.633064181Z [2024-02-24 02:19:02,632: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:19:02.636367064Z [2024-02-24 02:19:02,635: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:19:02.636475684Z [2024-02-24 02:19:02,636: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:19:02.636770453Z [2024-02-24 02:19:02,636: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:19:02.636953438Z [2024-02-24 02:19:02,636: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:19:02.638517106Z [2024-02-24 02:19:02,637: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:19:02.638530868Z [2024-02-24 02:19:02,638: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:19:02.640434641Z [2024-02-24 02:19:02,640: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:19:02.770231076Z [2024-02-24 02:19:02,769: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:19:04.447938887Z [2024-02-24 02:19:04,447: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8404a647-3892-493d-a741-45d5b1562d75] succeeded in 3.5319616020005924s: None
2024-02-24T02:19:05.623140176Z [2024-02-24 02:19:05,622: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[313384c0-f146-4f8d-8747-067c70b74de4] succeeded in 4.708375222999166s: None
2024-02-24T02:20:00.329158343Z [2024-02-24 02:20:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c161c877-f11c-4a76-9ee9-fd2ed818603f] received
2024-02-24T02:20:00.331652440Z [2024-02-24 02:20:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad8f39c7-fa62-44a8-ba18-51aaaa8509af] received
2024-02-24T02:20:00.337134381Z [2024-02-24 02:20:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9af133a-3a21-411a-81b4-1010d581ff00] received
2024-02-24T02:20:00.338620672Z [2024-02-24 02:20:00,338: INFO/ForkPoolWorker-16] [ad8f39c7-fa62-44a8-ba18-51aaaa8509af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:20:00.342663226Z [2024-02-24 02:20:00,341: INFO/ForkPoolWorker-15] [c161c877-f11c-4a76-9ee9-fd2ed818603f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:20:00.343794212Z [2024-02-24 02:20:00,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e61e50e9-a68f-482e-b6ca-819f595303d4] received
2024-02-24T02:20:00.345454201Z [2024-02-24 02:20:00,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e7580e2-60d3-4f0e-a134-e3bac449d7d3] received
2024-02-24T02:20:00.346275728Z [2024-02-24 02:20:00,345: INFO/ForkPoolWorker-1] [d9af133a-3a21-411a-81b4-1010d581ff00] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:20:00.359523941Z [2024-02-24 02:20:00,359: INFO/ForkPoolWorker-2] [e61e50e9-a68f-482e-b6ca-819f595303d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:20:00.368795219Z [2024-02-24 02:20:00,368: INFO/ForkPoolWorker-3] [6e7580e2-60d3-4f0e-a134-e3bac449d7d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:20:00.636690226Z [2024-02-24 02:20:00,633: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:20:00.759807166Z [2024-02-24 02:20:00,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:20:00.791342755Z [2024-02-24 02:20:00,788: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:20:00.875707027Z [2024-02-24 02:20:00,869: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:20:00.988445055Z [2024-02-24 02:20:00,987: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:20:00.993829890Z [2024-02-24 02:20:00,993: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:01.006341627Z [2024-02-24 02:20:00,993: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:20:01.031153592Z [2024-02-24 02:20:01,030: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:20:01.032612789Z [2024-02-24 02:20:01,032: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:20:01.032755943Z [2024-02-24 02:20:01,032: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:20:01.032798837Z [2024-02-24 02:20:01,032: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:20:01.033047205Z [2024-02-24 02:20:01,032: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:20:01.188169162Z [2024-02-24 02:20:01,187: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:01.632702249Z [2024-02-24 02:20:01,632: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:02.122413263Z [2024-02-24 02:20:02,121: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9af133a-3a21-411a-81b4-1010d581ff00] succeeded in 1.7833737620003376s: None
2024-02-24T02:20:02.296105536Z [2024-02-24 02:20:02,295: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:20:02.300852654Z [2024-02-24 02:20:02,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:02.322372874Z [2024-02-24 02:20:02,322: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:20:02.324212636Z [2024-02-24 02:20:02,323: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:02.324244163Z [2024-02-24 02:20:02,323: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:02.324252007Z [2024-02-24 02:20:02,323: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:02.324257708Z [2024-02-24 02:20:02,323: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:20:02.324270302Z [2024-02-24 02:20:02,324: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:20:02.324801132Z [2024-02-24 02:20:02,324: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:02.336811002Z [2024-02-24 02:20:02,336: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6e7580e2-60d3-4f0e-a134-e3bac449d7d3] succeeded in 1.9890128719998756s: None
2024-02-24T02:20:02.462200272Z [2024-02-24 02:20:02,461: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:02.531717165Z [2024-02-24 02:20:02,531: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:20:02.535314362Z [2024-02-24 02:20:02,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:02.558235822Z [2024-02-24 02:20:02,558: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:20:02.559691532Z [2024-02-24 02:20:02,559: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:02.559705563Z [2024-02-24 02:20:02,559: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:02.559932783Z [2024-02-24 02:20:02,559: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:02.560059641Z [2024-02-24 02:20:02,559: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:20:02.560352584Z [2024-02-24 02:20:02,560: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:20:02.560488854Z [2024-02-24 02:20:02,560: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:02.649973224Z [2024-02-24 02:20:02,642: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:02.650003257Z [2024-02-24 02:20:02,648: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:20:02.662784842Z [2024-02-24 02:20:02,657: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:02.758665349Z [2024-02-24 02:20:02,758: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:20:02.774906584Z [2024-02-24 02:20:02,774: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:02.775342940Z [2024-02-24 02:20:02,774: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:02.775659246Z [2024-02-24 02:20:02,775: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:02.775776474Z [2024-02-24 02:20:02,775: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:20:02.776207655Z [2024-02-24 02:20:02,775: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:20:02.782045048Z [2024-02-24 02:20:02,776: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:02.988977092Z [2024-02-24 02:20:02,988: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:03.498310846Z [2024-02-24 02:20:03,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a81cc76-ba0c-4ec2-b760-396cb77c3dc3] received
2024-02-24T02:20:03.507643695Z [2024-02-24 02:20:03,507: INFO/ForkPoolWorker-1] [6a81cc76-ba0c-4ec2-b760-396cb77c3dc3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:20:03.553961798Z [2024-02-24 02:20:03,548: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e61e50e9-a68f-482e-b6ca-819f595303d4] succeeded in 3.2038967030002823s: None
2024-02-24T02:20:03.869269364Z [2024-02-24 02:20:03,865: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:20:04.816137074Z [2024-02-24 02:20:04,815: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c161c877-f11c-4a76-9ee9-fd2ed818603f] succeeded in 4.482012137999845s: None
2024-02-24T02:20:05.094879140Z [2024-02-24 02:20:05,094: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:20:05.097961840Z [2024-02-24 02:20:05,097: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:05.128480467Z [2024-02-24 02:20:05,128: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:20:05.131177954Z [2024-02-24 02:20:05,130: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:05.131280240Z [2024-02-24 02:20:05,131: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:05.131367619Z [2024-02-24 02:20:05,131: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:05.131388783Z [2024-02-24 02:20:05,131: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:20:05.131729052Z [2024-02-24 02:20:05,131: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:20:05.131771972Z [2024-02-24 02:20:05,131: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:05.182626414Z [2024-02-24 02:20:05,182: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad8f39c7-fa62-44a8-ba18-51aaaa8509af] succeeded in 4.849640768999961s: None
2024-02-24T02:20:05.217230909Z [2024-02-24 02:20:05,216: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:05.806289715Z [2024-02-24 02:20:05,806: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d8a33f2-b45d-4964-8925-356ff92c1e6b] received
2024-02-24T02:20:05.814869097Z [2024-02-24 02:20:05,814: INFO/ForkPoolWorker-15] [6d8a33f2-b45d-4964-8925-356ff92c1e6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:20:05.876921160Z [2024-02-24 02:20:05,876: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a81cc76-ba0c-4ec2-b760-396cb77c3dc3] succeeded in 2.3752354349999223s: None
2024-02-24T02:20:06.124467250Z [2024-02-24 02:20:06,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:20:07.201956763Z [2024-02-24 02:20:07,201: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:20:07.205062508Z [2024-02-24 02:20:07,204: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:07.223305654Z [2024-02-24 02:20:07,223: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:20:07.224495209Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:07.224508458Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:07.224621929Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:07.224654694Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:20:07.225036974Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:20:07.225058164Z [2024-02-24 02:20:07,224: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:07.305406468Z [2024-02-24 02:20:07,305: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:07.892700534Z [2024-02-24 02:20:07,892: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d8a33f2-b45d-4964-8925-356ff92c1e6b] succeeded in 2.084544047000236s: None
2024-02-24T02:20:08.388101458Z [2024-02-24 02:20:08,387: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e421c73-4fb4-40bc-b8e0-fde48fce68a0] received
2024-02-24T02:20:08.401952941Z [2024-02-24 02:20:08,401: INFO/ForkPoolWorker-15] [9e421c73-4fb4-40bc-b8e0-fde48fce68a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:20:08.837976707Z [2024-02-24 02:20:08,834: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:20:10.107626965Z [2024-02-24 02:20:10,107: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:20:10.110950523Z [2024-02-24 02:20:10,110: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:20:10.137578787Z [2024-02-24 02:20:10,137: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:20:10.139497063Z [2024-02-24 02:20:10,139: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:20:10.139929876Z [2024-02-24 02:20:10,139: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:20:10.140035512Z [2024-02-24 02:20:10,139: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:20:10.140150770Z [2024-02-24 02:20:10,140: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:20:10.140419906Z [2024-02-24 02:20:10,140: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:20:10.140514043Z [2024-02-24 02:20:10,140: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:20:10.248457501Z [2024-02-24 02:20:10,247: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:20:10.881922679Z [2024-02-24 02:20:10,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9e421c73-4fb4-40bc-b8e0-fde48fce68a0] succeeded in 2.4892322850009805s: None
2024-02-24T02:21:00.657753670Z [2024-02-24 02:21:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d06f0c7-e70f-4bd3-ac43-27c4d25ddd27] received
2024-02-24T02:21:00.659293476Z [2024-02-24 02:21:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71676d3a-9167-4d56-9a2f-8d2ade159a21] received
2024-02-24T02:21:00.660314541Z [2024-02-24 02:21:00,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[886181ef-69c1-4237-80e2-c7b7599be5d4] received
2024-02-24T02:21:00.666686447Z [2024-02-24 02:21:00,666: INFO/ForkPoolWorker-16] [71676d3a-9167-4d56-9a2f-8d2ade159a21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:21:00.667103041Z [2024-02-24 02:21:00,666: INFO/ForkPoolWorker-1] [886181ef-69c1-4237-80e2-c7b7599be5d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:21:00.670063107Z [2024-02-24 02:21:00,669: INFO/ForkPoolWorker-15] [6d06f0c7-e70f-4bd3-ac43-27c4d25ddd27] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:21:01.008330469Z [2024-02-24 02:21:01,005: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:21:01.010410314Z [2024-02-24 02:21:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:21:01.095308039Z [2024-02-24 02:21:01,091: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:21:01.182755693Z [2024-02-24 02:21:01,182: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:21:01.188095934Z [2024-02-24 02:21:01,187: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:21:01.236071304Z [2024-02-24 02:21:01,235: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:21:01.242350017Z [2024-02-24 02:21:01,236: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:21:01.242377846Z [2024-02-24 02:21:01,236: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:21:01.242385333Z [2024-02-24 02:21:01,236: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:21:01.242390524Z [2024-02-24 02:21:01,236: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:21:01.389791161Z [2024-02-24 02:21:01,389: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:21:02.008653701Z [2024-02-24 02:21:02,007: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[71676d3a-9167-4d56-9a2f-8d2ade159a21] succeeded in 1.3465446440004598s: None
2024-02-24T02:21:02.260203607Z [2024-02-24 02:21:02,259: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:21:02.263600599Z [2024-02-24 02:21:02,262: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:21:02.285836931Z [2024-02-24 02:21:02,285: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:21:02.287258728Z [2024-02-24 02:21:02,287: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:21:02.287464905Z [2024-02-24 02:21:02,287: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:21:02.287699240Z [2024-02-24 02:21:02,287: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:21:02.287869155Z [2024-02-24 02:21:02,287: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:21:02.288215277Z [2024-02-24 02:21:02,288: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:21:02.288404688Z [2024-02-24 02:21:02,288: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:21:02.392491135Z [2024-02-24 02:21:02,392: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:21:02.471832724Z [2024-02-24 02:21:02,471: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:21:02.475346158Z [2024-02-24 02:21:02,474: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:21:02.498684908Z [2024-02-24 02:21:02,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:21:02.500185024Z [2024-02-24 02:21:02,499: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:21:02.500428932Z [2024-02-24 02:21:02,500: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:21:02.500720673Z [2024-02-24 02:21:02,500: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:21:02.500974729Z [2024-02-24 02:21:02,500: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:21:02.501393935Z [2024-02-24 02:21:02,501: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:21:02.501605228Z [2024-02-24 02:21:02,501: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:21:02.615090974Z [2024-02-24 02:21:02,614: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:21:04.495044881Z [2024-02-24 02:21:04,494: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[886181ef-69c1-4237-80e2-c7b7599be5d4] succeeded in 3.8335032850009156s: None
2024-02-24T02:21:04.559079344Z [2024-02-24 02:21:04,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6d06f0c7-e70f-4bd3-ac43-27c4d25ddd27] succeeded in 3.8987361950003105s: None
2024-02-24T02:22:01.224778037Z [2024-02-24 02:22:01,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bad3162e-bc47-4ef4-9c3a-f88019968c7e] received
2024-02-24T02:22:01.226006473Z [2024-02-24 02:22:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92fbf2a1-0d0d-4fe4-abd2-d5ba0d9b852a] received
2024-02-24T02:22:01.239694660Z [2024-02-24 02:22:01,236: INFO/ForkPoolWorker-16] [92fbf2a1-0d0d-4fe4-abd2-d5ba0d9b852a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:22:01.252276737Z [2024-02-24 02:22:01,245: INFO/ForkPoolWorker-15] [bad3162e-bc47-4ef4-9c3a-f88019968c7e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:22:01.259462079Z [2024-02-24 02:22:01,256: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[403a7753-f069-47b3-9cd4-9df42b64d60e] received
2024-02-24T02:22:01.267203475Z [2024-02-24 02:22:01,261: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d820610f-bd8b-42e0-9eb8-518c31b1d9aa] received
2024-02-24T02:22:01.272432752Z [2024-02-24 02:22:01,272: INFO/ForkPoolWorker-1] [403a7753-f069-47b3-9cd4-9df42b64d60e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:22:01.275426668Z [2024-02-24 02:22:01,275: INFO/ForkPoolWorker-2] [d820610f-bd8b-42e0-9eb8-518c31b1d9aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:22:01.609969365Z [2024-02-24 02:22:01,606: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:22:01.656717563Z [2024-02-24 02:22:01,653: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:22:01.696957885Z [2024-02-24 02:22:01,693: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:22:01.715540076Z [2024-02-24 02:22:01,711: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:22:01.818717101Z [2024-02-24 02:22:01,818: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:22:01.822834331Z [2024-02-24 02:22:01,822: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:22:01.875735894Z [2024-02-24 02:22:01,875: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:22:01.880122033Z [2024-02-24 02:22:01,879: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:22:01.880142333Z [2024-02-24 02:22:01,879: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:22:01.880152943Z [2024-02-24 02:22:01,879: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:22:01.880807257Z [2024-02-24 02:22:01,880: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:22:01.959655257Z [2024-02-24 02:22:01,959: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:22:02.088537462Z [2024-02-24 02:22:02,088: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:22:02.644527294Z [2024-02-24 02:22:02,643: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bad3162e-bc47-4ef4-9c3a-f88019968c7e] succeeded in 1.418176127001061s: None
2024-02-24T02:22:02.851527293Z [2024-02-24 02:22:02,851: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d820610f-bd8b-42e0-9eb8-518c31b1d9aa] succeeded in 1.5853439099992102s: None
2024-02-24T02:22:03.013226925Z [2024-02-24 02:22:03,012: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:22:03.016373931Z [2024-02-24 02:22:03,015: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:22:03.047041621Z [2024-02-24 02:22:03,046: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:22:03.049407954Z [2024-02-24 02:22:03,049: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:22:03.049473602Z [2024-02-24 02:22:03,049: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:22:03.049646876Z [2024-02-24 02:22:03,049: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:22:03.049699308Z [2024-02-24 02:22:03,049: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:22:03.050117689Z [2024-02-24 02:22:03,049: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:22:03.050179706Z [2024-02-24 02:22:03,050: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:22:03.141913795Z [2024-02-24 02:22:03,141: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:22:03.315094623Z [2024-02-24 02:22:03,314: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:22:03.319055525Z [2024-02-24 02:22:03,318: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:22:03.339445472Z [2024-02-24 02:22:03,339: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:22:03.340732949Z [2024-02-24 02:22:03,340: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:22:03.340938867Z [2024-02-24 02:22:03,340: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:22:03.341228476Z [2024-02-24 02:22:03,340: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:22:03.341380580Z [2024-02-24 02:22:03,341: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:22:03.341696623Z [2024-02-24 02:22:03,341: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:22:03.341974770Z [2024-02-24 02:22:03,341: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:22:03.438882396Z [2024-02-24 02:22:03,438: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:22:05.165811563Z [2024-02-24 02:22:05,165: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[403a7753-f069-47b3-9cd4-9df42b64d60e] succeeded in 3.904924383999969s: None
2024-02-24T02:22:06.852596348Z [2024-02-24 02:22:06,851: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[92fbf2a1-0d0d-4fe4-abd2-d5ba0d9b852a] succeeded in 5.624852422999538s: None
2024-02-24T02:23:01.234384324Z [2024-02-24 02:23:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2aef7ccc-db63-4995-8358-3432132fc55e] received
2024-02-24T02:23:01.241867616Z [2024-02-24 02:23:01,239: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cbfa4b7-2474-4e7e-b5cf-24cd6d89ec45] received
2024-02-24T02:23:01.248111419Z [2024-02-24 02:23:01,247: INFO/ForkPoolWorker-15] [2aef7ccc-db63-4995-8358-3432132fc55e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:23:01.249209242Z [2024-02-24 02:23:01,249: INFO/ForkPoolWorker-16] [2cbfa4b7-2474-4e7e-b5cf-24cd6d89ec45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:23:01.264633760Z [2024-02-24 02:23:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73aec779-2e5a-4d61-ae33-0e4c6bd7b2d6] received
2024-02-24T02:23:01.281855742Z [2024-02-24 02:23:01,271: INFO/ForkPoolWorker-1] [73aec779-2e5a-4d61-ae33-0e4c6bd7b2d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:23:01.647053510Z [2024-02-24 02:23:01,644: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:23:01.749028364Z [2024-02-24 02:23:01,745: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:23:01.805456352Z [2024-02-24 02:23:01,800: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:23:02.036269382Z [2024-02-24 02:23:02,035: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:23:02.043351225Z [2024-02-24 02:23:02,042: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:23:02.072990108Z [2024-02-24 02:23:02,072: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:23:02.074644902Z [2024-02-24 02:23:02,074: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:23:02.074826893Z [2024-02-24 02:23:02,074: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:23:02.075003472Z [2024-02-24 02:23:02,074: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:23:02.075453073Z [2024-02-24 02:23:02,075: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:23:02.195881192Z [2024-02-24 02:23:02,195: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:23:02.814121294Z [2024-02-24 02:23:02,813: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:23:02.817585187Z [2024-02-24 02:23:02,817: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:23:02.845178242Z [2024-02-24 02:23:02,844: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:23:02.846511889Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:23:02.846532052Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:23:02.846713479Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:23:02.846722952Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:23:02.846911178Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:23:02.846943561Z [2024-02-24 02:23:02,846: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:23:02.895833918Z [2024-02-24 02:23:02,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[73aec779-2e5a-4d61-ae33-0e4c6bd7b2d6] succeeded in 1.6319882380012132s: None
2024-02-24T02:23:02.940184281Z [2024-02-24 02:23:02,939: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:23:02.992733562Z [2024-02-24 02:23:02,992: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:23:02.996512606Z [2024-02-24 02:23:02,996: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:23:03.024672673Z [2024-02-24 02:23:03,024: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:23:03.027010531Z [2024-02-24 02:23:03,026: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:23:03.027154125Z [2024-02-24 02:23:03,027: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:23:03.027412056Z [2024-02-24 02:23:03,027: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:23:03.027544523Z [2024-02-24 02:23:03,027: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:23:03.027883138Z [2024-02-24 02:23:03,027: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:23:03.028025665Z [2024-02-24 02:23:03,027: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:23:03.135130955Z [2024-02-24 02:23:03,134: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:23:04.767085342Z [2024-02-24 02:23:04,766: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2aef7ccc-db63-4995-8358-3432132fc55e] succeeded in 3.531159992000539s: None
2024-02-24T02:23:05.783050642Z [2024-02-24 02:23:05,782: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2cbfa4b7-2474-4e7e-b5cf-24cd6d89ec45] succeeded in 4.541879099999278s: None
2024-02-24T02:24:01.164118793Z [2024-02-24 02:24:01,163: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b7d57b0c-d091-4753-b9c9-cd8cb9df75e5] received
2024-02-24T02:24:01.166295544Z [2024-02-24 02:24:01,166: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0aba9e3-8b88-43d8-b915-780fa5133f8b] received
2024-02-24T02:24:01.174377009Z [2024-02-24 02:24:01,174: INFO/ForkPoolWorker-16] [a0aba9e3-8b88-43d8-b915-780fa5133f8b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:24:01.175941161Z [2024-02-24 02:24:01,175: INFO/ForkPoolWorker-15] [b7d57b0c-d091-4753-b9c9-cd8cb9df75e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:24:01.181118214Z [2024-02-24 02:24:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d04d93a8-f8fa-40ed-bbd4-51839218cd2a] received
2024-02-24T02:24:01.186346233Z [2024-02-24 02:24:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[636c78b5-0445-435e-a3e0-8c63f6d0aa9f] received
2024-02-24T02:24:01.193520656Z [2024-02-24 02:24:01,193: INFO/ForkPoolWorker-1] [d04d93a8-f8fa-40ed-bbd4-51839218cd2a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:24:01.196833955Z [2024-02-24 02:24:01,196: INFO/ForkPoolWorker-2] [636c78b5-0445-435e-a3e0-8c63f6d0aa9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:24:01.495182157Z [2024-02-24 02:24:01,492: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:24:01.564624032Z [2024-02-24 02:24:01,561: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:24:01.645001550Z [2024-02-24 02:24:01,641: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:24:01.684863350Z [2024-02-24 02:24:01,681: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:24:01.731837744Z [2024-02-24 02:24:01,731: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:24:01.736017010Z [2024-02-24 02:24:01,735: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:24:01.771657274Z [2024-02-24 02:24:01,771: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:24:01.772822075Z [2024-02-24 02:24:01,772: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:24:01.773053773Z [2024-02-24 02:24:01,772: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:24:01.773200465Z [2024-02-24 02:24:01,773: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:24:01.773471159Z [2024-02-24 02:24:01,773: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:24:01.821250203Z [2024-02-24 02:24:01,820: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:24:01.927617275Z [2024-02-24 02:24:01,927: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:24:02.593247368Z [2024-02-24 02:24:02,592: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a0aba9e3-8b88-43d8-b915-780fa5133f8b] succeeded in 1.4257603109999764s: None
2024-02-24T02:24:02.877936793Z [2024-02-24 02:24:02,877: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d04d93a8-f8fa-40ed-bbd4-51839218cd2a] succeeded in 1.6949975329989684s: None
2024-02-24T02:24:03.121607530Z [2024-02-24 02:24:03,121: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:24:03.124953966Z [2024-02-24 02:24:03,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:24:03.143214906Z [2024-02-24 02:24:03,142: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:24:03.146893112Z [2024-02-24 02:24:03,146: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:24:03.146997735Z [2024-02-24 02:24:03,146: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:24:03.149084165Z [2024-02-24 02:24:03,148: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:24:03.150069369Z [2024-02-24 02:24:03,149: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:24:03.150521126Z [2024-02-24 02:24:03,150: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:24:03.150690478Z [2024-02-24 02:24:03,150: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:24:03.151043504Z [2024-02-24 02:24:03,150: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:24:03.151552799Z [2024-02-24 02:24:03,151: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:24:03.167304634Z [2024-02-24 02:24:03,167: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:24:03.170033633Z [2024-02-24 02:24:03,169: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:24:03.170192519Z [2024-02-24 02:24:03,169: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:24:03.170409701Z [2024-02-24 02:24:03,170: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:24:03.170532652Z [2024-02-24 02:24:03,170: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:24:03.170899748Z [2024-02-24 02:24:03,170: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:24:03.171044617Z [2024-02-24 02:24:03,170: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:24:03.247957140Z [2024-02-24 02:24:03,247: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:24:03.263088641Z [2024-02-24 02:24:03,262: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:24:04.789542423Z [2024-02-24 02:24:04,788: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b7d57b0c-d091-4753-b9c9-cd8cb9df75e5] succeeded in 3.6208715880002273s: None
2024-02-24T02:24:05.324946972Z [2024-02-24 02:24:05,324: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[636c78b5-0445-435e-a3e0-8c63f6d0aa9f] succeeded in 4.136749477000194s: None
2024-02-24T02:25:01.152170470Z [2024-02-24 02:25:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd72e1cc-ebac-4cf5-8184-6c5eac7c2f00] received
2024-02-24T02:25:01.158695197Z [2024-02-24 02:25:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efe53d68-be64-4703-8a42-2943bd462321] received
2024-02-24T02:25:01.162614352Z [2024-02-24 02:25:01,162: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[505ec90c-504f-4a50-9515-1773592d9c98] received
2024-02-24T02:25:01.165546512Z [2024-02-24 02:25:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[203f4bc4-6d64-4ffe-9372-0c6d1509d705] received
2024-02-24T02:25:01.170837616Z [2024-02-24 02:25:01,170: INFO/ForkPoolWorker-15] [dd72e1cc-ebac-4cf5-8184-6c5eac7c2f00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:25:01.184867402Z [2024-02-24 02:25:01,184: INFO/ForkPoolWorker-2] [203f4bc4-6d64-4ffe-9372-0c6d1509d705] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:25:01.194657301Z [2024-02-24 02:25:01,193: INFO/ForkPoolWorker-1] [505ec90c-504f-4a50-9515-1773592d9c98] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:25:01.195165272Z [2024-02-24 02:25:01,191: INFO/ForkPoolWorker-16] [efe53d68-be64-4703-8a42-2943bd462321] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:25:01.567513476Z [2024-02-24 02:25:01,563: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:25:01.700752940Z [2024-02-24 02:25:01,696: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:25:01.777927422Z [2024-02-24 02:25:01,773: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:25:01.788724805Z [2024-02-24 02:25:01,784: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:25:02.051087019Z [2024-02-24 02:25:02,050: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:25:02.059642706Z [2024-02-24 02:25:02,059: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:02.103024670Z [2024-02-24 02:25:02,102: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:25:02.105220466Z [2024-02-24 02:25:02,104: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:25:02.105496859Z [2024-02-24 02:25:02,105: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:25:02.105629243Z [2024-02-24 02:25:02,105: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:25:02.106844586Z [2024-02-24 02:25:02,106: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:25:02.250444243Z [2024-02-24 02:25:02,250: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:03.310086769Z [2024-02-24 02:25:03,309: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[efe53d68-be64-4703-8a42-2943bd462321] succeeded in 2.149195274001613s: None
2024-02-24T02:25:03.697885936Z [2024-02-24 02:25:03,696: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:25:03.701871013Z [2024-02-24 02:25:03,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:03.734027445Z [2024-02-24 02:25:03,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:25:03.742589254Z [2024-02-24 02:25:03,738: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:03.742614487Z [2024-02-24 02:25:03,738: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:03.742620672Z [2024-02-24 02:25:03,739: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:03.742626720Z [2024-02-24 02:25:03,739: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:25:03.742630361Z [2024-02-24 02:25:03,739: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:25:03.742634021Z [2024-02-24 02:25:03,739: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:03.847895440Z [2024-02-24 02:25:03,843: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:04.075630572Z [2024-02-24 02:25:04,075: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:25:04.079892186Z [2024-02-24 02:25:04,079: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:04.117360827Z [2024-02-24 02:25:04,115: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:25:04.119402802Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:04.119421356Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:04.119560106Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:04.119616109Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:25:04.119841041Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:25:04.119859929Z [2024-02-24 02:25:04,119: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:04.168885891Z [2024-02-24 02:25:04,168: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:25:04.173050652Z [2024-02-24 02:25:04,172: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:04.219133041Z [2024-02-24 02:25:04,218: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:25:04.220796913Z [2024-02-24 02:25:04,220: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:04.220825003Z [2024-02-24 02:25:04,220: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:04.221042513Z [2024-02-24 02:25:04,220: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:04.221081397Z [2024-02-24 02:25:04,220: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:25:04.221431097Z [2024-02-24 02:25:04,221: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:25:04.221446175Z [2024-02-24 02:25:04,221: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:04.228969559Z [2024-02-24 02:25:04,228: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:04.384809013Z [2024-02-24 02:25:04,384: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:04.985865596Z [2024-02-24 02:25:04,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[455bea7a-bf37-4e7a-bb58-d92ec95d9396] received
2024-02-24T02:25:05.005462061Z [2024-02-24 02:25:05,005: INFO/ForkPoolWorker-16] [455bea7a-bf37-4e7a-bb58-d92ec95d9396] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:25:05.044845799Z [2024-02-24 02:25:05,044: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[505ec90c-504f-4a50-9515-1773592d9c98] succeeded in 3.8801440700008243s: None
2024-02-24T02:25:05.280526741Z [2024-02-24 02:25:05,277: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:25:05.554830414Z [2024-02-24 02:25:05,554: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd72e1cc-ebac-4cf5-8184-6c5eac7c2f00] succeeded in 4.398971299999175s: None
2024-02-24T02:25:06.010020449Z [2024-02-24 02:25:06,009: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[203f4bc4-6d64-4ffe-9372-0c6d1509d705] succeeded in 4.841086491000169s: None
2024-02-24T02:25:06.406411174Z [2024-02-24 02:25:06,406: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:25:06.410013613Z [2024-02-24 02:25:06,409: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:06.440948010Z [2024-02-24 02:25:06,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:25:06.443561060Z [2024-02-24 02:25:06,443: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:06.443894000Z [2024-02-24 02:25:06,443: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:06.444338723Z [2024-02-24 02:25:06,443: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:06.444633817Z [2024-02-24 02:25:06,444: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:25:06.445336122Z [2024-02-24 02:25:06,445: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:25:06.445649685Z [2024-02-24 02:25:06,445: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:06.538989645Z [2024-02-24 02:25:06,538: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:07.250125637Z [2024-02-24 02:25:07,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[455bea7a-bf37-4e7a-bb58-d92ec95d9396] succeeded in 2.255507582000064s: None
2024-02-24T02:25:07.495793466Z [2024-02-24 02:25:07,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05a9a940-bc03-45af-bc25-e0d4f610dd7c] received
2024-02-24T02:25:07.502888091Z [2024-02-24 02:25:07,502: INFO/ForkPoolWorker-15] [05a9a940-bc03-45af-bc25-e0d4f610dd7c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:25:07.822475900Z [2024-02-24 02:25:07,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:25:08.895817891Z [2024-02-24 02:25:08,895: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:25:08.899066931Z [2024-02-24 02:25:08,898: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:08.922687089Z [2024-02-24 02:25:08,922: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:25:08.924060337Z [2024-02-24 02:25:08,923: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:08.924169683Z [2024-02-24 02:25:08,923: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:08.924403045Z [2024-02-24 02:25:08,923: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:08.924436582Z [2024-02-24 02:25:08,924: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:25:08.924781699Z [2024-02-24 02:25:08,924: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:25:08.924802623Z [2024-02-24 02:25:08,924: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:09.019852918Z [2024-02-24 02:25:09,019: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:09.631976480Z [2024-02-24 02:25:09,631: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[05a9a940-bc03-45af-bc25-e0d4f610dd7c] succeeded in 2.1340959220015066s: None
2024-02-24T02:25:09.911788363Z [2024-02-24 02:25:09,911: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d93786a-b421-48c0-855b-e156f373a542] received
2024-02-24T02:25:09.921927474Z [2024-02-24 02:25:09,921: INFO/ForkPoolWorker-15] [0d93786a-b421-48c0-855b-e156f373a542] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:25:10.219282042Z [2024-02-24 02:25:10,216: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:25:11.283695863Z [2024-02-24 02:25:11,280: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:25:11.286582370Z [2024-02-24 02:25:11,286: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:25:11.311941131Z [2024-02-24 02:25:11,311: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:25:11.313494798Z [2024-02-24 02:25:11,313: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:25:11.313622295Z [2024-02-24 02:25:11,313: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:25:11.314134656Z [2024-02-24 02:25:11,313: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:25:11.314378407Z [2024-02-24 02:25:11,314: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:25:11.314696251Z [2024-02-24 02:25:11,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:25:11.314815208Z [2024-02-24 02:25:11,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:25:11.417293512Z [2024-02-24 02:25:11,416: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:25:11.996752657Z [2024-02-24 02:25:11,996: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0d93786a-b421-48c0-855b-e156f373a542] succeeded in 2.08315550000043s: None
2024-02-24T02:26:00.983801346Z [2024-02-24 02:26:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21cea182-13c3-4ddb-9c8b-1f18126aa20d] received
2024-02-24T02:26:00.986048675Z [2024-02-24 02:26:00,985: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f6329603-6a3e-4cda-be06-d792e11fcc81] received
2024-02-24T02:26:00.994730134Z [2024-02-24 02:26:00,994: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f91f0508-692d-48ee-8f0c-1dc0b83c3214] received
2024-02-24T02:26:01.000877446Z [2024-02-24 02:26:01,000: INFO/ForkPoolWorker-16] [f6329603-6a3e-4cda-be06-d792e11fcc81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:26:01.002125815Z [2024-02-24 02:26:01,001: INFO/ForkPoolWorker-15] [21cea182-13c3-4ddb-9c8b-1f18126aa20d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:26:01.008365714Z [2024-02-24 02:26:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25eee561-4ac7-40ff-9028-f04bbde7e866] received
2024-02-24T02:26:01.010203062Z [2024-02-24 02:26:01,009: INFO/ForkPoolWorker-1] [f91f0508-692d-48ee-8f0c-1dc0b83c3214] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:26:01.022600034Z [2024-02-24 02:26:01,022: INFO/ForkPoolWorker-2] [25eee561-4ac7-40ff-9028-f04bbde7e866] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:26:01.409146652Z [2024-02-24 02:26:01,405: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:26:01.535999512Z [2024-02-24 02:26:01,530: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:26:01.584657485Z [2024-02-24 02:26:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:26:01.604862570Z [2024-02-24 02:26:01,604: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:26:01.608834219Z [2024-02-24 02:26:01,608: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:26:01.648776351Z [2024-02-24 02:26:01,648: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:26:01.650502557Z [2024-02-24 02:26:01,650: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:26:01.650774345Z [2024-02-24 02:26:01,650: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:26:01.650915270Z [2024-02-24 02:26:01,650: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:26:01.651436921Z [2024-02-24 02:26:01,651: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:26:01.656458494Z [2024-02-24 02:26:01,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:26:01.772055593Z [2024-02-24 02:26:01,771: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:26:01.949949899Z [2024-02-24 02:26:01,949: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:26:02.405966343Z [2024-02-24 02:26:02,403: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[25eee561-4ac7-40ff-9028-f04bbde7e866] succeeded in 1.3927265319998696s: None
2024-02-24T02:26:02.606814412Z [2024-02-24 02:26:02,606: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21cea182-13c3-4ddb-9c8b-1f18126aa20d] succeeded in 1.6161384469996847s: None
2024-02-24T02:26:03.032125293Z [2024-02-24 02:26:03,031: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:26:03.035632187Z [2024-02-24 02:26:03,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:26:03.059427002Z [2024-02-24 02:26:03,059: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:26:03.060981715Z [2024-02-24 02:26:03,060: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:26:03.061002296Z [2024-02-24 02:26:03,060: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:26:03.061240326Z [2024-02-24 02:26:03,060: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:26:03.061268557Z [2024-02-24 02:26:03,061: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:26:03.061655105Z [2024-02-24 02:26:03,061: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:26:03.061938686Z [2024-02-24 02:26:03,061: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:26:03.089993014Z [2024-02-24 02:26:03,089: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:26:03.093307338Z [2024-02-24 02:26:03,092: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:26:03.129456908Z [2024-02-24 02:26:03,129: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:26:03.130955457Z [2024-02-24 02:26:03,130: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:26:03.131135286Z [2024-02-24 02:26:03,130: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:26:03.131355495Z [2024-02-24 02:26:03,131: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:26:03.131452442Z [2024-02-24 02:26:03,131: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:26:03.131784402Z [2024-02-24 02:26:03,131: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:26:03.132165282Z [2024-02-24 02:26:03,132: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:26:03.148055340Z [2024-02-24 02:26:03,147: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:26:03.235634484Z [2024-02-24 02:26:03,235: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:26:04.727453021Z [2024-02-24 02:26:04,727: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f91f0508-692d-48ee-8f0c-1dc0b83c3214] succeeded in 3.7289592629986146s: None
2024-02-24T02:26:05.182958863Z [2024-02-24 02:26:05,182: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f6329603-6a3e-4cda-be06-d792e11fcc81] succeeded in 4.1949187539994455s: None
2024-02-24T02:27:00.588717222Z [2024-02-24 02:27:00,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffbde701-2fd7-4293-943b-2d5fa007bbf9] received
2024-02-24T02:27:00.598114817Z [2024-02-24 02:27:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0ca63227-c22a-4f06-9411-d82033992b02] received
2024-02-24T02:27:00.601230737Z [2024-02-24 02:27:00,601: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09b16109-e6ca-4988-9c51-efe09a7ab98f] received
2024-02-24T02:27:00.614466380Z [2024-02-24 02:27:00,614: INFO/ForkPoolWorker-15] [ffbde701-2fd7-4293-943b-2d5fa007bbf9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:27:00.617851843Z [2024-02-24 02:27:00,617: INFO/ForkPoolWorker-16] [0ca63227-c22a-4f06-9411-d82033992b02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:27:00.618675634Z [2024-02-24 02:27:00,618: INFO/ForkPoolWorker-1] [09b16109-e6ca-4988-9c51-efe09a7ab98f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:27:00.891838139Z [2024-02-24 02:27:00,888: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:27:01.019528844Z [2024-02-24 02:27:01,016: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:27:01.091006191Z [2024-02-24 02:27:01,087: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:27:01.196696790Z [2024-02-24 02:27:01,196: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:27:01.200794500Z [2024-02-24 02:27:01,200: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:27:01.307066211Z [2024-02-24 02:27:01,306: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:27:01.308640536Z [2024-02-24 02:27:01,308: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:27:01.308779007Z [2024-02-24 02:27:01,308: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:27:01.309093474Z [2024-02-24 02:27:01,308: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:27:01.310007814Z [2024-02-24 02:27:01,309: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:27:01.487466068Z [2024-02-24 02:27:01,487: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:27:02.222712186Z [2024-02-24 02:27:02,222: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[09b16109-e6ca-4988-9c51-efe09a7ab98f] succeeded in 1.6193293939995783s: None
2024-02-24T02:27:02.315643567Z [2024-02-24 02:27:02,315: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:27:02.318981713Z [2024-02-24 02:27:02,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:27:02.345033121Z [2024-02-24 02:27:02,344: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:27:02.346567550Z [2024-02-24 02:27:02,346: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:27:02.346602500Z [2024-02-24 02:27:02,346: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:27:02.346792708Z [2024-02-24 02:27:02,346: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:27:02.346867259Z [2024-02-24 02:27:02,346: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:27:02.347147332Z [2024-02-24 02:27:02,347: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:27:02.347217568Z [2024-02-24 02:27:02,347: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:27:02.451229153Z [2024-02-24 02:27:02,450: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:27:02.457128603Z [2024-02-24 02:27:02,456: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:27:02.460797554Z [2024-02-24 02:27:02,460: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:27:02.486707103Z [2024-02-24 02:27:02,486: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:27:02.488503998Z [2024-02-24 02:27:02,488: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:27:02.488692149Z [2024-02-24 02:27:02,488: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:27:02.488929352Z [2024-02-24 02:27:02,488: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:27:02.489100520Z [2024-02-24 02:27:02,488: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:27:02.489463983Z [2024-02-24 02:27:02,489: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:27:02.489624096Z [2024-02-24 02:27:02,489: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:27:02.588840411Z [2024-02-24 02:27:02,588: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:27:04.214788554Z [2024-02-24 02:27:04,214: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0ca63227-c22a-4f06-9411-d82033992b02] succeeded in 3.615520014998765s: None
2024-02-24T02:27:04.426684588Z [2024-02-24 02:27:04,426: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffbde701-2fd7-4293-943b-2d5fa007bbf9] succeeded in 3.82710855500045s: None
2024-02-24T02:28:00.583460296Z [2024-02-24 02:28:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[673eb173-3703-405a-9531-9bc5b5204180] received
2024-02-24T02:28:00.586403308Z [2024-02-24 02:28:00,586: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9aa6912a-cf7b-4bec-a577-a854986358b8] received
2024-02-24T02:28:00.592729637Z [2024-02-24 02:28:00,592: INFO/ForkPoolWorker-15] [673eb173-3703-405a-9531-9bc5b5204180] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:28:00.598376651Z [2024-02-24 02:28:00,598: INFO/ForkPoolWorker-16] [9aa6912a-cf7b-4bec-a577-a854986358b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:28:00.614460727Z [2024-02-24 02:28:00,614: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0530a856-2e4e-4ec3-9e31-c0870b53ec30] received
2024-02-24T02:28:00.622322616Z [2024-02-24 02:28:00,620: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b1a289e-887b-4610-88df-ce4bb929faa5] received
2024-02-24T02:28:00.628219901Z [2024-02-24 02:28:00,627: INFO/ForkPoolWorker-1] [0530a856-2e4e-4ec3-9e31-c0870b53ec30] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:28:00.636873624Z [2024-02-24 02:28:00,636: INFO/ForkPoolWorker-2] [5b1a289e-887b-4610-88df-ce4bb929faa5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:28:00.884604252Z [2024-02-24 02:28:00,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:28:00.910502390Z [2024-02-24 02:28:00,907: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:28:01.065436389Z [2024-02-24 02:28:01,062: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:28:01.144233840Z [2024-02-24 02:28:01,141: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:28:01.221915490Z [2024-02-24 02:28:01,219: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:28:01.374221780Z [2024-02-24 02:28:01,373: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:28:01.390484826Z [2024-02-24 02:28:01,389: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:28:01.429182620Z [2024-02-24 02:28:01,428: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:28:01.433865309Z [2024-02-24 02:28:01,433: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:28:01.435293715Z [2024-02-24 02:28:01,433: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:28:01.435451288Z [2024-02-24 02:28:01,435: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:28:01.435985358Z [2024-02-24 02:28:01,435: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:28:01.582465948Z [2024-02-24 02:28:01,582: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:28:01.720795037Z [2024-02-24 02:28:01,720: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[673eb173-3703-405a-9531-9bc5b5204180] succeeded in 1.134998807001466s: None
2024-02-24T02:28:02.219796079Z [2024-02-24 02:28:02,219: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5b1a289e-887b-4610-88df-ce4bb929faa5] succeeded in 1.592424562000815s: None
2024-02-24T02:28:02.306008120Z [2024-02-24 02:28:02,305: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:28:02.310184918Z [2024-02-24 02:28:02,309: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:28:02.347345479Z [2024-02-24 02:28:02,347: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:28:02.352124761Z [2024-02-24 02:28:02,351: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:28:02.355028461Z [2024-02-24 02:28:02,351: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:28:02.355054492Z [2024-02-24 02:28:02,351: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:28:02.355060301Z [2024-02-24 02:28:02,352: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:28:02.355064990Z [2024-02-24 02:28:02,352: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:28:02.355070026Z [2024-02-24 02:28:02,352: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:28:02.477950565Z [2024-02-24 02:28:02,477: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:28:02.575817868Z [2024-02-24 02:28:02,575: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:28:02.579135688Z [2024-02-24 02:28:02,578: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:28:02.600876923Z [2024-02-24 02:28:02,600: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:28:02.602150285Z [2024-02-24 02:28:02,601: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:28:02.602169012Z [2024-02-24 02:28:02,602: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:28:02.602330869Z [2024-02-24 02:28:02,602: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:28:02.602377557Z [2024-02-24 02:28:02,602: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:28:02.602637099Z [2024-02-24 02:28:02,602: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:28:02.602675087Z [2024-02-24 02:28:02,602: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:28:02.730213502Z [2024-02-24 02:28:02,729: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:28:04.344164377Z [2024-02-24 02:28:04,343: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0530a856-2e4e-4ec3-9e31-c0870b53ec30] succeeded in 3.724560510001538s: None
2024-02-24T02:28:04.371832952Z [2024-02-24 02:28:04,371: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9aa6912a-cf7b-4bec-a577-a854986358b8] succeeded in 3.7829798799994023s: None
2024-02-24T02:29:00.449287041Z [2024-02-24 02:29:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ecb14f4a-a736-4b7b-b2f4-da075df0b95d] received
2024-02-24T02:29:00.452136399Z [2024-02-24 02:29:00,451: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd13702d-5ab9-44bf-bd1c-69ffce7cdc01] received
2024-02-24T02:29:00.457251633Z [2024-02-24 02:29:00,457: INFO/ForkPoolWorker-15] [ecb14f4a-a736-4b7b-b2f4-da075df0b95d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:29:00.457466679Z [2024-02-24 02:29:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a79c520-f0f1-4a9d-a756-5c46ec260b92] received
2024-02-24T02:29:00.458262296Z [2024-02-24 02:29:00,458: INFO/ForkPoolWorker-16] [fd13702d-5ab9-44bf-bd1c-69ffce7cdc01] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:29:00.466677508Z [2024-02-24 02:29:00,466: INFO/ForkPoolWorker-1] [6a79c520-f0f1-4a9d-a756-5c46ec260b92] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:29:00.742698298Z [2024-02-24 02:29:00,739: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:29:00.768161977Z [2024-02-24 02:29:00,765: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:29:00.818959284Z [2024-02-24 02:29:00,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:29:00.951318653Z [2024-02-24 02:29:00,950: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T02:29:00.955245460Z [2024-02-24 02:29:00,954: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:29:00.974894837Z [2024-02-24 02:29:00,974: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:29:00.975878741Z [2024-02-24 02:29:00,975: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:29:00.975987441Z [2024-02-24 02:29:00,975: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:29:00.976084938Z [2024-02-24 02:29:00,975: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T02:29:00.976288042Z [2024-02-24 02:29:00,976: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:29:01.098592022Z [2024-02-24 02:29:01,098: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:29:01.727061624Z [2024-02-24 02:29:01,726: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ecb14f4a-a736-4b7b-b2f4-da075df0b95d] succeeded in 1.2749289189996489s: None
2024-02-24T02:29:01.979569060Z [2024-02-24 02:29:01,979: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:29:01.982963854Z [2024-02-24 02:29:01,982: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:29:02.001738417Z [2024-02-24 02:29:02,001: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:29:02.004049544Z [2024-02-24 02:29:02,003: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:29:02.004223791Z [2024-02-24 02:29:02,003: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:29:02.004452207Z [2024-02-24 02:29:02,004: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:29:02.004589885Z [2024-02-24 02:29:02,004: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:29:02.004962089Z [2024-02-24 02:29:02,004: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:29:02.005113438Z [2024-02-24 02:29:02,004: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:29:02.034098925Z [2024-02-24 02:29:02,033: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:29:02.037505855Z [2024-02-24 02:29:02,037: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:29:02.066264198Z [2024-02-24 02:29:02,066: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:29:02.068032949Z [2024-02-24 02:29:02,067: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:29:02.068258854Z [2024-02-24 02:29:02,068: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:29:02.068551110Z [2024-02-24 02:29:02,068: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:29:02.068778916Z [2024-02-24 02:29:02,068: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:29:02.069171001Z [2024-02-24 02:29:02,068: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:29:02.069360613Z [2024-02-24 02:29:02,069: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:29:02.101711076Z [2024-02-24 02:29:02,101: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:29:02.158877449Z [2024-02-24 02:29:02,158: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:29:04.463638035Z [2024-02-24 02:29:04,463: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6a79c520-f0f1-4a9d-a756-5c46ec260b92] succeeded in 4.004440051001438s: None
2024-02-24T02:29:04.893262606Z [2024-02-24 02:29:04,892: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fd13702d-5ab9-44bf-bd1c-69ffce7cdc01] succeeded in 4.439542712001639s: None
2024-02-24T02:30:00.457562382Z [2024-02-24 02:30:00,457: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[83e47c1d-aeb0-4ab1-a061-415d23fee9af] received
2024-02-24T02:30:00.463428549Z [2024-02-24 02:30:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5a6ef23-6af3-460c-8c06-0d9451a166be] received
2024-02-24T02:30:00.469455317Z [2024-02-24 02:30:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[595101f8-d13d-4127-835b-26a9785dd643] received
2024-02-24T02:30:00.469639477Z [2024-02-24 02:30:00,469: INFO/ForkPoolWorker-15] [83e47c1d-aeb0-4ab1-a061-415d23fee9af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:30:00.470544861Z [2024-02-24 02:30:00,470: INFO/ForkPoolWorker-16] [c5a6ef23-6af3-460c-8c06-0d9451a166be] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:30:00.473030203Z [2024-02-24 02:30:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1325659-7339-4017-bb4e-9ef7abc384f8] received
2024-02-24T02:30:00.478352228Z [2024-02-24 02:30:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37c14c7f-6e84-4747-a863-1f3ce4481458] received
2024-02-24T02:30:00.483630092Z [2024-02-24 02:30:00,483: INFO/ForkPoolWorker-1] [595101f8-d13d-4127-835b-26a9785dd643] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:30:00.491722168Z [2024-02-24 02:30:00,491: INFO/ForkPoolWorker-2] [e1325659-7339-4017-bb4e-9ef7abc384f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:30:00.502341839Z [2024-02-24 02:30:00,502: INFO/ForkPoolWorker-3] [37c14c7f-6e84-4747-a863-1f3ce4481458] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:30:00.837269572Z [2024-02-24 02:30:00,834: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:30:00.862242979Z [2024-02-24 02:30:00,858: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:30:00.988345130Z [2024-02-24 02:30:00,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:30:01.101435524Z [2024-02-24 02:30:01,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:30:01.102226908Z [2024-02-24 02:30:01,087: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:30:01.113362747Z [2024-02-24 02:30:01,112: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:01.503333740Z [2024-02-24 02:30:01,502: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:30:01.509309447Z [2024-02-24 02:30:01,508: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:01.573798523Z [2024-02-24 02:30:01,573: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:30:01.578939086Z [2024-02-24 02:30:01,578: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:30:01.579147798Z [2024-02-24 02:30:01,578: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:30:01.579292985Z [2024-02-24 02:30:01,579: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:30:01.579602416Z [2024-02-24 02:30:01,579: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:30:01.746315438Z [2024-02-24 02:30:01,746: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:01.848360823Z [2024-02-24 02:30:01,847: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c5a6ef23-6af3-460c-8c06-0d9451a166be] succeeded in 1.3834725189990422s: None
2024-02-24T02:30:02.383156186Z [2024-02-24 02:30:02,381: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[595101f8-d13d-4127-835b-26a9785dd643] succeeded in 1.9094689560006373s: None
2024-02-24T02:30:02.492879023Z [2024-02-24 02:30:02,492: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T02:30:02.496426249Z [2024-02-24 02:30:02,495: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:02.527963079Z [2024-02-24 02:30:02,527: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T02:30:02.529502847Z [2024-02-24 02:30:02,529: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:02.529705788Z [2024-02-24 02:30:02,529: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:02.530054998Z [2024-02-24 02:30:02,529: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:02.530221574Z [2024-02-24 02:30:02,530: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T02:30:02.530544550Z [2024-02-24 02:30:02,530: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:30:02.530711335Z [2024-02-24 02:30:02,530: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:02.597566123Z [2024-02-24 02:30:02,597: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:30:02.600966712Z [2024-02-24 02:30:02,600: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:02.617884931Z [2024-02-24 02:30:02,617: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:02.622152881Z [2024-02-24 02:30:02,621: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:30:02.623447857Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:02.623462537Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:02.623538133Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:02.623627792Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:30:02.623784454Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:30:02.623826741Z [2024-02-24 02:30:02,623: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:02.765157449Z [2024-02-24 02:30:02,764: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:02.841403642Z [2024-02-24 02:30:02,840: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:30:02.844488262Z [2024-02-24 02:30:02,844: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:02.882841807Z [2024-02-24 02:30:02,882: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:30:02.884343423Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:02.884361180Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:02.884526030Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:02.884613689Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:30:02.885008125Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:30:02.885126815Z [2024-02-24 02:30:02,884: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:02.964753184Z [2024-02-24 02:30:02,964: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:03.407358891Z [2024-02-24 02:30:03,406: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[83e47c1d-aeb0-4ab1-a061-415d23fee9af] succeeded in 2.946623712001383s: None
2024-02-24T02:30:03.470211033Z [2024-02-24 02:30:03,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd457c46-aff1-43f1-be03-7820ccd36a05] received
2024-02-24T02:30:03.477220247Z [2024-02-24 02:30:03,476: INFO/ForkPoolWorker-15] [dd457c46-aff1-43f1-be03-7820ccd36a05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:30:03.783252585Z [2024-02-24 02:30:03,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:30:04.313280119Z [2024-02-24 02:30:04,312: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[37c14c7f-6e84-4747-a863-1f3ce4481458] succeeded in 3.8325522470004216s: None
2024-02-24T02:30:04.952465230Z [2024-02-24 02:30:04,952: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:30:04.955760184Z [2024-02-24 02:30:04,955: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:04.988268138Z [2024-02-24 02:30:04,987: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:30:04.990246627Z [2024-02-24 02:30:04,989: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:04.990338876Z [2024-02-24 02:30:04,990: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:04.990679249Z [2024-02-24 02:30:04,990: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:04.990884553Z [2024-02-24 02:30:04,990: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:30:04.991646224Z [2024-02-24 02:30:04,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:30:04.991981527Z [2024-02-24 02:30:04,991: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:05.030464028Z [2024-02-24 02:30:05,030: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e1325659-7339-4017-bb4e-9ef7abc384f8] succeeded in 4.555149531999632s: None
2024-02-24T02:30:05.099741215Z [2024-02-24 02:30:05,099: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:05.779161278Z [2024-02-24 02:30:05,778: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dd457c46-aff1-43f1-be03-7820ccd36a05] succeeded in 2.307356217999768s: None
2024-02-24T02:30:06.057740017Z [2024-02-24 02:30:06,056: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64fec015-9273-433e-9b16-611b31f56360] received
2024-02-24T02:30:06.065543776Z [2024-02-24 02:30:06,065: INFO/ForkPoolWorker-15] [64fec015-9273-433e-9b16-611b31f56360] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:30:06.348705346Z [2024-02-24 02:30:06,345: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:30:07.481401479Z [2024-02-24 02:30:07,481: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:30:07.484661802Z [2024-02-24 02:30:07,484: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:07.516577485Z [2024-02-24 02:30:07,516: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:30:07.518920331Z [2024-02-24 02:30:07,518: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:07.518980265Z [2024-02-24 02:30:07,518: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:07.519323426Z [2024-02-24 02:30:07,518: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:07.519401622Z [2024-02-24 02:30:07,519: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:30:07.519840711Z [2024-02-24 02:30:07,519: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:30:07.519998579Z [2024-02-24 02:30:07,519: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:07.619814449Z [2024-02-24 02:30:07,619: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:08.168149984Z [2024-02-24 02:30:08,167: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[64fec015-9273-433e-9b16-611b31f56360] succeeded in 2.10703851299877s: None
2024-02-24T02:30:08.382795451Z [2024-02-24 02:30:08,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e23023b3-4fd0-4d81-9df3-76463f4b25ee] received
2024-02-24T02:30:08.390603475Z [2024-02-24 02:30:08,390: INFO/ForkPoolWorker-15] [e23023b3-4fd0-4d81-9df3-76463f4b25ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:30:08.699011126Z [2024-02-24 02:30:08,695: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:30:09.886880150Z [2024-02-24 02:30:09,886: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:30:09.890077956Z [2024-02-24 02:30:09,889: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:30:09.910741199Z [2024-02-24 02:30:09,910: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:30:09.912690148Z [2024-02-24 02:30:09,912: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:30:09.912887909Z [2024-02-24 02:30:09,912: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:30:09.913013662Z [2024-02-24 02:30:09,912: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:30:09.913120252Z [2024-02-24 02:30:09,913: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:30:09.913438490Z [2024-02-24 02:30:09,913: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:30:09.913573629Z [2024-02-24 02:30:09,913: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:30:10.000104982Z [2024-02-24 02:30:09,999: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:30:10.549858521Z [2024-02-24 02:30:10,549: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e23023b3-4fd0-4d81-9df3-76463f4b25ee] succeeded in 2.1651977290002833s: None
2024-02-24T02:31:01.223770712Z [2024-02-24 02:31:01,222: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dade461-f621-49e1-987b-56036b652902] received
2024-02-24T02:31:01.227868591Z [2024-02-24 02:31:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d69eb96-6e11-4013-85a8-6001c03876a5] received
2024-02-24T02:31:01.237873572Z [2024-02-24 02:31:01,237: INFO/ForkPoolWorker-16] [4d69eb96-6e11-4013-85a8-6001c03876a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:31:01.242627349Z [2024-02-24 02:31:01,242: INFO/ForkPoolWorker-15] [0dade461-f621-49e1-987b-56036b652902] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:31:01.250924258Z [2024-02-24 02:31:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[72312885-b8d8-496d-9724-d4a0dc99c3ac] received
2024-02-24T02:31:01.257951689Z [2024-02-24 02:31:01,257: INFO/ForkPoolWorker-1] [72312885-b8d8-496d-9724-d4a0dc99c3ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:31:01.622583423Z [2024-02-24 02:31:01,619: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:31:01.633296850Z [2024-02-24 02:31:01,630: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:31:01.645302878Z [2024-02-24 02:31:01,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:31:01.787696970Z [2024-02-24 02:31:01,787: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T02:31:01.791510011Z [2024-02-24 02:31:01,791: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:31:01.810775403Z [2024-02-24 02:31:01,810: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:31:01.814682540Z [2024-02-24 02:31:01,814: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:31:01.814791033Z [2024-02-24 02:31:01,814: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:31:01.814867780Z [2024-02-24 02:31:01,814: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T02:31:01.815112420Z [2024-02-24 02:31:01,815: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:31:01.900045478Z [2024-02-24 02:31:01,899: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:31:02.513817589Z [2024-02-24 02:31:02,513: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dade461-f621-49e1-987b-56036b652902] succeeded in 1.2898576320003485s: None
2024-02-24T02:31:02.928696262Z [2024-02-24 02:31:02,928: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:31:02.931936397Z [2024-02-24 02:31:02,931: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:31:02.961722572Z [2024-02-24 02:31:02,961: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:31:02.963523509Z [2024-02-24 02:31:02,963: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:31:02.963543324Z [2024-02-24 02:31:02,963: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:31:02.963768497Z [2024-02-24 02:31:02,963: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:31:02.963801903Z [2024-02-24 02:31:02,963: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:31:02.964204981Z [2024-02-24 02:31:02,963: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:31:02.964338375Z [2024-02-24 02:31:02,964: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:31:03.068201533Z [2024-02-24 02:31:03,067: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:31:03.133187338Z [2024-02-24 02:31:03,132: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:31:03.137547047Z [2024-02-24 02:31:03,137: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:31:03.164063925Z [2024-02-24 02:31:03,163: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:31:03.166202981Z [2024-02-24 02:31:03,165: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:31:03.166461407Z [2024-02-24 02:31:03,166: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:31:03.166872216Z [2024-02-24 02:31:03,166: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:31:03.167112670Z [2024-02-24 02:31:03,166: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:31:03.167604798Z [2024-02-24 02:31:03,167: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:31:03.167978056Z [2024-02-24 02:31:03,167: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:31:03.263951698Z [2024-02-24 02:31:03,263: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:31:04.616973129Z [2024-02-24 02:31:04,616: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[72312885-b8d8-496d-9724-d4a0dc99c3ac] succeeded in 3.364689972000633s: None
2024-02-24T02:31:05.262616101Z [2024-02-24 02:31:05,261: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4d69eb96-6e11-4013-85a8-6001c03876a5] succeeded in 4.03013060900048s: None
2024-02-24T02:32:01.063043570Z [2024-02-24 02:32:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23d43fa6-d89e-428e-87ee-aee7fa1375ad] received
2024-02-24T02:32:01.064852129Z [2024-02-24 02:32:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5363a8f2-f590-4d56-83d3-c1686d98451b] received
2024-02-24T02:32:01.074984552Z [2024-02-24 02:32:01,074: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[258492e4-b775-4643-9876-955ae1eedd94] received
2024-02-24T02:32:01.076623302Z [2024-02-24 02:32:01,076: INFO/ForkPoolWorker-16] [5363a8f2-f590-4d56-83d3-c1686d98451b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:32:01.082178166Z [2024-02-24 02:32:01,081: INFO/ForkPoolWorker-1] [258492e4-b775-4643-9876-955ae1eedd94] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:32:01.085731609Z [2024-02-24 02:32:01,085: INFO/ForkPoolWorker-15] [23d43fa6-d89e-428e-87ee-aee7fa1375ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:32:01.090630335Z [2024-02-24 02:32:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[078a610a-7c05-42fb-aa5b-0cc44b5a107a] received
2024-02-24T02:32:01.098436494Z [2024-02-24 02:32:01,098: INFO/ForkPoolWorker-2] [078a610a-7c05-42fb-aa5b-0cc44b5a107a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:32:01.476648231Z [2024-02-24 02:32:01,473: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:32:01.495117770Z [2024-02-24 02:32:01,490: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:32:01.545493805Z [2024-02-24 02:32:01,540: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:32:01.614223126Z [2024-02-24 02:32:01,610: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:32:01.638522896Z [2024-02-24 02:32:01,638: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:32:01.646450709Z [2024-02-24 02:32:01,645: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:32:01.692544861Z [2024-02-24 02:32:01,692: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:32:01.698613773Z [2024-02-24 02:32:01,698: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:32:01.698640190Z [2024-02-24 02:32:01,698: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:32:01.698700527Z [2024-02-24 02:32:01,698: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:32:01.698910630Z [2024-02-24 02:32:01,698: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:32:01.815576464Z [2024-02-24 02:32:01,815: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:32:01.882294409Z [2024-02-24 02:32:01,881: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:32:02.449747518Z [2024-02-24 02:32:02,449: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5363a8f2-f590-4d56-83d3-c1686d98451b] succeeded in 1.381338245999359s: None
2024-02-24T02:32:02.528361159Z [2024-02-24 02:32:02,527: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[258492e4-b775-4643-9876-955ae1eedd94] succeeded in 1.4518845900001907s: None
2024-02-24T02:32:02.947337254Z [2024-02-24 02:32:02,946: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:32:02.950978726Z [2024-02-24 02:32:02,950: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:32:02.972678220Z [2024-02-24 02:32:02,972: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:32:02.974548722Z [2024-02-24 02:32:02,974: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:32:02.974758985Z [2024-02-24 02:32:02,974: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:32:02.974988707Z [2024-02-24 02:32:02,974: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:32:02.975152776Z [2024-02-24 02:32:02,975: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:32:02.975507226Z [2024-02-24 02:32:02,975: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:32:02.975749953Z [2024-02-24 02:32:02,975: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:32:03.076065739Z [2024-02-24 02:32:03,075: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:32:03.173747604Z [2024-02-24 02:32:03,173: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:32:03.177509087Z [2024-02-24 02:32:03,176: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:32:03.205492362Z [2024-02-24 02:32:03,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:32:03.207159581Z [2024-02-24 02:32:03,206: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:32:03.207215318Z [2024-02-24 02:32:03,207: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:32:03.207382332Z [2024-02-24 02:32:03,207: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:32:03.207448954Z [2024-02-24 02:32:03,207: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:32:03.207765081Z [2024-02-24 02:32:03,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:32:03.207770632Z [2024-02-24 02:32:03,207: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:32:03.319806572Z [2024-02-24 02:32:03,319: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:32:04.954232675Z [2024-02-24 02:32:04,953: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[23d43fa6-d89e-428e-87ee-aee7fa1375ad] succeeded in 3.8887437129997124s: None
2024-02-24T02:32:05.682434708Z [2024-02-24 02:32:05,681: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[078a610a-7c05-42fb-aa5b-0cc44b5a107a] succeeded in 4.5900998420002s: None
2024-02-24T02:33:01.031295696Z [2024-02-24 02:33:01,030: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90a90332-ee8e-49ee-96d1-e9a77dacc382] received
2024-02-24T02:33:01.035794270Z [2024-02-24 02:33:01,035: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[917e5247-81d1-4b0d-971e-2363cad99ab7] received
2024-02-24T02:33:01.038939662Z [2024-02-24 02:33:01,038: INFO/ForkPoolWorker-15] [90a90332-ee8e-49ee-96d1-e9a77dacc382] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:33:01.038959435Z [2024-02-24 02:33:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cdbb7d9-e21d-4a8b-aaae-04b65ccb4801] received
2024-02-24T02:33:01.046821458Z [2024-02-24 02:33:01,046: INFO/ForkPoolWorker-16] [917e5247-81d1-4b0d-971e-2363cad99ab7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:33:01.049303920Z [2024-02-24 02:33:01,049: INFO/ForkPoolWorker-1] [0cdbb7d9-e21d-4a8b-aaae-04b65ccb4801] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:33:01.354579887Z [2024-02-24 02:33:01,351: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:33:01.451751060Z [2024-02-24 02:33:01,448: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:33:01.451946739Z [2024-02-24 02:33:01,448: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:33:01.631442279Z [2024-02-24 02:33:01,630: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:33:01.643678833Z [2024-02-24 02:33:01,640: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:33:01.686010411Z [2024-02-24 02:33:01,684: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:33:01.693864057Z [2024-02-24 02:33:01,690: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:33:01.693903381Z [2024-02-24 02:33:01,690: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:33:01.693908060Z [2024-02-24 02:33:01,691: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:33:01.693911319Z [2024-02-24 02:33:01,691: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:33:01.855084166Z [2024-02-24 02:33:01,854: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:33:02.698014465Z [2024-02-24 02:33:02,694: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0cdbb7d9-e21d-4a8b-aaae-04b65ccb4801] succeeded in 1.6542614239988325s: None
2024-02-24T02:33:02.821501992Z [2024-02-24 02:33:02,821: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:33:02.825354807Z [2024-02-24 02:33:02,824: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:33:02.852515934Z [2024-02-24 02:33:02,852: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:33:02.854550567Z [2024-02-24 02:33:02,854: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:33:02.854727751Z [2024-02-24 02:33:02,854: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:33:02.855137802Z [2024-02-24 02:33:02,854: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:33:02.855294428Z [2024-02-24 02:33:02,855: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:33:02.855564024Z [2024-02-24 02:33:02,855: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:33:02.855722835Z [2024-02-24 02:33:02,855: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:33:02.901580892Z [2024-02-24 02:33:02,901: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:33:02.905521330Z [2024-02-24 02:33:02,904: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:33:02.928419555Z [2024-02-24 02:33:02,928: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:33:02.930333733Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:33:02.930397537Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:33:02.930534073Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:33:02.930590260Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:33:02.930903844Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:33:02.930989386Z [2024-02-24 02:33:02,930: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:33:02.941619960Z [2024-02-24 02:33:02,941: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:33:03.012039421Z [2024-02-24 02:33:03,011: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:33:04.802984622Z [2024-02-24 02:33:04,802: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[90a90332-ee8e-49ee-96d1-e9a77dacc382] succeeded in 3.7698474029984936s: None
2024-02-24T02:33:05.108790930Z [2024-02-24 02:33:05,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[917e5247-81d1-4b0d-971e-2363cad99ab7] succeeded in 4.070891145998758s: None
2024-02-24T02:34:01.023226638Z [2024-02-24 02:34:01,022: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[684f71a8-c9ac-43e2-8440-49cf62687499] received
2024-02-24T02:34:01.041141339Z [2024-02-24 02:34:01,040: INFO/ForkPoolWorker-15] [684f71a8-c9ac-43e2-8440-49cf62687499] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:34:01.048660334Z [2024-02-24 02:34:01,048: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[556e6484-fb94-4351-b3b8-603a37ae527e] received
2024-02-24T02:34:01.050345630Z [2024-02-24 02:34:01,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d82e2fa-7545-4557-b47f-8a47a0fec2b3] received
2024-02-24T02:34:01.052111130Z [2024-02-24 02:34:01,051: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[faa13534-21c7-4ade-a4c4-cb0d1ac22eb5] received
2024-02-24T02:34:01.063470357Z [2024-02-24 02:34:01,063: INFO/ForkPoolWorker-2] [faa13534-21c7-4ade-a4c4-cb0d1ac22eb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:34:01.069172228Z [2024-02-24 02:34:01,068: INFO/ForkPoolWorker-16] [556e6484-fb94-4351-b3b8-603a37ae527e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:34:01.071093236Z [2024-02-24 02:34:01,070: INFO/ForkPoolWorker-1] [1d82e2fa-7545-4557-b47f-8a47a0fec2b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:34:01.528046049Z [2024-02-24 02:34:01,525: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:34:01.583774883Z [2024-02-24 02:34:01,579: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:34:01.717134798Z [2024-02-24 02:34:01,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:34:01.784566289Z [2024-02-24 02:34:01,784: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:34:01.788680904Z [2024-02-24 02:34:01,788: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:34:01.798376871Z [2024-02-24 02:34:01,788: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:34:01.830990180Z [2024-02-24 02:34:01,830: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:34:01.836519726Z [2024-02-24 02:34:01,836: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:34:01.836761855Z [2024-02-24 02:34:01,836: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:34:01.836924793Z [2024-02-24 02:34:01,836: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:34:01.837235134Z [2024-02-24 02:34:01,837: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:34:02.086210415Z [2024-02-24 02:34:02,085: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:34:02.113655262Z [2024-02-24 02:34:02,113: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:34:03.182808511Z [2024-02-24 02:34:03,182: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1d82e2fa-7545-4557-b47f-8a47a0fec2b3] succeeded in 2.126508647999799s: None
2024-02-24T02:34:03.286974265Z [2024-02-24 02:34:03,286: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[556e6484-fb94-4351-b3b8-603a37ae527e] succeeded in 2.2356511680009135s: None
2024-02-24T02:34:03.297180973Z [2024-02-24 02:34:03,296: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:34:03.300575584Z [2024-02-24 02:34:03,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:34:03.334903744Z [2024-02-24 02:34:03,334: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:34:03.342881960Z [2024-02-24 02:34:03,342: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:34:03.342910013Z [2024-02-24 02:34:03,342: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:34:03.343083905Z [2024-02-24 02:34:03,342: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:34:03.343183526Z [2024-02-24 02:34:03,343: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:34:03.343574181Z [2024-02-24 02:34:03,343: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:34:03.343642422Z [2024-02-24 02:34:03,343: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:34:03.426786610Z [2024-02-24 02:34:03,426: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:34:04.136319272Z [2024-02-24 02:34:04,135: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:34:04.140783233Z [2024-02-24 02:34:04,140: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:34:04.171464272Z [2024-02-24 02:34:04,171: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:34:04.174823580Z [2024-02-24 02:34:04,174: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:34:04.175792422Z [2024-02-24 02:34:04,175: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:34:04.176029786Z [2024-02-24 02:34:04,175: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:34:04.177102582Z [2024-02-24 02:34:04,176: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:34:04.177527231Z [2024-02-24 02:34:04,177: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:34:04.177869834Z [2024-02-24 02:34:04,177: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:34:04.258343408Z [2024-02-24 02:34:04,258: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:34:05.606119838Z [2024-02-24 02:34:05,605: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[684f71a8-c9ac-43e2-8440-49cf62687499] succeeded in 4.5725820870011376s: None
2024-02-24T02:34:08.242612191Z [2024-02-24 02:34:08,242: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[faa13534-21c7-4ade-a4c4-cb0d1ac22eb5] succeeded in 7.188380405999851s: None
2024-02-24T02:35:00.909140008Z [2024-02-24 02:35:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bde1f27a-6fef-4de5-bee4-3217e8f91237] received
2024-02-24T02:35:00.914687715Z [2024-02-24 02:35:00,914: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6f9b8d3-46e7-40ea-80bd-8c30232f303c] received
2024-02-24T02:35:00.922172361Z [2024-02-24 02:35:00,921: INFO/ForkPoolWorker-15] [bde1f27a-6fef-4de5-bee4-3217e8f91237] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:35:00.923835374Z [2024-02-24 02:35:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0d268d2b-1d1a-44fc-be0c-fad589814c23] received
2024-02-24T02:35:00.926377119Z [2024-02-24 02:35:00,925: INFO/ForkPoolWorker-16] [e6f9b8d3-46e7-40ea-80bd-8c30232f303c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:35:00.931604053Z [2024-02-24 02:35:00,931: INFO/ForkPoolWorker-1] [0d268d2b-1d1a-44fc-be0c-fad589814c23] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:35:00.931725181Z [2024-02-24 02:35:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d65f8d21-1bf9-462c-9d8f-6c4948d546d1] received
2024-02-24T02:35:00.944284422Z [2024-02-24 02:35:00,943: INFO/ForkPoolWorker-2] [d65f8d21-1bf9-462c-9d8f-6c4948d546d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:35:01.295132028Z [2024-02-24 02:35:01,289: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:35:01.297661811Z [2024-02-24 02:35:01,294: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:35:01.448951481Z [2024-02-24 02:35:01,445: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:35:01.499553586Z [2024-02-24 02:35:01,499: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:35:01.503685660Z [2024-02-24 02:35:01,503: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:01.543610853Z [2024-02-24 02:35:01,539: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:35:01.545252413Z [2024-02-24 02:35:01,545: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:35:01.547148347Z [2024-02-24 02:35:01,546: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:35:01.547269438Z [2024-02-24 02:35:01,547: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:35:01.547332287Z [2024-02-24 02:35:01,547: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:35:01.547583026Z [2024-02-24 02:35:01,547: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:35:01.674774775Z [2024-02-24 02:35:01,674: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:02.407154430Z [2024-02-24 02:35:02,406: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d65f8d21-1bf9-462c-9d8f-6c4948d546d1] succeeded in 1.4735792520004907s: None
2024-02-24T02:35:02.891361577Z [2024-02-24 02:35:02,890: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:35:02.894767429Z [2024-02-24 02:35:02,894: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:02.926892794Z [2024-02-24 02:35:02,926: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:35:02.931008483Z [2024-02-24 02:35:02,930: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:02.931029140Z [2024-02-24 02:35:02,930: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:02.931078793Z [2024-02-24 02:35:02,930: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:02.931245381Z [2024-02-24 02:35:02,931: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:35:02.931493260Z [2024-02-24 02:35:02,931: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:35:02.931528374Z [2024-02-24 02:35:02,931: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:03.045410493Z [2024-02-24 02:35:03,044: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:35:03.048390458Z [2024-02-24 02:35:03,048: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:03.050382130Z [2024-02-24 02:35:03,049: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:03.080969355Z [2024-02-24 02:35:03,080: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:35:03.082912421Z [2024-02-24 02:35:03,082: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:03.082994045Z [2024-02-24 02:35:03,082: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:03.083242221Z [2024-02-24 02:35:03,082: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:03.083335137Z [2024-02-24 02:35:03,083: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:35:03.084157030Z [2024-02-24 02:35:03,083: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:35:03.084252546Z [2024-02-24 02:35:03,084: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:03.128527426Z [2024-02-24 02:35:03,128: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:35:03.132614219Z [2024-02-24 02:35:03,131: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:03.187000107Z [2024-02-24 02:35:03,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:35:03.189085254Z [2024-02-24 02:35:03,188: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:03.189111265Z [2024-02-24 02:35:03,188: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:03.189195182Z [2024-02-24 02:35:03,188: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:03.189329872Z [2024-02-24 02:35:03,189: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:35:03.189935285Z [2024-02-24 02:35:03,189: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:35:03.190018927Z [2024-02-24 02:35:03,189: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:03.234564138Z [2024-02-24 02:35:03,234: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:03.321583662Z [2024-02-24 02:35:03,321: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:04.133823258Z [2024-02-24 02:35:04,133: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bde1f27a-6fef-4de5-bee4-3217e8f91237] succeeded in 3.2177600380000513s: None
2024-02-24T02:35:04.980394308Z [2024-02-24 02:35:04,979: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0d268d2b-1d1a-44fc-be0c-fad589814c23] succeeded in 4.054651333999573s: None
2024-02-24T02:35:05.018182803Z [2024-02-24 02:35:05,017: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[697bb3e0-5c0a-46f8-bb39-8d19755235cc] received
2024-02-24T02:35:05.035968784Z [2024-02-24 02:35:05,035: INFO/ForkPoolWorker-15] [697bb3e0-5c0a-46f8-bb39-8d19755235cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:35:05.378069244Z [2024-02-24 02:35:05,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:35:05.876452359Z [2024-02-24 02:35:05,875: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6f9b8d3-46e7-40ea-80bd-8c30232f303c] succeeded in 4.959339992999958s: None
2024-02-24T02:35:06.593661757Z [2024-02-24 02:35:06,593: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:35:06.596967081Z [2024-02-24 02:35:06,596: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:06.623334815Z [2024-02-24 02:35:06,623: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:35:06.624766668Z [2024-02-24 02:35:06,624: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:06.624853741Z [2024-02-24 02:35:06,624: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:06.625021563Z [2024-02-24 02:35:06,624: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:06.625083031Z [2024-02-24 02:35:06,625: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:35:06.625368441Z [2024-02-24 02:35:06,625: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:35:06.625473401Z [2024-02-24 02:35:06,625: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:06.704089896Z [2024-02-24 02:35:06,703: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:07.296765783Z [2024-02-24 02:35:07,296: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[697bb3e0-5c0a-46f8-bb39-8d19755235cc] succeeded in 2.2747161989991582s: None
2024-02-24T02:35:07.567780647Z [2024-02-24 02:35:07,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b8158340-b03f-4fb5-a3f3-5c494142a683] received
2024-02-24T02:35:07.576328434Z [2024-02-24 02:35:07,576: INFO/ForkPoolWorker-15] [b8158340-b03f-4fb5-a3f3-5c494142a683] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:35:07.855749620Z [2024-02-24 02:35:07,852: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:35:08.881622415Z [2024-02-24 02:35:08,881: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:35:08.884812061Z [2024-02-24 02:35:08,884: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:08.906221137Z [2024-02-24 02:35:08,905: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:35:08.907822699Z [2024-02-24 02:35:08,907: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:08.908023938Z [2024-02-24 02:35:08,907: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:08.908361871Z [2024-02-24 02:35:08,907: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:08.908534747Z [2024-02-24 02:35:08,908: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:35:08.908935028Z [2024-02-24 02:35:08,908: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:35:08.908965114Z [2024-02-24 02:35:08,908: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:09.006723265Z [2024-02-24 02:35:09,006: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:09.591981324Z [2024-02-24 02:35:09,591: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b8158340-b03f-4fb5-a3f3-5c494142a683] succeeded in 2.021018544000981s: None
2024-02-24T02:35:09.901355229Z [2024-02-24 02:35:09,900: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3556eed4-1b08-4c7f-a701-22fbba2f9e0d] received
2024-02-24T02:35:09.908402195Z [2024-02-24 02:35:09,908: INFO/ForkPoolWorker-15] [3556eed4-1b08-4c7f-a701-22fbba2f9e0d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:35:10.194860854Z [2024-02-24 02:35:10,191: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:35:11.253344157Z [2024-02-24 02:35:11,252: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:35:11.256293762Z [2024-02-24 02:35:11,255: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:35:11.303338983Z [2024-02-24 02:35:11,297: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:35:11.303382456Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:35:11.303391628Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:35:11.303397257Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:35:11.303402611Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:35:11.303407060Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:35:11.303412056Z [2024-02-24 02:35:11,299: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:35:11.387750914Z [2024-02-24 02:35:11,387: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:35:11.967069980Z [2024-02-24 02:35:11,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3556eed4-1b08-4c7f-a701-22fbba2f9e0d] succeeded in 2.063820596000369s: None
2024-02-24T02:36:00.351906747Z [2024-02-24 02:36:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a4e2400-2292-4c55-97d9-e9debcf066ea] received
2024-02-24T02:36:00.354631720Z [2024-02-24 02:36:00,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a0b1be1-cb23-460c-b93c-ece2c8edc603] received
2024-02-24T02:36:00.360825655Z [2024-02-24 02:36:00,360: INFO/ForkPoolWorker-16] [5a0b1be1-cb23-460c-b93c-ece2c8edc603] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:36:00.363284426Z [2024-02-24 02:36:00,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91a75182-884b-41d3-80c1-56d8120e6df5] received
2024-02-24T02:36:00.363300341Z [2024-02-24 02:36:00,363: INFO/ForkPoolWorker-15] [1a4e2400-2292-4c55-97d9-e9debcf066ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:36:00.386236254Z [2024-02-24 02:36:00,383: INFO/ForkPoolWorker-1] [91a75182-884b-41d3-80c1-56d8120e6df5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:36:00.387031252Z [2024-02-24 02:36:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f75a41f2-18bb-4935-a517-12bb0c33a9ed] received
2024-02-24T02:36:00.392613010Z [2024-02-24 02:36:00,392: INFO/ForkPoolWorker-2] [f75a41f2-18bb-4935-a517-12bb0c33a9ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:36:00.673187166Z [2024-02-24 02:36:00,670: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:36:00.754396116Z [2024-02-24 02:36:00,735: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:36:00.835316663Z [2024-02-24 02:36:00,830: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:36:00.848003691Z [2024-02-24 02:36:00,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:36:01.041067087Z [2024-02-24 02:36:01,040: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:36:01.046113478Z [2024-02-24 02:36:01,045: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:36:01.095920976Z [2024-02-24 02:36:01,095: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:36:01.106531230Z [2024-02-24 02:36:01,106: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:36:01.106796819Z [2024-02-24 02:36:01,106: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:36:01.106849012Z [2024-02-24 02:36:01,106: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:36:01.107200631Z [2024-02-24 02:36:01,107: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:36:01.125046322Z [2024-02-24 02:36:01,124: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:36:01.447582072Z [2024-02-24 02:36:01,447: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:36:02.090791545Z [2024-02-24 02:36:02,090: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a4e2400-2292-4c55-97d9-e9debcf066ea] succeeded in 1.7345504479999363s: None
2024-02-24T02:36:02.292887531Z [2024-02-24 02:36:02,292: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f75a41f2-18bb-4935-a517-12bb0c33a9ed] succeeded in 1.9043024759994296s: None
2024-02-24T02:36:02.468254437Z [2024-02-24 02:36:02,466: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:36:02.483240876Z [2024-02-24 02:36:02,478: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:36:02.509854683Z [2024-02-24 02:36:02,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:36:02.510794807Z [2024-02-24 02:36:02,510: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:36:02.510909091Z [2024-02-24 02:36:02,510: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:36:02.511095402Z [2024-02-24 02:36:02,510: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:36:02.511207766Z [2024-02-24 02:36:02,511: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:36:02.511445992Z [2024-02-24 02:36:02,511: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:36:02.511545341Z [2024-02-24 02:36:02,511: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:36:02.535116495Z [2024-02-24 02:36:02,534: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:36:02.538564334Z [2024-02-24 02:36:02,538: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:36:02.564598052Z [2024-02-24 02:36:02,564: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:36:02.565910125Z [2024-02-24 02:36:02,565: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:36:02.566016713Z [2024-02-24 02:36:02,565: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:36:02.566170008Z [2024-02-24 02:36:02,565: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:36:02.566208829Z [2024-02-24 02:36:02,566: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:36:02.566584350Z [2024-02-24 02:36:02,566: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:36:02.566599783Z [2024-02-24 02:36:02,566: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:36:02.613259176Z [2024-02-24 02:36:02,612: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:36:02.728476656Z [2024-02-24 02:36:02,728: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:36:04.211397963Z [2024-02-24 02:36:04,210: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[91a75182-884b-41d3-80c1-56d8120e6df5] succeeded in 3.845622937000371s: None
2024-02-24T02:36:04.660650361Z [2024-02-24 02:36:04,660: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a0b1be1-cb23-460c-b93c-ece2c8edc603] succeeded in 4.304272344999845s: None
2024-02-24T02:37:00.721216032Z [2024-02-24 02:37:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5605be0c-e096-4196-b3a5-bcfd4b381e76] received
2024-02-24T02:37:00.730141998Z [2024-02-24 02:37:00,729: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e4d8f35-5c03-48ba-a273-3de0501dbcc8] received
2024-02-24T02:37:00.730428988Z [2024-02-24 02:37:00,730: INFO/ForkPoolWorker-15] [5605be0c-e096-4196-b3a5-bcfd4b381e76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:37:00.739141878Z [2024-02-24 02:37:00,738: INFO/ForkPoolWorker-16] [8e4d8f35-5c03-48ba-a273-3de0501dbcc8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:37:00.747954367Z [2024-02-24 02:37:00,747: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ae9ac12-cb8b-42f1-bef0-38a952abf68a] received
2024-02-24T02:37:00.754621774Z [2024-02-24 02:37:00,754: INFO/ForkPoolWorker-1] [5ae9ac12-cb8b-42f1-bef0-38a952abf68a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:37:01.094483518Z [2024-02-24 02:37:01,091: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:37:01.100457181Z [2024-02-24 02:37:01,096: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:37:01.158312979Z [2024-02-24 02:37:01,151: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:37:01.250342383Z [2024-02-24 02:37:01,249: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:37:01.254219929Z [2024-02-24 02:37:01,253: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:37:01.275965229Z [2024-02-24 02:37:01,275: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:37:01.290027702Z [2024-02-24 02:37:01,289: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:37:01.290050924Z [2024-02-24 02:37:01,289: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:37:01.290055021Z [2024-02-24 02:37:01,289: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:37:01.290058114Z [2024-02-24 02:37:01,289: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:37:01.381743096Z [2024-02-24 02:37:01,381: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:37:02.070248880Z [2024-02-24 02:37:02,069: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e4d8f35-5c03-48ba-a273-3de0501dbcc8] succeeded in 1.3384687670004496s: None
2024-02-24T02:37:02.312086816Z [2024-02-24 02:37:02,311: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:37:02.315280517Z [2024-02-24 02:37:02,314: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:37:02.337148178Z [2024-02-24 02:37:02,336: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:37:02.338479808Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:37:02.338497363Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:37:02.338595113Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:37:02.338634315Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:37:02.338878872Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:37:02.338899778Z [2024-02-24 02:37:02,338: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:37:02.361844538Z [2024-02-24 02:37:02,356: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:37:02.361866104Z [2024-02-24 02:37:02,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:37:02.407611364Z [2024-02-24 02:37:02,407: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:37:02.412555399Z [2024-02-24 02:37:02,412: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:37:02.412580789Z [2024-02-24 02:37:02,412: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:37:02.412720474Z [2024-02-24 02:37:02,412: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:37:02.412843388Z [2024-02-24 02:37:02,412: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:37:02.413208229Z [2024-02-24 02:37:02,412: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:37:02.413233253Z [2024-02-24 02:37:02,413: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:37:02.456129702Z [2024-02-24 02:37:02,455: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:37:02.515068957Z [2024-02-24 02:37:02,514: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:37:04.541173817Z [2024-02-24 02:37:04,540: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ae9ac12-cb8b-42f1-bef0-38a952abf68a] succeeded in 3.7915025069996773s: None
2024-02-24T02:37:04.679451097Z [2024-02-24 02:37:04,678: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5605be0c-e096-4196-b3a5-bcfd4b381e76] succeeded in 3.954885629000273s: None
2024-02-24T02:37:38.259345245Z [2024-02-24 02:37:38,259: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d850f193-cfb9-4f3a-9d29-e1f710df912c] received
2024-02-24T02:37:38.268603170Z [2024-02-24 02:37:38,268: INFO/ForkPoolWorker-15] [d850f193-cfb9-4f3a-9d29-e1f710df912c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224023737_681209', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T02:37:38.524764796Z [2024-02-24 02:37:38,521: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T02:37:38.801317504Z [2024-02-24 02:37:38,801: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224023737_681209 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:37:39.393663942Z [2024-02-24 02:37:39,393: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d850f193-cfb9-4f3a-9d29-e1f710df912c] succeeded in 1.132416510999974s: None
2024-02-24T02:38:00.688669671Z [2024-02-24 02:38:00,688: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e739a78-7cca-4bc8-91fa-df13879e6ade] received
2024-02-24T02:38:00.694052754Z [2024-02-24 02:38:00,693: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e07ee277-16ed-4518-8687-e0ec900c7827] received
2024-02-24T02:38:00.700197654Z [2024-02-24 02:38:00,699: INFO/ForkPoolWorker-16] [e07ee277-16ed-4518-8687-e0ec900c7827] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:38:00.700961647Z [2024-02-24 02:38:00,700: INFO/ForkPoolWorker-15] [8e739a78-7cca-4bc8-91fa-df13879e6ade] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:38:00.709060463Z [2024-02-24 02:38:00,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53f21bb7-e5ab-4167-afc9-827f6b20782e] received
2024-02-24T02:38:00.715391189Z [2024-02-24 02:38:00,715: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3e1d23d-0a09-418d-bc4f-511ed33d68d6] received
2024-02-24T02:38:00.731045627Z [2024-02-24 02:38:00,730: INFO/ForkPoolWorker-2] [f3e1d23d-0a09-418d-bc4f-511ed33d68d6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:38:00.732016785Z [2024-02-24 02:38:00,731: INFO/ForkPoolWorker-1] [53f21bb7-e5ab-4167-afc9-827f6b20782e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:38:01.092801105Z [2024-02-24 02:38:01,089: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:38:01.105214975Z [2024-02-24 02:38:01,101: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:38:01.112022406Z [2024-02-24 02:38:01,108: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:38:01.125117431Z [2024-02-24 02:38:01,122: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:38:01.409038223Z [2024-02-24 02:38:01,408: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:38:01.412789241Z [2024-02-24 02:38:01,412: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:38:01.414435280Z [2024-02-24 02:38:01,414: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:38:01.458745266Z [2024-02-24 02:38:01,458: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:38:01.462687267Z [2024-02-24 02:38:01,462: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:38:01.462756245Z [2024-02-24 02:38:01,462: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:38:01.462866986Z [2024-02-24 02:38:01,462: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:38:01.463140428Z [2024-02-24 02:38:01,463: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:38:01.555728287Z [2024-02-24 02:38:01,555: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:38:02.007260728Z [2024-02-24 02:38:02,006: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e739a78-7cca-4bc8-91fa-df13879e6ade] succeeded in 1.3163281259985524s: None
2024-02-24T02:38:02.111735574Z [2024-02-24 02:38:02,109: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f3e1d23d-0a09-418d-bc4f-511ed33d68d6] succeeded in 1.392130124000687s: None
2024-02-24T02:38:02.592603260Z [2024-02-24 02:38:02,592: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:38:02.598005607Z [2024-02-24 02:38:02,597: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:38:02.621321268Z [2024-02-24 02:38:02,620: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:38:02.621333099Z [2024-02-24 02:38:02,621: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:38:02.623492567Z [2024-02-24 02:38:02,623: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:38:02.623515760Z [2024-02-24 02:38:02,623: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:38:02.623855180Z [2024-02-24 02:38:02,623: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:38:02.623863467Z [2024-02-24 02:38:02,623: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:38:02.624251639Z [2024-02-24 02:38:02,624: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:38:02.624399430Z [2024-02-24 02:38:02,624: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:38:02.624868475Z [2024-02-24 02:38:02,624: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:38:02.746440956Z [2024-02-24 02:38:02,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:38:02.753955295Z [2024-02-24 02:38:02,753: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:38:02.753975485Z [2024-02-24 02:38:02,753: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:38:02.754046851Z [2024-02-24 02:38:02,753: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:38:02.754089285Z [2024-02-24 02:38:02,754: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:38:02.754407792Z [2024-02-24 02:38:02,754: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:38:02.754432494Z [2024-02-24 02:38:02,754: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:38:02.825650948Z [2024-02-24 02:38:02,825: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:38:02.854758634Z [2024-02-24 02:38:02,854: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:38:05.758314312Z [2024-02-24 02:38:05,757: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[53f21bb7-e5ab-4167-afc9-827f6b20782e] succeeded in 5.04294198199932s: None
2024-02-24T02:38:05.973062571Z [2024-02-24 02:38:05,972: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e07ee277-16ed-4518-8687-e0ec900c7827] succeeded in 5.27743882499999s: None
2024-02-24T02:39:00.562631215Z [2024-02-24 02:39:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b3e6405-5203-4867-b5d6-51c1fbcc63a7] received
2024-02-24T02:39:00.564473874Z [2024-02-24 02:39:00,564: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e5f6362-149d-4060-ade8-d057216dfb8a] received
2024-02-24T02:39:00.572121108Z [2024-02-24 02:39:00,571: INFO/ForkPoolWorker-16] [0e5f6362-149d-4060-ade8-d057216dfb8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:39:00.576602545Z [2024-02-24 02:39:00,576: INFO/ForkPoolWorker-15] [0b3e6405-5203-4867-b5d6-51c1fbcc63a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:39:00.583498332Z [2024-02-24 02:39:00,583: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bc842f39-3441-47f6-8f3b-891239e7ecae] received
2024-02-24T02:39:00.598898509Z [2024-02-24 02:39:00,598: INFO/ForkPoolWorker-1] [bc842f39-3441-47f6-8f3b-891239e7ecae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:39:00.890093610Z [2024-02-24 02:39:00,887: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:39:00.910229996Z [2024-02-24 02:39:00,906: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:39:00.944587331Z [2024-02-24 02:39:00,940: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:39:01.084852273Z [2024-02-24 02:39:01,084: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:39:01.089045511Z [2024-02-24 02:39:01,088: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:01.109102634Z [2024-02-24 02:39:01,108: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:39:01.110716457Z [2024-02-24 02:39:01,110: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:39:01.110897073Z [2024-02-24 02:39:01,110: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:39:01.111014092Z [2024-02-24 02:39:01,110: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:39:01.111259384Z [2024-02-24 02:39:01,111: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:39:01.269970872Z [2024-02-24 02:39:01,265: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:01.877656276Z [2024-02-24 02:39:01,877: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0e5f6362-149d-4060-ade8-d057216dfb8a] succeeded in 1.3114934079985687s: None
2024-02-24T02:39:02.166387275Z [2024-02-24 02:39:02,164: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:39:02.171944559Z [2024-02-24 02:39:02,171: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:02.207520252Z [2024-02-24 02:39:02,207: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:39:02.209061762Z [2024-02-24 02:39:02,208: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:02.209078355Z [2024-02-24 02:39:02,208: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:02.209087495Z [2024-02-24 02:39:02,209: INFO/ForkPoolWorker-15] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:02.209241180Z [2024-02-24 02:39:02,209: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:02.209279194Z [2024-02-24 02:39:02,209: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:39:02.209569501Z [2024-02-24 02:39:02,209: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:39:02.209665409Z [2024-02-24 02:39:02,209: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:02.215552365Z [2024-02-24 02:39:02,215: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:02.322859629Z [2024-02-24 02:39:02,322: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:02.360172632Z [2024-02-24 02:39:02,359: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:39:02.363903983Z [2024-02-24 02:39:02,363: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:02.419634633Z [2024-02-24 02:39:02,419: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:39:02.421715786Z [2024-02-24 02:39:02,421: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:02.421739582Z [2024-02-24 02:39:02,421: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:02.421875307Z [2024-02-24 02:39:02,421: INFO/ForkPoolWorker-1] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:02.422096962Z [2024-02-24 02:39:02,421: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:02.422223511Z [2024-02-24 02:39:02,422: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:39:02.422508746Z [2024-02-24 02:39:02,422: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:39:02.422663499Z [2024-02-24 02:39:02,422: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:02.428984998Z [2024-02-24 02:39:02,428: INFO/ForkPoolWorker-1] Creating DAG vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:02.528655859Z [2024-02-24 02:39:02,528: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:05.026182477Z [2024-02-24 02:39:05,025: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0b3e6405-5203-4867-b5d6-51c1fbcc63a7] succeeded in 4.459958830000687s: None
2024-02-24T02:39:06.000601799Z [2024-02-24 02:39:06,000: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bc842f39-3441-47f6-8f3b-891239e7ecae] succeeded in 5.415107839000484s: None
2024-02-24T02:39:13.623988436Z [2024-02-24 02:39:13,623: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a84770a-e2ce-45cd-8438-c4a71cb9cb9d] received
2024-02-24T02:39:13.638918526Z [2024-02-24 02:39:13,638: INFO/ForkPoolWorker-15] [5a84770a-e2ce-45cd-8438-c4a71cb9cb9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:39:13.921612337Z [2024-02-24 02:39:13,918: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:39:14.946621365Z [2024-02-24 02:39:14,946: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:39:14.949738715Z [2024-02-24 02:39:14,949: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:14.965398515Z [2024-02-24 02:39:14,965: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:39:14.966580968Z [2024-02-24 02:39:14,966: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:14.966670696Z [2024-02-24 02:39:14,966: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:14.966725197Z [2024-02-24 02:39:14,966: INFO/ForkPoolWorker-15] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:14.966894159Z [2024-02-24 02:39:14,966: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:14.966945526Z [2024-02-24 02:39:14,966: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:39:14.967181313Z [2024-02-24 02:39:14,967: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:39:14.967270385Z [2024-02-24 02:39:14,967: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:14.972772534Z [2024-02-24 02:39:14,972: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:15.032809565Z [2024-02-24 02:39:15,032: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.extract_metrics_from_vnfrs scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:15.565034165Z [2024-02-24 02:39:15,564: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a84770a-e2ce-45cd-8438-c4a71cb9cb9d] succeeded in 1.9389790400000493s: None
2024-02-24T02:39:15.988990856Z [2024-02-24 02:39:15,988: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39a8b7af-23e8-48ae-adca-ea9be545c986] received
2024-02-24T02:39:15.996071403Z [2024-02-24 02:39:15,995: INFO/ForkPoolWorker-15] [39a8b7af-23e8-48ae-adca-ea9be545c986] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'split_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:39:16.257875515Z [2024-02-24 02:39:16,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:39:17.328789097Z [2024-02-24 02:39:17,328: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:39:17.332032666Z [2024-02-24 02:39:17,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:17.359656484Z [2024-02-24 02:39:17,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:39:17.362401797Z [2024-02-24 02:39:17,362: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:17.362639721Z [2024-02-24 02:39:17,362: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:17.362876518Z [2024-02-24 02:39:17,362: INFO/ForkPoolWorker-15] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:17.363240215Z [2024-02-24 02:39:17,362: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:17.363500451Z [2024-02-24 02:39:17,363: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:39:17.364034640Z [2024-02-24 02:39:17,363: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:39:17.364349958Z [2024-02-24 02:39:17,364: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:17.375279446Z [2024-02-24 02:39:17,374: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:17.447609423Z [2024-02-24 02:39:17,447: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.split_metrics scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:18.052085130Z [2024-02-24 02:39:18,051: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39a8b7af-23e8-48ae-adca-ea9be545c986] succeeded in 2.0612407549997442s: None
2024-02-24T02:39:19.064088169Z [2024-02-24 02:39:19,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[21323f6e-543f-4faa-93e1-d06b63e568ff] received
2024-02-24T02:39:19.068917998Z [2024-02-24 02:39:19,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98cd126e-02b3-4057-ad1f-64fa0135a1b9] received
2024-02-24T02:39:19.077510364Z [2024-02-24 02:39:19,077: INFO/ForkPoolWorker-16] [98cd126e-02b3-4057-ad1f-64fa0135a1b9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:39:19.086289679Z [2024-02-24 02:39:19,086: INFO/ForkPoolWorker-15] [21323f6e-543f-4faa-93e1-d06b63e568ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'collect_metrics', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:39:19.333802076Z [2024-02-24 02:39:19,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:39:19.380480120Z [2024-02-24 02:39:19,376: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:39:20.483486197Z [2024-02-24 02:39:20,483: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:39:20.486781205Z [2024-02-24 02:39:20,486: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:20.490824584Z [2024-02-24 02:39:20,490: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:39:20.494019353Z [2024-02-24 02:39:20,493: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:20.514632327Z [2024-02-24 02:39:20,514: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:39:20.515322936Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:39:20.515753765Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:20.515766833Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:20.515827893Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-15] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:20.516045447Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:20.516055315Z [2024-02-24 02:39:20,515: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:39:20.516323522Z [2024-02-24 02:39:20,516: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:39:20.516333756Z [2024-02-24 02:39:20,516: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:20.517585708Z [2024-02-24 02:39:20,517: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:20.517916112Z [2024-02-24 02:39:20,517: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:20.518419008Z [2024-02-24 02:39:20,518: INFO/ForkPoolWorker-16] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:20.518915374Z [2024-02-24 02:39:20,518: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:20.519233669Z [2024-02-24 02:39:20,519: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:39:20.519687304Z [2024-02-24 02:39:20,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:39:20.519944213Z [2024-02-24 02:39:20,519: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:20.522601033Z [2024-02-24 02:39:20,522: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:20.527121588Z [2024-02-24 02:39:20,526: INFO/ForkPoolWorker-16] Creating DAG vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:20.618165090Z [2024-02-24 02:39:20,617: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.collect_metrics scheduled__2024-02-24T02:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:20.624889673Z [2024-02-24 02:39:20,624: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:20.646304564Z [2024-02-24 02:39:20,645: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c562003-8715-44ad-93ee-186215f83cdf] received
2024-02-24T02:39:20.656324871Z [2024-02-24 02:39:20,656: INFO/ForkPoolWorker-1] [2c562003-8715-44ad-93ee-186215f83cdf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:39:20.967026507Z [2024-02-24 02:39:20,963: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:39:21.183144247Z [2024-02-24 02:39:21,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03d2abc2-8743-48eb-96a1-a19b2062b41b] received
2024-02-24T02:39:21.213315539Z [2024-02-24 02:39:21,212: INFO/ForkPoolWorker-2] [03d2abc2-8743-48eb-96a1-a19b2062b41b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'send_prometheus', 'scheduled__2024-02-24T02:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:39:21.262988547Z [2024-02-24 02:39:21,262: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[21323f6e-543f-4faa-93e1-d06b63e568ff] succeeded in 2.1963002499996946s: None
2024-02-24T02:39:21.539264344Z [2024-02-24 02:39:21,536: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:39:22.222130109Z [2024-02-24 02:39:22,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[98cd126e-02b3-4057-ad1f-64fa0135a1b9] succeeded in 3.1514534939997247s: None
2024-02-24T02:39:22.234797923Z [2024-02-24 02:39:22,234: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:39:22.237992707Z [2024-02-24 02:39:22,237: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:22.261290621Z [2024-02-24 02:39:22,261: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:39:22.262941732Z [2024-02-24 02:39:22,262: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:22.262999425Z [2024-02-24 02:39:22,262: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:22.263102497Z [2024-02-24 02:39:22,262: INFO/ForkPoolWorker-1] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:22.263283017Z [2024-02-24 02:39:22,263: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:22.263338231Z [2024-02-24 02:39:22,263: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:39:22.263706476Z [2024-02-24 02:39:22,263: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:39:22.263713517Z [2024-02-24 02:39:22,263: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:22.268103534Z [2024-02-24 02:39:22,267: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:22.366887929Z [2024-02-24 02:39:22,366: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:22.745636907Z [2024-02-24 02:39:22,745: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:39:22.752293279Z [2024-02-24 02:39:22,751: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:39:22.793352052Z [2024-02-24 02:39:22,793: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:39:22.795382184Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:39:22.795438779Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:39:22.795522611Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] Read VIM e3d0a28a-b3ee-4530-a90a-efa92840586d (basic01_063462)
2024-02-24T02:39:22.795683280Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': 'e3d0a28a-b3ee-4530-a90a-efa92840586d', 'name': 'basic01_063462', 'vim_type': 'openstack'}]
2024-02-24T02:39:22.795739119Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:39:22.796020615Z [2024-02-24 02:39:22,795: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:39:22.796083035Z [2024-02-24 02:39:22,796: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:39:22.801987504Z [2024-02-24 02:39:22,801: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d
2024-02-24T02:39:22.879865347Z [2024-02-24 02:39:22,879: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d.send_prometheus scheduled__2024-02-24T02:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:23.398691075Z [2024-02-24 02:39:23,398: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[03d2abc2-8743-48eb-96a1-a19b2062b41b] succeeded in 2.2137465729992982s: None
2024-02-24T02:39:24.511317346Z [2024-02-24 02:39:24,510: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2c562003-8715-44ad-93ee-186215f83cdf] succeeded in 3.8592978920005407s: None
2024-02-24T02:39:38.712514365Z [2024-02-24 02:39:38,712: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4e7c8d92-5711-448b-abc5-ef8043921c32] received
2024-02-24T02:39:38.723261542Z [2024-02-24 02:39:38,722: INFO/ForkPoolWorker-15] [4e7c8d92-5711-448b-abc5-ef8043921c32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224023937_351244', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T02:39:39.001254461Z [2024-02-24 02:39:38,998: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T02:39:39.308369933Z [2024-02-24 02:39:39,308: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224023937_351244 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:39:39.923508769Z [2024-02-24 02:39:39,922: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4e7c8d92-5711-448b-abc5-ef8043921c32] succeeded in 1.2086024539985374s: None
2024-02-24T02:40:01.302318395Z [2024-02-24 02:40:01,302: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[601dadb5-f292-47d9-9c7c-d580b49da4c8] received
2024-02-24T02:40:01.304420516Z [2024-02-24 02:40:01,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5] received
2024-02-24T02:40:01.307284066Z [2024-02-24 02:40:01,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71cdf606-782b-498c-9bcc-5c5f2f261a17] received
2024-02-24T02:40:01.314947923Z [2024-02-24 02:40:01,314: INFO/ForkPoolWorker-1] [71cdf606-782b-498c-9bcc-5c5f2f261a17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:40:01.316342031Z [2024-02-24 02:40:01,316: INFO/ForkPoolWorker-15] [601dadb5-f292-47d9-9c7c-d580b49da4c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:40:01.319877634Z [2024-02-24 02:40:01,319: INFO/ForkPoolWorker-16] [e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:40:01.320071574Z [2024-02-24 02:40:01,319: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c248d074-df94-4113-b2d7-aabf49fd6c10] received
2024-02-24T02:40:01.321663406Z [2024-02-24 02:40:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6168a6d1-7ddc-444f-8329-e162d1d161a5] received
2024-02-24T02:40:01.329494681Z [2024-02-24 02:40:01,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cad89f49-52f9-4d12-9c0b-d14af2037ae8] received
2024-02-24T02:40:01.333482423Z [2024-02-24 02:40:01,333: INFO/ForkPoolWorker-2] [c248d074-df94-4113-b2d7-aabf49fd6c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:40:01.334439632Z [2024-02-24 02:40:01,334: INFO/ForkPoolWorker-3] [6168a6d1-7ddc-444f-8329-e162d1d161a5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:40:01.347931422Z [2024-02-24 02:40:01,347: INFO/ForkPoolWorker-4] [cad89f49-52f9-4d12-9c0b-d14af2037ae8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:40:01.352005780Z [2024-02-24 02:40:01,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbc6016e-ac7d-4f47-a762-6acfde22379b] received
2024-02-24T02:40:01.358515179Z [2024-02-24 02:40:01,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4d45f65-f42a-4093-8e26-8cd1589bb171] received
2024-02-24T02:40:01.370122132Z [2024-02-24 02:40:01,369: INFO/ForkPoolWorker-5] [bbc6016e-ac7d-4f47-a762-6acfde22379b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:40:01.374218342Z [2024-02-24 02:40:01,373: INFO/ForkPoolWorker-6] [b4d45f65-f42a-4093-8e26-8cd1589bb171] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:40:01.857055371Z [2024-02-24 02:40:01,853: INFO/ForkPoolWorker-5] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:40:02.065567992Z [2024-02-24 02:40:02,062: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:02.170817859Z [2024-02-24 02:40:02,155: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:02.181089150Z [2024-02-24 02:40:02,178: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:02.246614602Z [2024-02-24 02:40:02,236: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:02.283365406Z [2024-02-24 02:40:02,283: INFO/ForkPoolWorker-5] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:02.302589537Z [2024-02-24 02:40:02,277: INFO/ForkPoolWorker-4] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:02.534053038Z [2024-02-24 02:40:02,528: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:02.843406584Z [2024-02-24 02:40:02,819: INFO/ForkPoolWorker-6] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:40:03.283840399Z [2024-02-24 02:40:03,283: INFO/ForkPoolWorker-6] Getting SDNC list
2024-02-24T02:40:03.288110775Z [2024-02-24 02:40:03,287: INFO/ForkPoolWorker-6] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:03.341482407Z [2024-02-24 02:40:03,341: INFO/ForkPoolWorker-6] Connected to database osm version 1.2
2024-02-24T02:40:03.348136017Z [2024-02-24 02:40:03,347: INFO/ForkPoolWorker-6] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:40:03.348449442Z [2024-02-24 02:40:03,348: INFO/ForkPoolWorker-6] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:40:03.348650386Z [2024-02-24 02:40:03,348: INFO/ForkPoolWorker-6] Getting SDNC list OK
2024-02-24T02:40:03.349010666Z [2024-02-24 02:40:03,348: INFO/ForkPoolWorker-6] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:40:03.365280721Z [2024-02-24 02:40:03,364: INFO/ForkPoolWorker-5] Task airflow.executors.celery_executor.execute_command[bbc6016e-ac7d-4f47-a762-6acfde22379b] succeeded in 2.010621839999658s: None
2024-02-24T02:40:03.500579479Z [2024-02-24 02:40:03,500: INFO/ForkPoolWorker-6] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:04.609391128Z [2024-02-24 02:40:04,609: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:04.612510259Z [2024-02-24 02:40:04,612: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:04.619490693Z [2024-02-24 02:40:04,619: INFO/ForkPoolWorker-6] Task airflow.executors.celery_executor.execute_command[b4d45f65-f42a-4093-8e26-8cd1589bb171] succeeded in 3.2565274799999315s: None
2024-02-24T02:40:04.639026117Z [2024-02-24 02:40:04,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:04.642954499Z [2024-02-24 02:40:04,642: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:04.642985790Z [2024-02-24 02:40:04,642: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:04.643055481Z [2024-02-24 02:40:04,642: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:04.643096387Z [2024-02-24 02:40:04,643: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:04.643616800Z [2024-02-24 02:40:04,643: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:40:04.643933032Z [2024-02-24 02:40:04,643: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:04.771952347Z [2024-02-24 02:40:04,771: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:05.156267764Z [2024-02-24 02:40:05,155: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T02:40:05.160161239Z [2024-02-24 02:40:05,159: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.217150671Z [2024-02-24 02:40:05,216: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T02:40:05.219168727Z [2024-02-24 02:40:05,218: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.220272363Z [2024-02-24 02:40:05,219: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.220630998Z [2024-02-24 02:40:05,220: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.220991830Z [2024-02-24 02:40:05,220: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T02:40:05.221339062Z [2024-02-24 02:40:05,221: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:40:05.222859525Z [2024-02-24 02:40:05,222: INFO/ForkPoolWorker-3] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.264260059Z [2024-02-24 02:40:05,263: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:40:05.269289761Z [2024-02-24 02:40:05,268: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.282623463Z [2024-02-24 02:40:05,282: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:40:05.286266562Z [2024-02-24 02:40:05,285: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.318838920Z [2024-02-24 02:40:05,318: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:40:05.327081796Z [2024-02-24 02:40:05,326: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.327188020Z [2024-02-24 02:40:05,326: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.327977217Z [2024-02-24 02:40:05,327: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.328237035Z [2024-02-24 02:40:05,328: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:40:05.328939446Z [2024-02-24 02:40:05,328: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:05.329302091Z [2024-02-24 02:40:05,328: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.340157593Z [2024-02-24 02:40:05,339: WARNING/ForkPoolWorker-1] Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:05.341425608Z [2024-02-24 02:40:05,340: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:05.341466994Z [2024-02-24 02:40:05,340: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:40:05.343690103Z [2024-02-24 02:40:05,343: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.343708751Z [2024-02-24 02:40:05,343: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:40:05.343795192Z [2024-02-24 02:40:05,343: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.343977145Z [2024-02-24 02:40:05,343: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.344015473Z [2024-02-24 02:40:05,343: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:40:05.344346463Z [2024-02-24 02:40:05,344: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:40:05.344431905Z [2024-02-24 02:40:05,344: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.347294141Z [2024-02-24 02:40:05,347: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.353336529Z [2024-02-24 02:40:05,353: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:05.354270316Z [2024-02-24 02:40:05,353: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:05.359133130Z [2024-02-24 02:40:05,358: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:40:05.364780651Z [2024-02-24 02:40:05,364: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.368111346Z [2024-02-24 02:40:05,367: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:40:05.369473814Z [2024-02-24 02:40:05,369: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.369587948Z [2024-02-24 02:40:05,369: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.369822599Z [2024-02-24 02:40:05,369: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.370004295Z [2024-02-24 02:40:05,369: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:40:05.370374221Z [2024-02-24 02:40:05,370: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:05.370497788Z [2024-02-24 02:40:05,370: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.375416110Z [2024-02-24 02:40:05,374: ERROR/ForkPoolWorker-1] [71cdf606-782b-498c-9bcc-5c5f2f261a17] Failed to execute task Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:05.375491645Z Traceback (most recent call last):
2024-02-24T02:40:05.375496182Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:05.375499853Z     args.func(args)
2024-02-24T02:40:05.375503616Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:05.375508223Z     return func(*args, **kwargs)
2024-02-24T02:40:05.375511531Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:05.375514916Z     return f(*args, **kwargs)
2024-02-24T02:40:05.375518138Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:05.375521454Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:05.375524460Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:05.375527968Z     raise AirflowException(
2024-02-24T02:40:05.375531474Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:05.376526238Z [2024-02-24 02:40:05,376: INFO/ForkPoolWorker-3] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:05.398199821Z [2024-02-24 02:40:05,397: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:40:05.402239696Z [2024-02-24 02:40:05,401: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.402266768Z [2024-02-24 02:40:05,402: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.402403411Z [2024-02-24 02:40:05,402: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.402439864Z [2024-02-24 02:40:05,402: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:40:05.403484641Z [2024-02-24 02:40:05,403: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:40:05.403550948Z [2024-02-24 02:40:05,403: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.414823678Z [2024-02-24 02:40:05,414: ERROR/ForkPoolWorker-16] [e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5] Failed to execute task Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:05.414857511Z Traceback (most recent call last):
2024-02-24T02:40:05.414862387Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:05.414866231Z     args.func(args)
2024-02-24T02:40:05.414870210Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:05.414874255Z     return func(*args, **kwargs)
2024-02-24T02:40:05.414877945Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:05.414881143Z     return f(*args, **kwargs)
2024-02-24T02:40:05.414884281Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:05.414887490Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:05.414891129Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:05.414910446Z     raise AirflowException(
2024-02-24T02:40:05.414914275Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:05.415935938Z [2024-02-24 02:40:05,415: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[71cdf606-782b-498c-9bcc-5c5f2f261a17] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 71cdf606-782b-498c-9bcc-5c5f2f261a17')
2024-02-24T02:40:05.415947951Z Traceback (most recent call last):
2024-02-24T02:40:05.415952585Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:05.415955865Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:05.415959175Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:05.415962319Z     return self.run(*args, **kwargs)
2024-02-24T02:40:05.415965894Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:05.415969881Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:05.415972969Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:05.415976381Z     raise AirflowException(msg)
2024-02-24T02:40:05.415980364Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 71cdf606-782b-498c-9bcc-5c5f2f261a17
2024-02-24T02:40:05.456623956Z [2024-02-24 02:40:05,456: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5')
2024-02-24T02:40:05.456644577Z Traceback (most recent call last):
2024-02-24T02:40:05.456649232Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:05.456652388Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:05.456655513Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:05.456658807Z     return self.run(*args, **kwargs)
2024-02-24T02:40:05.456662478Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:05.456683831Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:05.456686992Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:05.456690738Z     raise AirflowException(msg)
2024-02-24T02:40:05.456695065Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id e4ba626a-d750-4e6b-8468-dfe6ab4ac7a5
2024-02-24T02:40:05.492465778Z [2024-02-24 02:40:05,492: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:40:05.495969419Z [2024-02-24 02:40:05,495: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.530740989Z [2024-02-24 02:40:05,530: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:40:05.534882902Z [2024-02-24 02:40:05,534: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.534906927Z [2024-02-24 02:40:05,534: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.535056703Z [2024-02-24 02:40:05,534: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.535121549Z [2024-02-24 02:40:05,535: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:40:05.535441803Z [2024-02-24 02:40:05,535: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:40:05.535516934Z [2024-02-24 02:40:05,535: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.541869830Z [2024-02-24 02:40:05,541: WARNING/ForkPoolWorker-2] Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:05.542588331Z [2024-02-24 02:40:05,541: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:05.543516113Z [2024-02-24 02:40:05,543: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:40:05.546157599Z [2024-02-24 02:40:05,545: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.566260489Z [2024-02-24 02:40:05,566: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:40:05.569824831Z [2024-02-24 02:40:05,569: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.570028176Z [2024-02-24 02:40:05,569: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.570238458Z [2024-02-24 02:40:05,570: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.570383162Z [2024-02-24 02:40:05,570: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:40:05.570734379Z [2024-02-24 02:40:05,570: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:40:05.570907134Z [2024-02-24 02:40:05,570: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.574407576Z [2024-02-24 02:40:05,573: ERROR/ForkPoolWorker-2] [c248d074-df94-4113-b2d7-aabf49fd6c10] Failed to execute task Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:05.574426952Z Traceback (most recent call last):
2024-02-24T02:40:05.574447725Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:05.574451900Z     args.func(args)
2024-02-24T02:40:05.574455658Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:05.574459269Z     return func(*args, **kwargs)
2024-02-24T02:40:05.574462418Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:05.574479272Z     return f(*args, **kwargs)
2024-02-24T02:40:05.574482381Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:05.574485511Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:05.574488624Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:05.574491679Z     raise AirflowException(
2024-02-24T02:40:05.574495495Z airflow.exceptions.AirflowException: Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:05.623566999Z [2024-02-24 02:40:05,622: ERROR/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c248d074-df94-4113-b2d7-aabf49fd6c10] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c248d074-df94-4113-b2d7-aabf49fd6c10')
2024-02-24T02:40:05.623597889Z Traceback (most recent call last):
2024-02-24T02:40:05.623604229Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:05.623609778Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:05.623614712Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:05.623619315Z     return self.run(*args, **kwargs)
2024-02-24T02:40:05.623625434Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:05.623632915Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:05.623637889Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:05.623644027Z     raise AirflowException(msg)
2024-02-24T02:40:05.623649492Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id c248d074-df94-4113-b2d7-aabf49fd6c10
2024-02-24T02:40:05.777024782Z [2024-02-24 02:40:05,776: INFO/ForkPoolWorker-4] Getting VIM list
2024-02-24T02:40:05.780318950Z [2024-02-24 02:40:05,779: INFO/ForkPoolWorker-4] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:05.812612294Z [2024-02-24 02:40:05,812: INFO/ForkPoolWorker-4] Connected to database osm version 1.2
2024-02-24T02:40:05.814187904Z [2024-02-24 02:40:05,813: INFO/ForkPoolWorker-4] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:05.814370244Z [2024-02-24 02:40:05,814: INFO/ForkPoolWorker-4] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:05.814588313Z [2024-02-24 02:40:05,814: INFO/ForkPoolWorker-4] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:05.814720044Z [2024-02-24 02:40:05,814: INFO/ForkPoolWorker-4] Getting VIM list OK
2024-02-24T02:40:05.815041485Z [2024-02-24 02:40:05,814: INFO/ForkPoolWorker-4] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:05.815199178Z [2024-02-24 02:40:05,815: INFO/ForkPoolWorker-4] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:05.939048176Z [2024-02-24 02:40:05,938: INFO/ForkPoolWorker-4] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:06.582589748Z [2024-02-24 02:40:06,582: INFO/ForkPoolWorker-4] Task airflow.executors.celery_executor.execute_command[cad89f49-52f9-4d12-9c0b-d14af2037ae8] succeeded in 5.24506275100066s: None
2024-02-24T02:40:07.057531983Z [2024-02-24 02:40:07,056: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[601dadb5-f292-47d9-9c7c-d580b49da4c8] succeeded in 5.753192800999386s: None
2024-02-24T02:40:07.550234171Z [2024-02-24 02:40:07,550: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f6d1bd4-2b8e-41a8-8e44-a915601d7a10] received
2024-02-24T02:40:07.557732427Z [2024-02-24 02:40:07,557: INFO/ForkPoolWorker-15] [3f6d1bd4-2b8e-41a8-8e44-a915601d7a10] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:40:07.689495993Z [2024-02-24 02:40:07,689: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[6168a6d1-7ddc-444f-8329-e162d1d161a5] succeeded in 6.365920437998284s: None
2024-02-24T02:40:07.866480344Z [2024-02-24 02:40:07,863: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:08.939247708Z [2024-02-24 02:40:08,938: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:08.942619924Z [2024-02-24 02:40:08,942: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:08.966555009Z [2024-02-24 02:40:08,966: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:08.968584112Z [2024-02-24 02:40:08,968: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:08.968811996Z [2024-02-24 02:40:08,968: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:08.969076623Z [2024-02-24 02:40:08,968: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:08.969255204Z [2024-02-24 02:40:08,969: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:08.969628760Z [2024-02-24 02:40:08,969: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:08.969854456Z [2024-02-24 02:40:08,969: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:09.072794669Z [2024-02-24 02:40:09,072: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:09.813380189Z [2024-02-24 02:40:09,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3f6d1bd4-2b8e-41a8-8e44-a915601d7a10] succeeded in 2.2612720939996507s: None
2024-02-24T02:40:10.005298352Z [2024-02-24 02:40:10,004: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[060d07e5-323b-4734-b81e-46e013f4a8d8] received
2024-02-24T02:40:10.017473613Z [2024-02-24 02:40:10,017: INFO/ForkPoolWorker-15] [060d07e5-323b-4734-b81e-46e013f4a8d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:40:10.327926113Z [2024-02-24 02:40:10,324: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:11.455799495Z [2024-02-24 02:40:11,455: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:11.459511703Z [2024-02-24 02:40:11,458: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:11.480723866Z [2024-02-24 02:40:11,480: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:11.482200126Z [2024-02-24 02:40:11,481: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:11.482387397Z [2024-02-24 02:40:11,482: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:11.482547818Z [2024-02-24 02:40:11,482: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:11.482715857Z [2024-02-24 02:40:11,482: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:11.483157156Z [2024-02-24 02:40:11,482: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:11.483392916Z [2024-02-24 02:40:11,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:11.576513656Z [2024-02-24 02:40:11,576: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:12.223632479Z [2024-02-24 02:40:12,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[060d07e5-323b-4734-b81e-46e013f4a8d8] succeeded in 2.2150866519987176s: None
2024-02-24T02:40:12.843092993Z [2024-02-24 02:40:12,842: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c902e3f-fb36-40fa-88c7-231c3ca5f699] received
2024-02-24T02:40:12.854817644Z [2024-02-24 02:40:12,854: INFO/ForkPoolWorker-15] [2c902e3f-fb36-40fa-88c7-231c3ca5f699] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:40:13.142163041Z [2024-02-24 02:40:13,139: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:14.232739479Z [2024-02-24 02:40:14,232: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:14.235949063Z [2024-02-24 02:40:14,235: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:14.253142822Z [2024-02-24 02:40:14,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:14.254303094Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:14.254317046Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:14.254445259Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:14.254476593Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:14.254677773Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:14.254700876Z [2024-02-24 02:40:14,254: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:14.336221985Z [2024-02-24 02:40:14,335: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:40:14.879319825Z [2024-02-24 02:40:14,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c902e3f-fb36-40fa-88c7-231c3ca5f699] succeeded in 2.0344369699996605s: None
2024-02-24T02:40:16.931496947Z [2024-02-24 02:40:16,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14f307c6-d319-497b-a628-0bcb9c0b8e19] received
2024-02-24T02:40:16.934982845Z [2024-02-24 02:40:16,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[122920b4-e67d-44a2-863a-b212fab17638] received
2024-02-24T02:40:16.941763645Z [2024-02-24 02:40:16,941: INFO/ForkPoolWorker-16] [122920b4-e67d-44a2-863a-b212fab17638] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:40:16.942327038Z [2024-02-24 02:40:16,942: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b4dd353-0925-4bfc-8953-4cc47374e310] received
2024-02-24T02:40:16.949513170Z [2024-02-24 02:40:16,949: INFO/ForkPoolWorker-15] [14f307c6-d319-497b-a628-0bcb9c0b8e19] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:40:16.951199149Z [2024-02-24 02:40:16,949: INFO/ForkPoolWorker-1] [8b4dd353-0925-4bfc-8953-4cc47374e310] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:40:17.251856842Z [2024-02-24 02:40:17,248: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:17.297917553Z [2024-02-24 02:40:17,294: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:17.303805950Z [2024-02-24 02:40:17,300: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:18.417210652Z [2024-02-24 02:40:18,416: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:40:18.421030419Z [2024-02-24 02:40:18,420: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.437724665Z [2024-02-24 02:40:18,437: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:18.440789181Z [2024-02-24 02:40:18,440: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.442595910Z [2024-02-24 02:40:18,442: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:40:18.443730435Z [2024-02-24 02:40:18,443: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.443828604Z [2024-02-24 02:40:18,443: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.443996485Z [2024-02-24 02:40:18,443: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.444069523Z [2024-02-24 02:40:18,444: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:40:18.444318413Z [2024-02-24 02:40:18,444: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:40:18.444405517Z [2024-02-24 02:40:18,444: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.450383347Z [2024-02-24 02:40:18,450: WARNING/ForkPoolWorker-16] Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:18.451332337Z [2024-02-24 02:40:18,450: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:40:18.452313503Z [2024-02-24 02:40:18,452: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:40:18.455787814Z [2024-02-24 02:40:18,455: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.458212449Z [2024-02-24 02:40:18,457: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:40:18.460130794Z [2024-02-24 02:40:18,459: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:18.461555530Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.461566666Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.461574884Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.461694294Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.461728559Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:18.461969465Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:18.462015287Z [2024-02-24 02:40:18,461: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.469548947Z [2024-02-24 02:40:18,469: WARNING/ForkPoolWorker-15] Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:18.470216462Z [2024-02-24 02:40:18,469: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:40:18.471006930Z [2024-02-24 02:40:18,470: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:40:18.473707257Z [2024-02-24 02:40:18,473: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.480183428Z [2024-02-24 02:40:18,480: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:40:18.481565298Z [2024-02-24 02:40:18,481: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.481661545Z [2024-02-24 02:40:18,481: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.481925790Z [2024-02-24 02:40:18,481: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.482053873Z [2024-02-24 02:40:18,481: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:40:18.482466490Z [2024-02-24 02:40:18,482: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:40:18.482587124Z [2024-02-24 02:40:18,482: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.483322195Z [2024-02-24 02:40:18,483: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:40:18.484706025Z [2024-02-24 02:40:18,484: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.484798937Z [2024-02-24 02:40:18,484: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.484903205Z [2024-02-24 02:40:18,484: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.484927018Z [2024-02-24 02:40:18,484: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:40:18.485109411Z [2024-02-24 02:40:18,485: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:40:18.485133037Z [2024-02-24 02:40:18,485: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.486636030Z [2024-02-24 02:40:18,486: ERROR/ForkPoolWorker-16] [122920b4-e67d-44a2-863a-b212fab17638] Failed to execute task Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:18.486648337Z Traceback (most recent call last):
2024-02-24T02:40:18.486652087Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:18.486655392Z     args.func(args)
2024-02-24T02:40:18.486658757Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:18.486663224Z     return func(*args, **kwargs)
2024-02-24T02:40:18.486666206Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:18.486682375Z     return f(*args, **kwargs)
2024-02-24T02:40:18.486685432Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:18.486688365Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:18.486691974Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:18.486694872Z     raise AirflowException(
2024-02-24T02:40:18.486698344Z airflow.exceptions.AirflowException: Dag 'vm_status_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:18.491013385Z [2024-02-24 02:40:18,488: ERROR/ForkPoolWorker-15] [14f307c6-d319-497b-a628-0bcb9c0b8e19] Failed to execute task Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:18.491028458Z Traceback (most recent call last):
2024-02-24T02:40:18.491032249Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:18.491035695Z     args.func(args)
2024-02-24T02:40:18.491039360Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:18.491042948Z     return func(*args, **kwargs)
2024-02-24T02:40:18.491045861Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:18.491048757Z     return f(*args, **kwargs)
2024-02-24T02:40:18.491051693Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:18.491054674Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:18.491057611Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:18.491060540Z     raise AirflowException(
2024-02-24T02:40:18.491063986Z airflow.exceptions.AirflowException: Dag 'vm_metrics_vim_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:18.499428785Z [2024-02-24 02:40:18,498: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:40:18.499556135Z [2024-02-24 02:40:18,499: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.499723345Z [2024-02-24 02:40:18,499: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.499953965Z [2024-02-24 02:40:18,499: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.500106194Z [2024-02-24 02:40:18,500: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:40:18.500521112Z [2024-02-24 02:40:18,500: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:40:18.500689430Z [2024-02-24 02:40:18,500: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.508276440Z [2024-02-24 02:40:18,508: WARNING/ForkPoolWorker-1] Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' not found in path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py; trying path /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:18.510229005Z [2024-02-24 02:40:18,509: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:40:18.511418981Z [2024-02-24 02:40:18,511: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:40:18.517309734Z [2024-02-24 02:40:18,516: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:40:18.525165245Z [2024-02-24 02:40:18,524: ERROR/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[122920b4-e67d-44a2-863a-b212fab17638] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 122920b4-e67d-44a2-863a-b212fab17638')
2024-02-24T02:40:18.525178098Z Traceback (most recent call last):
2024-02-24T02:40:18.525181967Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:18.525185241Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:18.525188254Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:18.525191457Z     return self.run(*args, **kwargs)
2024-02-24T02:40:18.525194985Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:18.525198552Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:18.525201541Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:18.525204821Z     raise AirflowException(msg)
2024-02-24T02:40:18.525208302Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 122920b4-e67d-44a2-863a-b212fab17638
2024-02-24T02:40:18.525801636Z [2024-02-24 02:40:18,525: ERROR/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14f307c6-d319-497b-a628-0bcb9c0b8e19] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 14f307c6-d319-497b-a628-0bcb9c0b8e19')
2024-02-24T02:40:18.525812826Z Traceback (most recent call last):
2024-02-24T02:40:18.525816504Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:18.525819525Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:18.525822531Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:18.525825656Z     return self.run(*args, **kwargs)
2024-02-24T02:40:18.525829548Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:18.525833074Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:18.525836421Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:18.525839808Z     raise AirflowException(msg)
2024-02-24T02:40:18.525843124Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 14f307c6-d319-497b-a628-0bcb9c0b8e19
2024-02-24T02:40:18.531637449Z [2024-02-24 02:40:18,531: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:40:18.533649263Z [2024-02-24 02:40:18,533: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:40:18.533826504Z [2024-02-24 02:40:18,533: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:40:18.534017025Z [2024-02-24 02:40:18,533: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:40:18.534121114Z [2024-02-24 02:40:18,534: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:40:18.534425650Z [2024-02-24 02:40:18,534: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:40:18.534537822Z [2024-02-24 02:40:18,534: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:40:18.538489077Z [2024-02-24 02:40:18,538: ERROR/ForkPoolWorker-1] [8b4dd353-0925-4bfc-8953-4cc47374e310] Failed to execute task Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse..
2024-02-24T02:40:18.538497868Z Traceback (most recent call last):
2024-02-24T02:40:18.538501515Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 130, in _execute_in_fork
2024-02-24T02:40:18.538505035Z     args.func(args)
2024-02-24T02:40:18.538508173Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/cli_parser.py", line 52, in command
2024-02-24T02:40:18.538511782Z     return func(*args, **kwargs)
2024-02-24T02:40:18.538514689Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 108, in wrapper
2024-02-24T02:40:18.538517838Z     return f(*args, **kwargs)
2024-02-24T02:40:18.538520719Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/cli/commands/task_command.py", line 379, in task_run
2024-02-24T02:40:18.538523652Z     dag = get_dag(args.subdir, args.dag_id)
2024-02-24T02:40:18.538530215Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/utils/cli.py", line 231, in get_dag
2024-02-24T02:40:18.538533282Z     raise AirflowException(
2024-02-24T02:40:18.538536831Z airflow.exceptions.AirflowException: Dag 'vim_status_e3d0a28a-b3ee-4530-a90a-efa92840586d' could not be found; either it does not exist or it failed to parse.
2024-02-24T02:40:18.577285391Z [2024-02-24 02:40:18,576: ERROR/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8b4dd353-0925-4bfc-8953-4cc47374e310] raised unexpected: AirflowException('Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8b4dd353-0925-4bfc-8953-4cc47374e310')
2024-02-24T02:40:18.577305698Z Traceback (most recent call last):
2024-02-24T02:40:18.577310124Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 451, in trace_task
2024-02-24T02:40:18.577313296Z     R = retval = fun(*args, **kwargs)
2024-02-24T02:40:18.577316395Z   File "/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 734, in __protected_call__
2024-02-24T02:40:18.577319952Z     return self.run(*args, **kwargs)
2024-02-24T02:40:18.577323772Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 96, in execute_command
2024-02-24T02:40:18.577327488Z     _execute_in_fork(command_to_exec, celery_task_id)
2024-02-24T02:40:18.577330587Z   File "/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py", line 111, in _execute_in_fork
2024-02-24T02:40:18.577334394Z     raise AirflowException(msg)
2024-02-24T02:40:18.577338246Z airflow.exceptions.AirflowException: Celery command failed on host: airflow-worker-0.airflow-worker.osm.svc.cluster.local with celery_task_id 8b4dd353-0925-4bfc-8953-4cc47374e310
2024-02-24T02:41:00.710337772Z [2024-02-24 02:41:00,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cd8b5662-4f8b-41a5-acc8-0b15b268ae32] received
2024-02-24T02:41:00.720075863Z [2024-02-24 02:41:00,719: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7775e759-0cb7-454d-82ab-238005b27c4f] received
2024-02-24T02:41:00.726531989Z [2024-02-24 02:41:00,726: INFO/ForkPoolWorker-15] [cd8b5662-4f8b-41a5-acc8-0b15b268ae32] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:41:00.728486249Z [2024-02-24 02:41:00,727: INFO/ForkPoolWorker-16] [7775e759-0cb7-454d-82ab-238005b27c4f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:41:00.732554832Z [2024-02-24 02:41:00,732: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a126e254-6d25-4a8e-86d6-eabfdacb8e74] received
2024-02-24T02:41:00.750257029Z [2024-02-24 02:41:00,749: INFO/ForkPoolWorker-1] [a126e254-6d25-4a8e-86d6-eabfdacb8e74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:41:01.079377171Z [2024-02-24 02:41:01,075: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:41:01.083263175Z [2024-02-24 02:41:01,078: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:41:01.130218969Z [2024-02-24 02:41:01,126: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:41:01.336080708Z [2024-02-24 02:41:01,335: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:41:01.340054914Z [2024-02-24 02:41:01,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:41:01.366183504Z [2024-02-24 02:41:01,365: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:41:01.371819091Z [2024-02-24 02:41:01,371: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:41:01.371881342Z [2024-02-24 02:41:01,371: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:41:01.371947912Z [2024-02-24 02:41:01,371: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:41:01.372286659Z [2024-02-24 02:41:01,372: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:41:01.518258228Z [2024-02-24 02:41:01,517: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:41:02.229640543Z [2024-02-24 02:41:02,229: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7775e759-0cb7-454d-82ab-238005b27c4f] succeeded in 1.5077027739989717s: None
2024-02-24T02:41:02.285917470Z [2024-02-24 02:41:02,285: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:41:02.289526519Z [2024-02-24 02:41:02,288: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:41:02.314877653Z [2024-02-24 02:41:02,314: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:41:02.316424536Z [2024-02-24 02:41:02,316: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:41:02.316578609Z [2024-02-24 02:41:02,316: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:41:02.316954878Z [2024-02-24 02:41:02,316: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:41:02.317128953Z [2024-02-24 02:41:02,316: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:41:02.317691943Z [2024-02-24 02:41:02,317: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:41:02.317853795Z [2024-02-24 02:41:02,317: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:41:02.395130075Z [2024-02-24 02:41:02,394: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:41:02.399500480Z [2024-02-24 02:41:02,397: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:41:02.436784275Z [2024-02-24 02:41:02,436: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:41:02.438693564Z [2024-02-24 02:41:02,438: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:41:02.438788168Z [2024-02-24 02:41:02,438: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:41:02.438957745Z [2024-02-24 02:41:02,438: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:41:02.439094152Z [2024-02-24 02:41:02,438: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:41:02.439478844Z [2024-02-24 02:41:02,439: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:41:02.439545057Z [2024-02-24 02:41:02,439: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:41:02.477741375Z [2024-02-24 02:41:02,477: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:41:02.534983503Z [2024-02-24 02:41:02,534: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:41:04.107604860Z [2024-02-24 02:41:04,106: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a126e254-6d25-4a8e-86d6-eabfdacb8e74] succeeded in 3.3640404749985464s: None
2024-02-24T02:41:05.078622352Z [2024-02-24 02:41:05,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cd8b5662-4f8b-41a5-acc8-0b15b268ae32] succeeded in 4.365181463999761s: None
2024-02-24T02:42:01.002115535Z [2024-02-24 02:42:01,001: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c832e6cb-111e-49bc-91ed-98623d95cbad] received
2024-02-24T02:42:01.009158970Z [2024-02-24 02:42:01,008: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f5eff25-9b70-459c-bd80-f07f6a4bbe9b] received
2024-02-24T02:42:01.011770092Z [2024-02-24 02:42:01,011: INFO/ForkPoolWorker-15] [c832e6cb-111e-49bc-91ed-98623d95cbad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:42:01.012866974Z [2024-02-24 02:42:01,012: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9e6b55cc-9a50-41b9-9ff5-a230ffc19959] received
2024-02-24T02:42:01.027619674Z [2024-02-24 02:42:01,027: INFO/ForkPoolWorker-16] [2f5eff25-9b70-459c-bd80-f07f6a4bbe9b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:42:01.035415092Z [2024-02-24 02:42:01,035: INFO/ForkPoolWorker-1] [9e6b55cc-9a50-41b9-9ff5-a230ffc19959] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:42:01.038545123Z [2024-02-24 02:42:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0de63f97-5eac-4b95-a65d-2275d4e591d3] received
2024-02-24T02:42:01.049089910Z [2024-02-24 02:42:01,048: INFO/ForkPoolWorker-2] [0de63f97-5eac-4b95-a65d-2275d4e591d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:42:01.427784945Z [2024-02-24 02:42:01,424: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:42:01.453862431Z [2024-02-24 02:42:01,450: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:42:01.551402409Z [2024-02-24 02:42:01,548: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:42:01.630708233Z [2024-02-24 02:42:01,627: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:42:01.640197139Z [2024-02-24 02:42:01,639: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:42:01.644593381Z [2024-02-24 02:42:01,644: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:42:01.692361288Z [2024-02-24 02:42:01,692: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:42:01.701697674Z [2024-02-24 02:42:01,701: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:42:01.701828392Z [2024-02-24 02:42:01,701: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:42:01.701848212Z [2024-02-24 02:42:01,701: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:42:01.702001229Z [2024-02-24 02:42:01,701: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:42:01.721035470Z [2024-02-24 02:42:01,720: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:42:01.804413989Z [2024-02-24 02:42:01,804: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:42:02.486776765Z [2024-02-24 02:42:02,486: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f5eff25-9b70-459c-bd80-f07f6a4bbe9b] succeeded in 1.4723591460005991s: None
2024-02-24T02:42:02.507918189Z [2024-02-24 02:42:02,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9e6b55cc-9a50-41b9-9ff5-a230ffc19959] succeeded in 1.490462584000852s: None
2024-02-24T02:42:03.165046456Z [2024-02-24 02:42:03,164: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:42:03.168263349Z [2024-02-24 02:42:03,167: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:42:03.202730449Z [2024-02-24 02:42:03,202: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:42:03.203427786Z [2024-02-24 02:42:03,203: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:42:03.204918931Z [2024-02-24 02:42:03,204: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:42:03.205041142Z [2024-02-24 02:42:03,204: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:42:03.205161197Z [2024-02-24 02:42:03,204: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:42:03.205192138Z [2024-02-24 02:42:03,205: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:42:03.205448518Z [2024-02-24 02:42:03,205: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:42:03.205461318Z [2024-02-24 02:42:03,205: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:42:03.206292664Z [2024-02-24 02:42:03,205: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:42:03.227049490Z [2024-02-24 02:42:03,226: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:42:03.228217055Z [2024-02-24 02:42:03,227: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:42:03.228252068Z [2024-02-24 02:42:03,228: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:42:03.228458100Z [2024-02-24 02:42:03,228: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:42:03.228540576Z [2024-02-24 02:42:03,228: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:42:03.228932627Z [2024-02-24 02:42:03,228: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:42:03.229077871Z [2024-02-24 02:42:03,228: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:42:03.290734302Z [2024-02-24 02:42:03,290: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:42:03.322825916Z [2024-02-24 02:42:03,322: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:42:05.655821594Z [2024-02-24 02:42:05,655: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c832e6cb-111e-49bc-91ed-98623d95cbad] succeeded in 4.650809090999246s: None
2024-02-24T02:42:06.396209790Z [2024-02-24 02:42:06,395: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0de63f97-5eac-4b95-a65d-2275d4e591d3] succeeded in 5.355435597999531s: None
2024-02-24T02:43:00.809485971Z [2024-02-24 02:43:00,809: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bbd7faf4-e4a0-41b4-9e55-3067c88d4fe0] received
2024-02-24T02:43:00.817629586Z [2024-02-24 02:43:00,817: INFO/ForkPoolWorker-15] [bbd7faf4-e4a0-41b4-9e55-3067c88d4fe0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:43:00.820333879Z [2024-02-24 02:43:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5f9f93e-2bb5-47c7-8596-8d7f4621a4f9] received
2024-02-24T02:43:00.827207792Z [2024-02-24 02:43:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1b7e8df0-492e-40e2-999c-30e891a15390] received
2024-02-24T02:43:00.827497171Z [2024-02-24 02:43:00,827: INFO/ForkPoolWorker-16] [d5f9f93e-2bb5-47c7-8596-8d7f4621a4f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:43:00.846747120Z [2024-02-24 02:43:00,846: INFO/ForkPoolWorker-1] [1b7e8df0-492e-40e2-999c-30e891a15390] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:43:01.224501494Z [2024-02-24 02:43:01,220: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:43:01.290690174Z [2024-02-24 02:43:01,287: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:43:01.527945697Z [2024-02-24 02:43:01,524: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:43:01.711032351Z [2024-02-24 02:43:01,710: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:43:01.715230116Z [2024-02-24 02:43:01,714: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:43:01.758622833Z [2024-02-24 02:43:01,758: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:43:01.766585968Z [2024-02-24 02:43:01,766: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:43:01.766648786Z [2024-02-24 02:43:01,766: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:43:01.766655386Z [2024-02-24 02:43:01,766: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:43:01.766964536Z [2024-02-24 02:43:01,766: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:43:01.919551293Z [2024-02-24 02:43:01,919: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:43:02.748724675Z [2024-02-24 02:43:02,747: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d5f9f93e-2bb5-47c7-8596-8d7f4621a4f9] succeeded in 1.9262671919987042s: None
2024-02-24T02:43:02.921215009Z [2024-02-24 02:43:02,920: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:43:02.927774605Z [2024-02-24 02:43:02,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:43:02.949961197Z [2024-02-24 02:43:02,949: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:43:02.951600382Z [2024-02-24 02:43:02,951: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:43:02.951616938Z [2024-02-24 02:43:02,951: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:43:02.951762133Z [2024-02-24 02:43:02,951: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:43:02.951811721Z [2024-02-24 02:43:02,951: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:43:02.952085043Z [2024-02-24 02:43:02,951: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:43:02.952137711Z [2024-02-24 02:43:02,952: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:43:03.051106401Z [2024-02-24 02:43:03,050: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:43:03.054231192Z [2024-02-24 02:43:03,053: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:43:03.054903981Z [2024-02-24 02:43:03,054: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:43:03.099443586Z [2024-02-24 02:43:03,099: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:43:03.101211608Z [2024-02-24 02:43:03,100: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:43:03.101356159Z [2024-02-24 02:43:03,101: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:43:03.101578781Z [2024-02-24 02:43:03,101: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:43:03.101711367Z [2024-02-24 02:43:03,101: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:43:03.103345613Z [2024-02-24 02:43:03,103: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:43:03.103566200Z [2024-02-24 02:43:03,103: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:43:03.224960814Z [2024-02-24 02:43:03,224: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:43:06.484106062Z [2024-02-24 02:43:06,483: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bbd7faf4-e4a0-41b4-9e55-3067c88d4fe0] succeeded in 5.673150570999496s: None
2024-02-24T02:43:07.386753355Z [2024-02-24 02:43:07,386: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1b7e8df0-492e-40e2-999c-30e891a15390] succeeded in 6.5554243689985014s: None
2024-02-24T02:44:01.140259949Z [2024-02-24 02:44:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7a3b06a0-ba6a-4054-a359-451631c9d7bf] received
2024-02-24T02:44:01.145006807Z [2024-02-24 02:44:01,144: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4635f260-26c5-4097-96c8-8224850181da] received
2024-02-24T02:44:01.151179855Z [2024-02-24 02:44:01,150: INFO/ForkPoolWorker-15] [7a3b06a0-ba6a-4054-a359-451631c9d7bf] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:44:01.153366403Z [2024-02-24 02:44:01,153: INFO/ForkPoolWorker-16] [4635f260-26c5-4097-96c8-8224850181da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:44:01.154380729Z [2024-02-24 02:44:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4b40a1f5-7c7f-4bc8-86b1-453062917efe] received
2024-02-24T02:44:01.159007802Z [2024-02-24 02:44:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[293b758b-19e8-4cc7-aed5-9378ec248b48] received
2024-02-24T02:44:01.162559979Z [2024-02-24 02:44:01,162: INFO/ForkPoolWorker-1] [4b40a1f5-7c7f-4bc8-86b1-453062917efe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:44:01.183430918Z [2024-02-24 02:44:01,183: INFO/ForkPoolWorker-2] [293b758b-19e8-4cc7-aed5-9378ec248b48] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:44:01.522524097Z [2024-02-24 02:44:01,519: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:44:01.538571791Z [2024-02-24 02:44:01,535: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:44:01.577042044Z [2024-02-24 02:44:01,573: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:44:01.601526647Z [2024-02-24 02:44:01,598: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:44:01.735172602Z [2024-02-24 02:44:01,734: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:44:01.738969566Z [2024-02-24 02:44:01,738: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:44:01.764977851Z [2024-02-24 02:44:01,764: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:44:01.766802702Z [2024-02-24 02:44:01,766: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:44:01.766827052Z [2024-02-24 02:44:01,766: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:44:01.766923490Z [2024-02-24 02:44:01,766: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:44:01.767070898Z [2024-02-24 02:44:01,766: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:44:01.796750126Z [2024-02-24 02:44:01,796: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:44:01.922291836Z [2024-02-24 02:44:01,921: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:44:02.504681712Z [2024-02-24 02:44:02,504: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7a3b06a0-ba6a-4054-a359-451631c9d7bf] succeeded in 1.3582096179998189s: None
2024-02-24T02:44:02.701815603Z [2024-02-24 02:44:02,698: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[293b758b-19e8-4cc7-aed5-9378ec248b48] succeeded in 1.5363964360003592s: None
2024-02-24T02:44:03.038602857Z [2024-02-24 02:44:03,038: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:44:03.042167919Z [2024-02-24 02:44:03,041: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:44:03.061630862Z [2024-02-24 02:44:03,061: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:44:03.067302567Z [2024-02-24 02:44:03,066: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:44:03.069587923Z [2024-02-24 02:44:03,069: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:44:03.072214942Z [2024-02-24 02:44:03,071: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:44:03.072277605Z [2024-02-24 02:44:03,072: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:44:03.072391260Z [2024-02-24 02:44:03,072: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:44:03.072426269Z [2024-02-24 02:44:03,072: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:44:03.072701085Z [2024-02-24 02:44:03,072: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:44:03.072825880Z [2024-02-24 02:44:03,072: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:44:03.094889985Z [2024-02-24 02:44:03,094: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:44:03.096743993Z [2024-02-24 02:44:03,096: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:44:03.097003705Z [2024-02-24 02:44:03,096: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:44:03.097257030Z [2024-02-24 02:44:03,097: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:44:03.097429684Z [2024-02-24 02:44:03,097: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:44:03.097911995Z [2024-02-24 02:44:03,097: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:44:03.098190023Z [2024-02-24 02:44:03,098: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:44:03.167226651Z [2024-02-24 02:44:03,166: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:44:03.201204003Z [2024-02-24 02:44:03,200: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:44:05.234010691Z [2024-02-24 02:44:05,233: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4b40a1f5-7c7f-4bc8-86b1-453062917efe] succeeded in 4.077347980000923s: None
2024-02-24T02:44:05.544244529Z [2024-02-24 02:44:05,543: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4635f260-26c5-4097-96c8-8224850181da] succeeded in 4.397566241999812s: None
2024-02-24T02:45:00.373674122Z [2024-02-24 02:45:00,373: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65a37b2e-12ab-44ca-9683-445ae9bc4bad] received
2024-02-24T02:45:00.378007002Z [2024-02-24 02:45:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1b24052-81e5-42a3-8826-be8581bc06a4] received
2024-02-24T02:45:00.383462511Z [2024-02-24 02:45:00,383: INFO/ForkPoolWorker-15] [65a37b2e-12ab-44ca-9683-445ae9bc4bad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:45:00.386287696Z [2024-02-24 02:45:00,386: INFO/ForkPoolWorker-16] [d1b24052-81e5-42a3-8826-be8581bc06a4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:45:00.396313310Z [2024-02-24 02:45:00,396: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5458e32-3ae1-4c21-810c-b63ceb4c90be] received
2024-02-24T02:45:00.398363493Z [2024-02-24 02:45:00,398: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f8afe82-b0f1-4f1f-9088-85c4a8cdfb84] received
2024-02-24T02:45:00.405682409Z [2024-02-24 02:45:00,405: INFO/ForkPoolWorker-1] [e5458e32-3ae1-4c21-810c-b63ceb4c90be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:45:00.405921610Z [2024-02-24 02:45:00,405: INFO/ForkPoolWorker-2] [9f8afe82-b0f1-4f1f-9088-85c4a8cdfb84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:45:00.738320795Z [2024-02-24 02:45:00,734: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:45:00.770440896Z [2024-02-24 02:45:00,763: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:45:00.951454778Z [2024-02-24 02:45:00,947: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:45:00.990179478Z [2024-02-24 02:45:00,986: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:45:01.148920897Z [2024-02-24 02:45:01,148: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:45:01.152758850Z [2024-02-24 02:45:01,152: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:01.201696169Z [2024-02-24 02:45:01,201: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:45:01.212017609Z [2024-02-24 02:45:01,210: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:45:01.212043927Z [2024-02-24 02:45:01,210: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:45:01.212048248Z [2024-02-24 02:45:01,210: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:45:01.212051395Z [2024-02-24 02:45:01,210: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:45:01.353949526Z [2024-02-24 02:45:01,351: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:02.114483508Z [2024-02-24 02:45:02,114: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9f8afe82-b0f1-4f1f-9088-85c4a8cdfb84] succeeded in 1.7148013629994239s: None
2024-02-24T02:45:02.344756585Z [2024-02-24 02:45:02,344: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:45:02.348386445Z [2024-02-24 02:45:02,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:02.373478544Z [2024-02-24 02:45:02,373: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:45:02.375819934Z [2024-02-24 02:45:02,375: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:02.375886065Z [2024-02-24 02:45:02,375: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:02.376075903Z [2024-02-24 02:45:02,375: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:02.376155568Z [2024-02-24 02:45:02,376: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:45:02.376532540Z [2024-02-24 02:45:02,376: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:45:02.376637290Z [2024-02-24 02:45:02,376: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:02.428799661Z [2024-02-24 02:45:02,428: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:45:02.432172446Z [2024-02-24 02:45:02,431: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:02.460256255Z [2024-02-24 02:45:02,460: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:45:02.461913883Z [2024-02-24 02:45:02,461: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:02.465897673Z [2024-02-24 02:45:02,465: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:02.466153963Z [2024-02-24 02:45:02,465: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:02.466328498Z [2024-02-24 02:45:02,466: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:45:02.466655751Z [2024-02-24 02:45:02,466: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:45:02.467211083Z [2024-02-24 02:45:02,467: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:02.473576394Z [2024-02-24 02:45:02,473: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:02.568850110Z [2024-02-24 02:45:02,568: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:02.604938424Z [2024-02-24 02:45:02,604: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:45:02.608439708Z [2024-02-24 02:45:02,607: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:02.637913877Z [2024-02-24 02:45:02,634: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:45:02.637937890Z [2024-02-24 02:45:02,635: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:02.637941845Z [2024-02-24 02:45:02,636: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:02.637945864Z [2024-02-24 02:45:02,636: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:02.637949936Z [2024-02-24 02:45:02,636: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:45:02.637953112Z [2024-02-24 02:45:02,636: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:45:02.637969372Z [2024-02-24 02:45:02,636: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:02.756004937Z [2024-02-24 02:45:02,755: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:03.149056101Z [2024-02-24 02:45:03,148: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99a494ef-82a1-4563-ab7e-4e10b1550b85] received
2024-02-24T02:45:03.160108823Z [2024-02-24 02:45:03,159: INFO/ForkPoolWorker-2] [99a494ef-82a1-4563-ab7e-4e10b1550b85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:45:03.218196563Z [2024-02-24 02:45:03,217: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65a37b2e-12ab-44ca-9683-445ae9bc4bad] succeeded in 2.8425718569997116s: None
2024-02-24T02:45:03.482195147Z [2024-02-24 02:45:03,478: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:45:04.341096291Z [2024-02-24 02:45:04,338: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[e5458e32-3ae1-4c21-810c-b63ceb4c90be] succeeded in 3.93960833500023s: None
2024-02-24T02:45:04.555430748Z [2024-02-24 02:45:04,555: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d1b24052-81e5-42a3-8826-be8581bc06a4] succeeded in 4.175523601999885s: None
2024-02-24T02:45:04.682516340Z [2024-02-24 02:45:04,682: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:45:04.686125137Z [2024-02-24 02:45:04,685: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:04.711190172Z [2024-02-24 02:45:04,710: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:45:04.712448608Z [2024-02-24 02:45:04,712: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:04.712484212Z [2024-02-24 02:45:04,712: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:04.712699441Z [2024-02-24 02:45:04,712: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:04.712785367Z [2024-02-24 02:45:04,712: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:45:04.713073623Z [2024-02-24 02:45:04,712: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:45:04.713138471Z [2024-02-24 02:45:04,713: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:04.807953660Z [2024-02-24 02:45:04,807: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:05.465703893Z [2024-02-24 02:45:05,464: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99a494ef-82a1-4563-ab7e-4e10b1550b85] succeeded in 2.3146416149993456s: None
2024-02-24T02:45:05.557902706Z [2024-02-24 02:45:05,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[71b98462-ebcf-4eaa-a97e-86174f8b74db] received
2024-02-24T02:45:05.569327532Z [2024-02-24 02:45:05,568: INFO/ForkPoolWorker-15] [71b98462-ebcf-4eaa-a97e-86174f8b74db] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:45:05.919710232Z [2024-02-24 02:45:05,916: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:45:07.103334810Z [2024-02-24 02:45:07,102: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:45:07.106519442Z [2024-02-24 02:45:07,106: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:07.123949680Z [2024-02-24 02:45:07,123: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:45:07.125084090Z [2024-02-24 02:45:07,124: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:07.125153680Z [2024-02-24 02:45:07,125: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:07.125295544Z [2024-02-24 02:45:07,125: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:07.125370130Z [2024-02-24 02:45:07,125: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:45:07.125661064Z [2024-02-24 02:45:07,125: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:45:07.125742626Z [2024-02-24 02:45:07,125: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:07.215248765Z [2024-02-24 02:45:07,214: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:07.748211456Z [2024-02-24 02:45:07,747: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[71b98462-ebcf-4eaa-a97e-86174f8b74db] succeeded in 2.187465835999319s: None
2024-02-24T02:45:07.854849512Z [2024-02-24 02:45:07,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7532261-b377-4614-b2e0-61ba44958fb1] received
2024-02-24T02:45:07.860621789Z [2024-02-24 02:45:07,860: INFO/ForkPoolWorker-15] [d7532261-b377-4614-b2e0-61ba44958fb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:45:08.166220015Z [2024-02-24 02:45:08,163: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:45:09.297363541Z [2024-02-24 02:45:09,296: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:45:09.300848921Z [2024-02-24 02:45:09,300: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:45:09.323105570Z [2024-02-24 02:45:09,322: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:45:09.325156608Z [2024-02-24 02:45:09,324: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:45:09.325407777Z [2024-02-24 02:45:09,325: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:45:09.325729758Z [2024-02-24 02:45:09,325: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:45:09.325966687Z [2024-02-24 02:45:09,325: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:45:09.326405987Z [2024-02-24 02:45:09,326: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:45:09.326586488Z [2024-02-24 02:45:09,326: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:45:09.433867460Z [2024-02-24 02:45:09,433: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:45:09.983806096Z [2024-02-24 02:45:09,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7532261-b377-4614-b2e0-61ba44958fb1] succeeded in 2.12743690500065s: None
2024-02-24T02:46:00.249042913Z [2024-02-24 02:46:00,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cb809cb-b1bf-4618-a090-6d38dcd235ad] received
2024-02-24T02:46:00.252623466Z [2024-02-24 02:46:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[505c3700-8497-4b17-a4bc-e4da23a35063] received
2024-02-24T02:46:00.260091377Z [2024-02-24 02:46:00,259: INFO/ForkPoolWorker-15] [6cb809cb-b1bf-4618-a090-6d38dcd235ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:46:00.261549731Z [2024-02-24 02:46:00,261: INFO/ForkPoolWorker-16] [505c3700-8497-4b17-a4bc-e4da23a35063] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:46:00.272619799Z [2024-02-24 02:46:00,272: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[548c9678-5445-4463-aa3c-e93f546014d2] received
2024-02-24T02:46:00.274685591Z [2024-02-24 02:46:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1db4088-6488-45ad-ab0e-26fe8ff53af4] received
2024-02-24T02:46:00.280856040Z [2024-02-24 02:46:00,280: INFO/ForkPoolWorker-2] [b1db4088-6488-45ad-ab0e-26fe8ff53af4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:46:00.280966832Z [2024-02-24 02:46:00,280: INFO/ForkPoolWorker-1] [548c9678-5445-4463-aa3c-e93f546014d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:46:00.601525466Z [2024-02-24 02:46:00,598: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:46:00.653589253Z [2024-02-24 02:46:00,650: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:46:00.680685283Z [2024-02-24 02:46:00,677: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:46:00.691454322Z [2024-02-24 02:46:00,688: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:46:00.842817829Z [2024-02-24 02:46:00,842: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:46:00.846711646Z [2024-02-24 02:46:00,846: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:46:00.872773575Z [2024-02-24 02:46:00,872: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:46:00.874079054Z [2024-02-24 02:46:00,873: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:46:00.874198943Z [2024-02-24 02:46:00,873: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:46:00.874335704Z [2024-02-24 02:46:00,874: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:46:00.874633799Z [2024-02-24 02:46:00,874: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:46:00.998283761Z [2024-02-24 02:46:00,998: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:46:01.001123295Z [2024-02-24 02:46:01,000: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:46:01.636824724Z [2024-02-24 02:46:01,636: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b1db4088-6488-45ad-ab0e-26fe8ff53af4] succeeded in 1.3604279680002946s: None
2024-02-24T02:46:01.676720096Z [2024-02-24 02:46:01,676: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cb809cb-b1bf-4618-a090-6d38dcd235ad] succeeded in 1.4217969460005406s: None
2024-02-24T02:46:02.026416618Z [2024-02-24 02:46:02,025: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:46:02.032241946Z [2024-02-24 02:46:02,031: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:46:02.067817297Z [2024-02-24 02:46:02,067: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:46:02.069596965Z [2024-02-24 02:46:02,069: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:46:02.069825665Z [2024-02-24 02:46:02,069: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:46:02.070251732Z [2024-02-24 02:46:02,069: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:46:02.070497301Z [2024-02-24 02:46:02,070: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:46:02.070961409Z [2024-02-24 02:46:02,070: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:46:02.071148896Z [2024-02-24 02:46:02,070: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:46:02.152436507Z [2024-02-24 02:46:02,152: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:46:02.155798137Z [2024-02-24 02:46:02,155: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:46:02.169745024Z [2024-02-24 02:46:02,169: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:46:02.194549357Z [2024-02-24 02:46:02,194: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:46:02.196222281Z [2024-02-24 02:46:02,195: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:46:02.196373505Z [2024-02-24 02:46:02,196: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:46:02.196717310Z [2024-02-24 02:46:02,196: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:46:02.196890525Z [2024-02-24 02:46:02,196: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:46:02.197476565Z [2024-02-24 02:46:02,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:46:02.197789584Z [2024-02-24 02:46:02,197: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:46:02.307378982Z [2024-02-24 02:46:02,307: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:46:03.970111365Z [2024-02-24 02:46:03,969: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[548c9678-5445-4463-aa3c-e93f546014d2] succeeded in 3.695907953000642s: None
2024-02-24T02:46:04.313030288Z [2024-02-24 02:46:04,312: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[505c3700-8497-4b17-a4bc-e4da23a35063] succeeded in 4.057979563000117s: None
2024-02-24T02:47:01.171005819Z [2024-02-24 02:47:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfc3ee17-17aa-4f9e-8e9e-ac5305dd2812] received
2024-02-24T02:47:01.183070052Z [2024-02-24 02:47:01,182: INFO/ForkPoolWorker-15] [cfc3ee17-17aa-4f9e-8e9e-ac5305dd2812] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:47:01.202539759Z [2024-02-24 02:47:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de57139f-256f-4fb1-8256-78e614d3a26c] received
2024-02-24T02:47:01.224112489Z [2024-02-24 02:47:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[78b7e690-4864-4245-baec-a9b79b6befbc] received
2024-02-24T02:47:01.246275370Z [2024-02-24 02:47:01,231: INFO/ForkPoolWorker-16] [de57139f-256f-4fb1-8256-78e614d3a26c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:47:01.246311761Z [2024-02-24 02:47:01,231: INFO/ForkPoolWorker-1] [78b7e690-4864-4245-baec-a9b79b6befbc] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:47:01.630552181Z [2024-02-24 02:47:01,627: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:47:01.672365578Z [2024-02-24 02:47:01,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:47:01.823998052Z [2024-02-24 02:47:01,823: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:47:01.835067856Z [2024-02-24 02:47:01,833: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:47:01.902019882Z [2024-02-24 02:47:01,901: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:47:01.907008417Z [2024-02-24 02:47:01,906: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:47:01.907246130Z [2024-02-24 02:47:01,906: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:47:01.907366715Z [2024-02-24 02:47:01,907: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:47:01.907773327Z [2024-02-24 02:47:01,907: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:47:02.103127131Z [2024-02-24 02:47:02,102: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:47:02.169618238Z [2024-02-24 02:47:02,159: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:47:03.200761590Z [2024-02-24 02:47:03,200: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[78b7e690-4864-4245-baec-a9b79b6befbc] succeeded in 1.974321454999881s: None
2024-02-24T02:47:04.031787266Z [2024-02-24 02:47:04,030: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:47:04.036229129Z [2024-02-24 02:47:04,034: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:47:04.107604918Z [2024-02-24 02:47:04,107: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:47:04.118185600Z [2024-02-24 02:47:04,117: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:47:04.118210374Z [2024-02-24 02:47:04,118: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:47:04.118284038Z [2024-02-24 02:47:04,118: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:47:04.118312280Z [2024-02-24 02:47:04,118: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:47:04.118557139Z [2024-02-24 02:47:04,118: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:47:04.118742935Z [2024-02-24 02:47:04,118: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:47:04.236363939Z [2024-02-24 02:47:04,236: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:47:04.544940217Z [2024-02-24 02:47:04,544: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:47:04.551630242Z [2024-02-24 02:47:04,551: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:47:04.628889153Z [2024-02-24 02:47:04,628: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:47:04.631752229Z [2024-02-24 02:47:04,631: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:47:04.632023581Z [2024-02-24 02:47:04,631: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:47:04.632378654Z [2024-02-24 02:47:04,632: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:47:04.632698179Z [2024-02-24 02:47:04,632: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:47:04.633553656Z [2024-02-24 02:47:04,633: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:47:04.633884581Z [2024-02-24 02:47:04,633: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:47:04.789125690Z [2024-02-24 02:47:04,788: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:47:06.473374882Z [2024-02-24 02:47:06,472: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfc3ee17-17aa-4f9e-8e9e-ac5305dd2812] succeeded in 5.298353677000705s: None
2024-02-24T02:47:07.191582169Z [2024-02-24 02:47:07,190: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[de57139f-256f-4fb1-8256-78e614d3a26c] succeeded in 5.9853640270011965s: None
2024-02-24T02:48:01.020174880Z [2024-02-24 02:48:01,019: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[155eb3b0-4f08-4f7c-80d5-7a002067785c] received
2024-02-24T02:48:01.027358192Z [2024-02-24 02:48:01,027: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6717785-cda9-4a1a-8c1b-b20fcec144c5] received
2024-02-24T02:48:01.036596570Z [2024-02-24 02:48:01,036: INFO/ForkPoolWorker-15] [155eb3b0-4f08-4f7c-80d5-7a002067785c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:48:01.037473130Z [2024-02-24 02:48:01,037: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[891330b0-869d-4c9b-8386-62049d6cedae] received
2024-02-24T02:48:01.043406075Z [2024-02-24 02:48:01,043: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e55b1d72-d7f0-4249-9002-14f27d225d02] received
2024-02-24T02:48:01.049928252Z [2024-02-24 02:48:01,045: INFO/ForkPoolWorker-1] [891330b0-869d-4c9b-8386-62049d6cedae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:48:01.054149914Z [2024-02-24 02:48:01,053: INFO/ForkPoolWorker-16] [e6717785-cda9-4a1a-8c1b-b20fcec144c5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:48:01.064442452Z [2024-02-24 02:48:01,064: INFO/ForkPoolWorker-2] [e55b1d72-d7f0-4249-9002-14f27d225d02] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:48:01.374002706Z [2024-02-24 02:48:01,370: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:48:01.398648621Z [2024-02-24 02:48:01,395: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:48:01.549045484Z [2024-02-24 02:48:01,545: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:48:01.714733425Z [2024-02-24 02:48:01,707: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:48:01.725500330Z [2024-02-24 02:48:01,725: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:48:01.937495900Z [2024-02-24 02:48:01,937: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:48:01.944046596Z [2024-02-24 02:48:01,943: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:48:02.007204393Z [2024-02-24 02:48:02,006: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:48:02.013913817Z [2024-02-24 02:48:02,013: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:48:02.014460108Z [2024-02-24 02:48:02,014: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:48:02.014766011Z [2024-02-24 02:48:02,014: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:48:02.015256173Z [2024-02-24 02:48:02,015: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:48:02.195603579Z [2024-02-24 02:48:02,195: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:48:02.339085798Z [2024-02-24 02:48:02,338: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[155eb3b0-4f08-4f7c-80d5-7a002067785c] succeeded in 1.3160575359997893s: None
2024-02-24T02:48:02.739827099Z [2024-02-24 02:48:02,739: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:48:02.743612806Z [2024-02-24 02:48:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:48:02.834602871Z [2024-02-24 02:48:02,834: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:48:02.836102260Z [2024-02-24 02:48:02,835: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:48:02.836522911Z [2024-02-24 02:48:02,836: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:48:02.837125983Z [2024-02-24 02:48:02,836: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:48:02.837192407Z [2024-02-24 02:48:02,837: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:48:02.837618900Z [2024-02-24 02:48:02,837: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:48:02.838041306Z [2024-02-24 02:48:02,837: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:48:02.932685793Z [2024-02-24 02:48:02,932: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e55b1d72-d7f0-4249-9002-14f27d225d02] succeeded in 1.8855642879989318s: None
2024-02-24T02:48:02.932706236Z [2024-02-24 02:48:02,932: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:48:02.981818878Z [2024-02-24 02:48:02,981: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:48:02.985944301Z [2024-02-24 02:48:02,985: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:48:03.018996727Z [2024-02-24 02:48:03,018: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:48:03.020707553Z [2024-02-24 02:48:03,020: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:48:03.020869162Z [2024-02-24 02:48:03,020: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:48:03.021103866Z [2024-02-24 02:48:03,020: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:48:03.021193222Z [2024-02-24 02:48:03,021: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:48:03.021551459Z [2024-02-24 02:48:03,021: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:48:03.021725886Z [2024-02-24 02:48:03,021: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:48:03.127724949Z [2024-02-24 02:48:03,127: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:48:05.215860963Z [2024-02-24 02:48:05,215: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[891330b0-869d-4c9b-8386-62049d6cedae] succeeded in 4.175137815000198s: None
2024-02-24T02:48:05.324653089Z [2024-02-24 02:48:05,324: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6717785-cda9-4a1a-8c1b-b20fcec144c5] succeeded in 4.294464027998401s: None
2024-02-24T02:49:00.215573944Z [2024-02-24 02:49:00,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62283e4e-ad20-481a-ba76-45afac346c72] received
2024-02-24T02:49:00.223552245Z [2024-02-24 02:49:00,223: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e5b5fe74-9530-4eae-aedb-c45cc0c8a889] received
2024-02-24T02:49:00.225296521Z [2024-02-24 02:49:00,225: INFO/ForkPoolWorker-15] [62283e4e-ad20-481a-ba76-45afac346c72] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:49:00.230636401Z [2024-02-24 02:49:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1622ffec-eaed-432b-910e-26e857e118f9] received
2024-02-24T02:49:00.237477881Z [2024-02-24 02:49:00,237: INFO/ForkPoolWorker-16] [e5b5fe74-9530-4eae-aedb-c45cc0c8a889] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:49:00.239234101Z [2024-02-24 02:49:00,238: INFO/ForkPoolWorker-1] [1622ffec-eaed-432b-910e-26e857e118f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:49:00.530784775Z [2024-02-24 02:49:00,527: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:49:00.535377641Z [2024-02-24 02:49:00,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:49:00.538604836Z [2024-02-24 02:49:00,535: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:49:00.694235634Z [2024-02-24 02:49:00,693: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:49:00.697811289Z [2024-02-24 02:49:00,697: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:49:00.738477679Z [2024-02-24 02:49:00,738: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:49:00.741447513Z [2024-02-24 02:49:00,741: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:49:00.741484155Z [2024-02-24 02:49:00,741: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:49:00.741576353Z [2024-02-24 02:49:00,741: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:49:00.742143028Z [2024-02-24 02:49:00,741: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:49:00.865806953Z [2024-02-24 02:49:00,865: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:49:01.488019400Z [2024-02-24 02:49:01,487: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e5b5fe74-9530-4eae-aedb-c45cc0c8a889] succeeded in 1.2616217459999461s: None
2024-02-24T02:49:01.746145808Z [2024-02-24 02:49:01,745: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:49:01.749564703Z [2024-02-24 02:49:01,749: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:49:01.775805024Z [2024-02-24 02:49:01,775: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:49:01.778476392Z [2024-02-24 02:49:01,778: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:49:01.778813343Z [2024-02-24 02:49:01,778: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:49:01.779567235Z [2024-02-24 02:49:01,779: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:49:01.780068750Z [2024-02-24 02:49:01,779: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:49:01.781273887Z [2024-02-24 02:49:01,780: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:49:01.781743894Z [2024-02-24 02:49:01,781: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:49:01.898985214Z [2024-02-24 02:49:01,898: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:49:01.899167777Z [2024-02-24 02:49:01,898: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:49:01.902354246Z [2024-02-24 02:49:01,901: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:49:01.935750034Z [2024-02-24 02:49:01,931: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:49:01.941514514Z [2024-02-24 02:49:01,941: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:49:01.942268739Z [2024-02-24 02:49:01,941: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:49:01.943087413Z [2024-02-24 02:49:01,942: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:49:01.943390600Z [2024-02-24 02:49:01,943: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:49:01.944108808Z [2024-02-24 02:49:01,943: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:49:01.945421388Z [2024-02-24 02:49:01,945: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:49:02.051631730Z [2024-02-24 02:49:02,051: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:49:03.508599738Z [2024-02-24 02:49:03,507: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1622ffec-eaed-432b-910e-26e857e118f9] succeeded in 3.276257805999194s: None
2024-02-24T02:49:04.203816784Z [2024-02-24 02:49:04,203: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62283e4e-ad20-481a-ba76-45afac346c72] succeeded in 3.9859731050000846s: None
2024-02-24T02:50:00.557741398Z [2024-02-24 02:50:00,557: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f29cb0f0-fd9c-4576-9d2b-5e3e4c6b91d4] received
2024-02-24T02:50:00.562530151Z [2024-02-24 02:50:00,562: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1f8bae02-c715-4726-82a2-7e54636d6294] received
2024-02-24T02:50:00.565112600Z [2024-02-24 02:50:00,564: INFO/ForkPoolWorker-15] [f29cb0f0-fd9c-4576-9d2b-5e3e4c6b91d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:50:00.567019374Z [2024-02-24 02:50:00,566: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[26789072-963b-464d-be1a-983489e10671] received
2024-02-24T02:50:00.575100706Z [2024-02-24 02:50:00,574: INFO/ForkPoolWorker-16] [1f8bae02-c715-4726-82a2-7e54636d6294] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:50:00.575953849Z [2024-02-24 02:50:00,575: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c78da6d6-bfcb-4032-b758-dac90ec393b4] received
2024-02-24T02:50:00.580087432Z [2024-02-24 02:50:00,579: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb48ffd5-6daa-48ac-b272-f35adc6a82f9] received
2024-02-24T02:50:00.580332169Z [2024-02-24 02:50:00,579: INFO/ForkPoolWorker-1] [26789072-963b-464d-be1a-983489e10671] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:50:00.588817273Z [2024-02-24 02:50:00,588: INFO/ForkPoolWorker-2] [c78da6d6-bfcb-4032-b758-dac90ec393b4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:50:00.604009597Z [2024-02-24 02:50:00,603: INFO/ForkPoolWorker-3] [fb48ffd5-6daa-48ac-b272-f35adc6a82f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:50:00.938910551Z [2024-02-24 02:50:00,935: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:50:00.995188219Z [2024-02-24 02:50:00,990: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:50:01.043512539Z [2024-02-24 02:50:01,039: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:50:01.053702129Z [2024-02-24 02:50:01,049: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:50:01.109531253Z [2024-02-24 02:50:01,109: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:50:01.113798837Z [2024-02-24 02:50:01,113: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:01.179791616Z [2024-02-24 02:50:01,171: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:50:01.222264794Z [2024-02-24 02:50:01,219: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:50:01.245996737Z [2024-02-24 02:50:01,226: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:50:01.246004829Z [2024-02-24 02:50:01,226: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:50:01.246008544Z [2024-02-24 02:50:01,227: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:50:01.246011786Z [2024-02-24 02:50:01,227: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:50:01.411651245Z [2024-02-24 02:50:01,411: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:01.606366518Z [2024-02-24 02:50:01,606: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:02.110435924Z [2024-02-24 02:50:02,110: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[26789072-963b-464d-be1a-983489e10671] succeeded in 1.5411243210000976s: None
2024-02-24T02:50:02.279037378Z [2024-02-24 02:50:02,278: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1f8bae02-c715-4726-82a2-7e54636d6294] succeeded in 1.7145067559995368s: None
2024-02-24T02:50:02.514649748Z [2024-02-24 02:50:02,514: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:50:02.518381004Z [2024-02-24 02:50:02,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:02.591607801Z [2024-02-24 02:50:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:50:02.594991543Z [2024-02-24 02:50:02,594: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:02.595254369Z [2024-02-24 02:50:02,594: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:02.595705101Z [2024-02-24 02:50:02,595: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:02.595900094Z [2024-02-24 02:50:02,595: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:50:02.596321023Z [2024-02-24 02:50:02,596: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:50:02.596481555Z [2024-02-24 02:50:02,596: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:02.712109117Z [2024-02-24 02:50:02,711: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:50:02.716319045Z [2024-02-24 02:50:02,715: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:02.758763814Z [2024-02-24 02:50:02,758: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:02.771309813Z [2024-02-24 02:50:02,771: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:50:02.776011491Z [2024-02-24 02:50:02,775: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:02.776447279Z [2024-02-24 02:50:02,776: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:02.776764435Z [2024-02-24 02:50:02,776: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:02.776957580Z [2024-02-24 02:50:02,776: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:50:02.777470934Z [2024-02-24 02:50:02,777: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:50:02.777652737Z [2024-02-24 02:50:02,777: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:02.897037630Z [2024-02-24 02:50:02,896: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:02.947578027Z [2024-02-24 02:50:02,946: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T02:50:02.955366908Z [2024-02-24 02:50:02,953: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:02.982658898Z [2024-02-24 02:50:02,982: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T02:50:02.984710378Z [2024-02-24 02:50:02,984: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:02.984959624Z [2024-02-24 02:50:02,984: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:02.985310173Z [2024-02-24 02:50:02,984: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:02.985439123Z [2024-02-24 02:50:02,985: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T02:50:02.985790589Z [2024-02-24 02:50:02,985: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:50:02.986392954Z [2024-02-24 02:50:02,985: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:03.095719876Z [2024-02-24 02:50:03,095: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:03.540348936Z [2024-02-24 02:50:03,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f29cb0f0-fd9c-4576-9d2b-5e3e4c6b91d4] succeeded in 2.980428409999149s: None
2024-02-24T02:50:04.615362689Z [2024-02-24 02:50:04,615: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[591e559b-f8cd-4272-843f-42452976475c] received
2024-02-24T02:50:04.622186199Z [2024-02-24 02:50:04,621: INFO/ForkPoolWorker-15] [591e559b-f8cd-4272-843f-42452976475c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:50:04.930375943Z [2024-02-24 02:50:04,926: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:50:05.013437315Z [2024-02-24 02:50:05,012: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[fb48ffd5-6daa-48ac-b272-f35adc6a82f9] succeeded in 4.430242382999495s: None
2024-02-24T02:50:05.608262335Z [2024-02-24 02:50:05,607: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c78da6d6-bfcb-4032-b758-dac90ec393b4] succeeded in 5.030207223999241s: None
2024-02-24T02:50:06.075371406Z [2024-02-24 02:50:06,074: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:50:06.078450309Z [2024-02-24 02:50:06,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:06.101341783Z [2024-02-24 02:50:06,101: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:50:06.102979489Z [2024-02-24 02:50:06,102: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:06.103149738Z [2024-02-24 02:50:06,102: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:06.103388581Z [2024-02-24 02:50:06,103: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:06.103544423Z [2024-02-24 02:50:06,103: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:50:06.104001187Z [2024-02-24 02:50:06,103: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:50:06.104249231Z [2024-02-24 02:50:06,104: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:06.208076191Z [2024-02-24 02:50:06,207: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:06.898326979Z [2024-02-24 02:50:06,897: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[591e559b-f8cd-4272-843f-42452976475c] succeeded in 2.2812806659985654s: None
2024-02-24T02:50:07.682259651Z [2024-02-24 02:50:07,681: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b100d74-9882-4655-9df0-d5ce3c9c7e20] received
2024-02-24T02:50:07.693352706Z [2024-02-24 02:50:07,693: INFO/ForkPoolWorker-15] [5b100d74-9882-4655-9df0-d5ce3c9c7e20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:50:07.991434986Z [2024-02-24 02:50:07,988: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:50:09.041921425Z [2024-02-24 02:50:09,037: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:50:09.041965190Z [2024-02-24 02:50:09,040: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:09.064488625Z [2024-02-24 02:50:09,064: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:50:09.066417870Z [2024-02-24 02:50:09,066: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:09.066868897Z [2024-02-24 02:50:09,066: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:09.067630021Z [2024-02-24 02:50:09,067: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:09.067906339Z [2024-02-24 02:50:09,067: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:50:09.068873498Z [2024-02-24 02:50:09,068: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:50:09.069230030Z [2024-02-24 02:50:09,069: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:09.179811338Z [2024-02-24 02:50:09,179: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:09.730748315Z [2024-02-24 02:50:09,730: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[73a19be6-430f-47b9-8bfe-da9ecc404a80] received
2024-02-24T02:50:09.740067566Z [2024-02-24 02:50:09,739: INFO/ForkPoolWorker-16] [73a19be6-430f-47b9-8bfe-da9ecc404a80] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:50:09.798780352Z [2024-02-24 02:50:09,798: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5b100d74-9882-4655-9df0-d5ce3c9c7e20] succeeded in 2.1130887830004212s: None
2024-02-24T02:50:10.047481337Z [2024-02-24 02:50:10,044: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:50:11.136058196Z [2024-02-24 02:50:11,135: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:50:11.139124918Z [2024-02-24 02:50:11,138: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:50:11.168346306Z [2024-02-24 02:50:11,168: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:50:11.174797074Z [2024-02-24 02:50:11,174: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:50:11.174840628Z [2024-02-24 02:50:11,174: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:50:11.175035235Z [2024-02-24 02:50:11,174: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:50:11.175092744Z [2024-02-24 02:50:11,174: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:50:11.175484028Z [2024-02-24 02:50:11,175: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:50:11.175920652Z [2024-02-24 02:50:11,175: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:50:11.333244581Z [2024-02-24 02:50:11,332: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:50:11.960208764Z [2024-02-24 02:50:11,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[73a19be6-430f-47b9-8bfe-da9ecc404a80] succeeded in 2.2265327549994254s: None
2024-02-24T02:51:00.722706910Z [2024-02-24 02:51:00,722: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f24bd0f2-496d-4a87-8bc4-b7af23ba4123] received
2024-02-24T02:51:00.735776971Z [2024-02-24 02:51:00,735: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f5f0d9-bc9a-47fc-9665-d45bdd4a70c4] received
2024-02-24T02:51:00.735951998Z [2024-02-24 02:51:00,735: INFO/ForkPoolWorker-15] [f24bd0f2-496d-4a87-8bc4-b7af23ba4123] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:51:00.742509857Z [2024-02-24 02:51:00,742: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f4bb6944-b0d0-4701-b24f-ff8ac4db50f5] received
2024-02-24T02:51:00.756020443Z [2024-02-24 02:51:00,755: INFO/ForkPoolWorker-1] [f4bb6944-b0d0-4701-b24f-ff8ac4db50f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:51:00.757644179Z [2024-02-24 02:51:00,757: INFO/ForkPoolWorker-16] [b1f5f0d9-bc9a-47fc-9665-d45bdd4a70c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:51:01.011774813Z [2024-02-24 02:51:01,008: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:51:01.079621095Z [2024-02-24 02:51:01,076: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:51:01.101295473Z [2024-02-24 02:51:01,098: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:51:01.352186139Z [2024-02-24 02:51:01,351: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:51:01.356434413Z [2024-02-24 02:51:01,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:51:01.390966340Z [2024-02-24 02:51:01,390: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:51:01.394755108Z [2024-02-24 02:51:01,394: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:51:01.394838650Z [2024-02-24 02:51:01,394: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:51:01.394936221Z [2024-02-24 02:51:01,394: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:51:01.395175736Z [2024-02-24 02:51:01,395: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:51:01.483900974Z [2024-02-24 02:51:01,483: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:51:02.156420511Z [2024-02-24 02:51:02,156: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f4bb6944-b0d0-4701-b24f-ff8ac4db50f5] succeeded in 1.4129268610013241s: None
2024-02-24T02:51:02.197688463Z [2024-02-24 02:51:02,197: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:51:02.200913595Z [2024-02-24 02:51:02,200: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:51:02.235009541Z [2024-02-24 02:51:02,234: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:51:02.236499789Z [2024-02-24 02:51:02,236: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:51:02.236689550Z [2024-02-24 02:51:02,236: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:51:02.236928430Z [2024-02-24 02:51:02,236: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:51:02.237061024Z [2024-02-24 02:51:02,236: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:51:02.237446497Z [2024-02-24 02:51:02,237: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:51:02.237620780Z [2024-02-24 02:51:02,237: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:51:02.273681211Z [2024-02-24 02:51:02,273: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:51:02.276870000Z [2024-02-24 02:51:02,276: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:51:02.298068775Z [2024-02-24 02:51:02,297: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:51:02.299186821Z [2024-02-24 02:51:02,298: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:51:02.299224211Z [2024-02-24 02:51:02,299: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:51:02.299331134Z [2024-02-24 02:51:02,299: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:51:02.299361809Z [2024-02-24 02:51:02,299: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:51:02.299601900Z [2024-02-24 02:51:02,299: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:51:02.299685262Z [2024-02-24 02:51:02,299: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:51:02.339542727Z [2024-02-24 02:51:02,339: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:51:02.393918554Z [2024-02-24 02:51:02,391: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:51:04.125156826Z [2024-02-24 02:51:04,124: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f24bd0f2-496d-4a87-8bc4-b7af23ba4123] succeeded in 3.3980291400002898s: None
2024-02-24T02:51:04.953413990Z [2024-02-24 02:51:04,952: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b1f5f0d9-bc9a-47fc-9665-d45bdd4a70c4] succeeded in 4.206747092001024s: None
2024-02-24T02:52:00.594423196Z [2024-02-24 02:52:00,593: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5540663-9d23-4ccd-a60d-dc33d0e783a7] received
2024-02-24T02:52:00.598499595Z [2024-02-24 02:52:00,597: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c01eab-a34e-42ca-b4f6-851d67e6a29d] received
2024-02-24T02:52:00.606468987Z [2024-02-24 02:52:00,606: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0b554985-f814-4fff-8855-1e53b36fb6f8] received
2024-02-24T02:52:00.613112223Z [2024-02-24 02:52:00,612: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ce0136e-6701-4f2d-aae2-59b04337e614] received
2024-02-24T02:52:00.613640331Z [2024-02-24 02:52:00,613: INFO/ForkPoolWorker-15] [d5540663-9d23-4ccd-a60d-dc33d0e783a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:52:00.613857918Z [2024-02-24 02:52:00,613: INFO/ForkPoolWorker-1] [0b554985-f814-4fff-8855-1e53b36fb6f8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:52:00.617528405Z [2024-02-24 02:52:00,616: INFO/ForkPoolWorker-16] [95c01eab-a34e-42ca-b4f6-851d67e6a29d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:52:00.641104312Z [2024-02-24 02:52:00,640: INFO/ForkPoolWorker-2] [8ce0136e-6701-4f2d-aae2-59b04337e614] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:52:00.938040955Z [2024-02-24 02:52:00,934: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:52:00.957930033Z [2024-02-24 02:52:00,954: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:52:00.970818601Z [2024-02-24 02:52:00,967: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:52:00.985220816Z [2024-02-24 02:52:00,981: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:52:01.102888702Z [2024-02-24 02:52:01,102: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:52:01.107110183Z [2024-02-24 02:52:01,106: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:52:01.167540517Z [2024-02-24 02:52:01,167: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:52:01.174721095Z [2024-02-24 02:52:01,174: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:52:01.174824710Z [2024-02-24 02:52:01,174: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:52:01.174980907Z [2024-02-24 02:52:01,174: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:52:01.175247005Z [2024-02-24 02:52:01,175: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:52:01.424938728Z [2024-02-24 02:52:01,424: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:52:01.466564516Z [2024-02-24 02:52:01,466: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:52:02.191169888Z [2024-02-24 02:52:02,190: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8ce0136e-6701-4f2d-aae2-59b04337e614] succeeded in 1.5705892559999484s: None
2024-02-24T02:52:02.450482127Z [2024-02-24 02:52:02,437: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d5540663-9d23-4ccd-a60d-dc33d0e783a7] succeeded in 1.8369446639990201s: None
2024-02-24T02:52:02.665855279Z [2024-02-24 02:52:02,648: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:52:02.665883204Z [2024-02-24 02:52:02,651: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:52:02.728731700Z [2024-02-24 02:52:02,728: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:52:02.733353149Z [2024-02-24 02:52:02,732: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:52:02.735687469Z [2024-02-24 02:52:02,734: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:52:02.736718382Z [2024-02-24 02:52:02,736: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:52:02.737253139Z [2024-02-24 02:52:02,737: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:52:02.737737346Z [2024-02-24 02:52:02,737: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:52:02.737844048Z [2024-02-24 02:52:02,737: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:52:02.738101358Z [2024-02-24 02:52:02,737: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:52:02.738251389Z [2024-02-24 02:52:02,738: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:52:02.788268373Z [2024-02-24 02:52:02,787: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:52:02.789859240Z [2024-02-24 02:52:02,789: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:52:02.789937483Z [2024-02-24 02:52:02,789: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:52:02.790138557Z [2024-02-24 02:52:02,789: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:52:02.790253489Z [2024-02-24 02:52:02,790: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:52:02.790573280Z [2024-02-24 02:52:02,790: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:52:02.794017406Z [2024-02-24 02:52:02,790: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:52:02.898076959Z [2024-02-24 02:52:02,897: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:52:02.942838396Z [2024-02-24 02:52:02,942: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:52:05.500228664Z [2024-02-24 02:52:05,499: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95c01eab-a34e-42ca-b4f6-851d67e6a29d] succeeded in 4.897857063999254s: None
2024-02-24T02:52:05.551765383Z [2024-02-24 02:52:05,551: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0b554985-f814-4fff-8855-1e53b36fb6f8] succeeded in 4.943407483000556s: None
2024-02-24T02:53:01.354873037Z [2024-02-24 02:53:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c548e59-5a39-4287-8f2d-ad45c9dda1cc] received
2024-02-24T02:53:01.358575343Z [2024-02-24 02:53:01,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3095fad7-36f3-4645-b946-fcb222ce8a43] received
2024-02-24T02:53:01.361717070Z [2024-02-24 02:53:01,361: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea006408-19f6-43de-93b8-5c75c29f4699] received
2024-02-24T02:53:01.370189340Z [2024-02-24 02:53:01,369: INFO/ForkPoolWorker-16] [3095fad7-36f3-4645-b946-fcb222ce8a43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:53:01.370374826Z [2024-02-24 02:53:01,370: INFO/ForkPoolWorker-15] [5c548e59-5a39-4287-8f2d-ad45c9dda1cc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:53:01.377539170Z [2024-02-24 02:53:01,377: INFO/ForkPoolWorker-1] [ea006408-19f6-43de-93b8-5c75c29f4699] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:53:01.797356788Z [2024-02-24 02:53:01,794: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:53:01.825052831Z [2024-02-24 02:53:01,821: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:53:01.847544727Z [2024-02-24 02:53:01,843: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:53:02.017351530Z [2024-02-24 02:53:02,016: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:53:02.022495390Z [2024-02-24 02:53:02,022: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:53:02.107776729Z [2024-02-24 02:53:02,107: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:53:02.111062480Z [2024-02-24 02:53:02,110: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:53:02.111601999Z [2024-02-24 02:53:02,110: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:53:02.111714877Z [2024-02-24 02:53:02,111: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:53:02.112389549Z [2024-02-24 02:53:02,112: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:53:02.221121460Z [2024-02-24 02:53:02,220: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:53:03.124740926Z [2024-02-24 02:53:03,124: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea006408-19f6-43de-93b8-5c75c29f4699] succeeded in 1.7545254610013217s: None
2024-02-24T02:53:03.355388281Z [2024-02-24 02:53:03,355: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:53:03.358616682Z [2024-02-24 02:53:03,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:53:03.378574441Z [2024-02-24 02:53:03,378: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:53:03.379723568Z [2024-02-24 02:53:03,379: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:53:03.379798381Z [2024-02-24 02:53:03,379: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:53:03.379954463Z [2024-02-24 02:53:03,379: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:53:03.380013698Z [2024-02-24 02:53:03,379: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:53:03.380251812Z [2024-02-24 02:53:03,380: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:53:03.380321800Z [2024-02-24 02:53:03,380: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:53:03.460227135Z [2024-02-24 02:53:03,459: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:53:03.727988008Z [2024-02-24 02:53:03,726: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:53:03.730363783Z [2024-02-24 02:53:03,729: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:53:03.757584952Z [2024-02-24 02:53:03,757: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:53:03.762388271Z [2024-02-24 02:53:03,761: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:53:03.762840816Z [2024-02-24 02:53:03,762: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:53:03.763480718Z [2024-02-24 02:53:03,762: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:53:03.763734615Z [2024-02-24 02:53:03,763: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:53:03.764565207Z [2024-02-24 02:53:03,764: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:53:03.764807785Z [2024-02-24 02:53:03,764: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:53:03.878171908Z [2024-02-24 02:53:03,877: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:53:07.534544980Z [2024-02-24 02:53:07,533: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3095fad7-36f3-4645-b946-fcb222ce8a43] succeeded in 6.1710374129997945s: None
2024-02-24T02:53:08.051337750Z [2024-02-24 02:53:08,049: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5c548e59-5a39-4287-8f2d-ad45c9dda1cc] succeeded in 6.691133864000221s: None
2024-02-24T02:54:00.473722150Z [2024-02-24 02:54:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fb33f2d5-07cc-4810-add2-df8da82074c0] received
2024-02-24T02:54:00.479273322Z [2024-02-24 02:54:00,478: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe957450-01a3-4b7b-80d7-8b30bc562558] received
2024-02-24T02:54:00.483924208Z [2024-02-24 02:54:00,483: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe698709-1bd6-476c-94ad-ca5274305a37] received
2024-02-24T02:54:00.484442867Z [2024-02-24 02:54:00,484: INFO/ForkPoolWorker-15] [fb33f2d5-07cc-4810-add2-df8da82074c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:54:00.487263683Z [2024-02-24 02:54:00,487: INFO/ForkPoolWorker-16] [fe957450-01a3-4b7b-80d7-8b30bc562558] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:54:00.499026802Z [2024-02-24 02:54:00,498: INFO/ForkPoolWorker-1] [fe698709-1bd6-476c-94ad-ca5274305a37] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:54:00.509230121Z [2024-02-24 02:54:00,509: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbe7d1e9-1f9a-4a31-a1ab-b70565c4d436] received
2024-02-24T02:54:00.517748802Z [2024-02-24 02:54:00,516: INFO/ForkPoolWorker-2] [fbe7d1e9-1f9a-4a31-a1ab-b70565c4d436] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:54:00.829072063Z [2024-02-24 02:54:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:54:00.936840694Z [2024-02-24 02:54:00,925: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:54:00.956589392Z [2024-02-24 02:54:00,953: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:54:01.273959198Z [2024-02-24 02:54:01,264: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:54:01.361215740Z [2024-02-24 02:54:01,360: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:54:01.372490764Z [2024-02-24 02:54:01,372: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:54:01.461376669Z [2024-02-24 02:54:01,461: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:54:01.466858735Z [2024-02-24 02:54:01,466: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:54:01.467028898Z [2024-02-24 02:54:01,466: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:54:01.467169527Z [2024-02-24 02:54:01,466: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:54:01.467440723Z [2024-02-24 02:54:01,467: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:54:01.601044301Z [2024-02-24 02:54:01,600: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:54:01.620746049Z [2024-02-24 02:54:01,620: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:54:02.216334594Z [2024-02-24 02:54:02,215: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fb33f2d5-07cc-4810-add2-df8da82074c0] succeeded in 1.740617225999813s: None
2024-02-24T02:54:02.433028634Z [2024-02-24 02:54:02,431: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbe7d1e9-1f9a-4a31-a1ab-b70565c4d436] succeeded in 1.9204155119987263s: None
2024-02-24T02:54:02.457870094Z [2024-02-24 02:54:02,457: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:54:02.461850020Z [2024-02-24 02:54:02,461: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:54:02.490122463Z [2024-02-24 02:54:02,489: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:54:02.491859594Z [2024-02-24 02:54:02,491: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:54:02.491990704Z [2024-02-24 02:54:02,491: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:54:02.492201634Z [2024-02-24 02:54:02,491: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:54:02.492314183Z [2024-02-24 02:54:02,492: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:54:02.492691889Z [2024-02-24 02:54:02,492: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:54:02.492846095Z [2024-02-24 02:54:02,492: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:54:02.589846520Z [2024-02-24 02:54:02,589: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:54:02.592862716Z [2024-02-24 02:54:02,592: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:54:02.596260056Z [2024-02-24 02:54:02,595: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:54:02.616898430Z [2024-02-24 02:54:02,616: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:54:02.618088397Z [2024-02-24 02:54:02,617: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:54:02.618206287Z [2024-02-24 02:54:02,618: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:54:02.618316386Z [2024-02-24 02:54:02,618: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:54:02.618341853Z [2024-02-24 02:54:02,618: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:54:02.619236300Z [2024-02-24 02:54:02,619: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:54:02.619338324Z [2024-02-24 02:54:02,619: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:54:02.827036570Z [2024-02-24 02:54:02,826: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:54:04.305374175Z [2024-02-24 02:54:04,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fe698709-1bd6-476c-94ad-ca5274305a37] succeeded in 3.8192619860001287s: None
2024-02-24T02:54:04.999932101Z [2024-02-24 02:54:04,999: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fe957450-01a3-4b7b-80d7-8b30bc562558] succeeded in 4.518772117000481s: None
2024-02-24T02:55:00.588130408Z [2024-02-24 02:55:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c068e9f7-31f0-4f30-942c-8d0f407e76e7] received
2024-02-24T02:55:00.589848805Z [2024-02-24 02:55:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ff5129c-d543-4b1e-a4a0-5ae05da2cb6a] received
2024-02-24T02:55:00.597467010Z [2024-02-24 02:55:00,597: INFO/ForkPoolWorker-16] [7ff5129c-d543-4b1e-a4a0-5ae05da2cb6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:55:00.607688956Z [2024-02-24 02:55:00,607: INFO/ForkPoolWorker-15] [c068e9f7-31f0-4f30-942c-8d0f407e76e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:55:00.626232842Z [2024-02-24 02:55:00,625: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[335b1dca-33e0-4e03-845f-ebb88f488af9] received
2024-02-24T02:55:00.629067691Z [2024-02-24 02:55:00,628: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[025df665-0e02-4a26-a028-9d3ed209667e] received
2024-02-24T02:55:00.636258580Z [2024-02-24 02:55:00,636: INFO/ForkPoolWorker-1] [335b1dca-33e0-4e03-845f-ebb88f488af9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:55:00.666802722Z [2024-02-24 02:55:00,666: INFO/ForkPoolWorker-2] [025df665-0e02-4a26-a028-9d3ed209667e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:55:01.266170032Z [2024-02-24 02:55:01,254: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:55:01.299591394Z [2024-02-24 02:55:01,295: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:55:01.354870610Z [2024-02-24 02:55:01,349: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:55:01.520308999Z [2024-02-24 02:55:01,517: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:55:01.536942613Z [2024-02-24 02:55:01,536: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T02:55:01.541386316Z [2024-02-24 02:55:01,540: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:01.571758019Z [2024-02-24 02:55:01,571: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:55:01.578977800Z [2024-02-24 02:55:01,578: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:55:01.579036465Z [2024-02-24 02:55:01,578: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:55:01.579220904Z [2024-02-24 02:55:01,579: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T02:55:01.579593052Z [2024-02-24 02:55:01,579: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:55:01.767544755Z [2024-02-24 02:55:01,767: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:02.989731654Z [2024-02-24 02:55:02,989: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ff5129c-d543-4b1e-a4a0-5ae05da2cb6a] succeeded in 2.3982918159999826s: None
2024-02-24T02:55:03.708365456Z [2024-02-24 02:55:03,707: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:55:03.713852162Z [2024-02-24 02:55:03,711: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:03.784240152Z [2024-02-24 02:55:03,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:55:03.798186913Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:03.798206946Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:03.798351259Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:03.798359318Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:55:03.798362769Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:55:03.798366264Z [2024-02-24 02:55:03,797: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:03.857870908Z [2024-02-24 02:55:03,857: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T02:55:03.861484368Z [2024-02-24 02:55:03,861: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:03.890345668Z [2024-02-24 02:55:03,890: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:55:03.897858101Z [2024-02-24 02:55:03,893: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:03.897881590Z [2024-02-24 02:55:03,893: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:03.897887881Z [2024-02-24 02:55:03,893: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:03.897892387Z [2024-02-24 02:55:03,893: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T02:55:03.897895607Z [2024-02-24 02:55:03,894: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:55:03.897898914Z [2024-02-24 02:55:03,894: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:04.047280890Z [2024-02-24 02:55:04,046: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:04.198621769Z [2024-02-24 02:55:04,198: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:04.722727994Z [2024-02-24 02:55:04,722: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:55:04.726422505Z [2024-02-24 02:55:04,725: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:04.758270030Z [2024-02-24 02:55:04,757: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:55:04.762319542Z [2024-02-24 02:55:04,761: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:04.762415822Z [2024-02-24 02:55:04,762: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:04.762691453Z [2024-02-24 02:55:04,762: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:04.762820835Z [2024-02-24 02:55:04,762: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:55:04.763290211Z [2024-02-24 02:55:04,763: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:55:04.763414274Z [2024-02-24 02:55:04,763: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:04.987595227Z [2024-02-24 02:55:04,985: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:05.782799291Z [2024-02-24 02:55:05,782: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[335b1dca-33e0-4e03-845f-ebb88f488af9] succeeded in 5.152207197001189s: None
2024-02-24T02:55:05.899493968Z [2024-02-24 02:55:05,899: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c068e9f7-31f0-4f30-942c-8d0f407e76e7] succeeded in 5.309899231999225s: None
2024-02-24T02:55:06.813921560Z [2024-02-24 02:55:06,813: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[63dcbd98-24e5-4508-a9e2-34fec58e461d] received
2024-02-24T02:55:06.845170870Z [2024-02-24 02:55:06,844: INFO/ForkPoolWorker-15] [63dcbd98-24e5-4508-a9e2-34fec58e461d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:55:07.238233105Z [2024-02-24 02:55:07,234: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:55:07.379682798Z [2024-02-24 02:55:07,378: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[025df665-0e02-4a26-a028-9d3ed209667e] succeeded in 6.746718076999969s: None
2024-02-24T02:55:08.697919506Z [2024-02-24 02:55:08,697: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:55:08.701145632Z [2024-02-24 02:55:08,700: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:08.731110060Z [2024-02-24 02:55:08,730: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:55:08.732574879Z [2024-02-24 02:55:08,732: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:08.732718331Z [2024-02-24 02:55:08,732: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:08.732885727Z [2024-02-24 02:55:08,732: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:08.732977272Z [2024-02-24 02:55:08,732: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:55:08.733231019Z [2024-02-24 02:55:08,733: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:55:08.733615877Z [2024-02-24 02:55:08,733: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:08.848706654Z [2024-02-24 02:55:08,848: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:09.575357733Z [2024-02-24 02:55:09,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[63dcbd98-24e5-4508-a9e2-34fec58e461d] succeeded in 2.74721101599971s: None
2024-02-24T02:55:09.578414106Z [2024-02-24 02:55:09,578: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[55b8d7e8-6879-46a6-976b-89b1029bebc9] received
2024-02-24T02:55:09.587193252Z [2024-02-24 02:55:09,586: INFO/ForkPoolWorker-15] [55b8d7e8-6879-46a6-976b-89b1029bebc9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T02:55:09.967929419Z [2024-02-24 02:55:09,962: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:55:11.242057321Z [2024-02-24 02:55:11,241: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:55:11.246854463Z [2024-02-24 02:55:11,246: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:11.314602886Z [2024-02-24 02:55:11,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:55:11.316159818Z [2024-02-24 02:55:11,315: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:11.316625538Z [2024-02-24 02:55:11,316: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:11.317897734Z [2024-02-24 02:55:11,316: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:11.317909484Z [2024-02-24 02:55:11,316: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:55:11.317913364Z [2024-02-24 02:55:11,317: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:55:11.317917069Z [2024-02-24 02:55:11,317: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:11.407770803Z [2024-02-24 02:55:11,407: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:12.024357684Z [2024-02-24 02:55:12,023: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[55b8d7e8-6879-46a6-976b-89b1029bebc9] succeeded in 2.4444233310005075s: None
2024-02-24T02:55:13.067680141Z [2024-02-24 02:55:13,067: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1441418b-6e93-4d76-a78e-884640870282] received
2024-02-24T02:55:13.095992377Z [2024-02-24 02:55:13,095: INFO/ForkPoolWorker-15] [1441418b-6e93-4d76-a78e-884640870282] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T02:55:13.433821064Z [2024-02-24 02:55:13,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T02:55:14.584521760Z [2024-02-24 02:55:14,584: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:55:14.587682058Z [2024-02-24 02:55:14,587: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:55:14.614918362Z [2024-02-24 02:55:14,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:55:14.616422587Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:55:14.616444641Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:55:14.616621127Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:55:14.616704987Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:55:14.616980931Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T02:55:14.617001574Z [2024-02-24 02:55:14,616: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:55:14.757910290Z [2024-02-24 02:55:14,757: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:55:15.340294912Z [2024-02-24 02:55:15,339: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1441418b-6e93-4d76-a78e-884640870282] succeeded in 2.270105835999857s: None
2024-02-24T02:56:00.473522977Z [2024-02-24 02:56:00,473: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[52c715f5-26a1-431a-be31-7607a01d2386] received
2024-02-24T02:56:00.477859492Z [2024-02-24 02:56:00,477: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[11b796e2-cf94-48c8-9637-96034f5be62d] received
2024-02-24T02:56:00.484415259Z [2024-02-24 02:56:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[64195eba-73f2-47c0-9d52-8e7eca20898a] received
2024-02-24T02:56:00.486100124Z [2024-02-24 02:56:00,485: INFO/ForkPoolWorker-15] [52c715f5-26a1-431a-be31-7607a01d2386] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:56:00.488029854Z [2024-02-24 02:56:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbdfc385-77b9-46ae-b23e-834696c044d9] received
2024-02-24T02:56:00.492866215Z [2024-02-24 02:56:00,492: INFO/ForkPoolWorker-16] [11b796e2-cf94-48c8-9637-96034f5be62d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:56:00.493677639Z [2024-02-24 02:56:00,493: INFO/ForkPoolWorker-1] [64195eba-73f2-47c0-9d52-8e7eca20898a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:56:00.507974096Z [2024-02-24 02:56:00,507: INFO/ForkPoolWorker-2] [fbdfc385-77b9-46ae-b23e-834696c044d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:56:00.894778641Z [2024-02-24 02:56:00,891: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:56:00.916473734Z [2024-02-24 02:56:00,912: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:56:00.961521964Z [2024-02-24 02:56:00,958: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:56:01.010634404Z [2024-02-24 02:56:01,006: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:56:01.055722007Z [2024-02-24 02:56:01,055: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:56:01.060685784Z [2024-02-24 02:56:01,060: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:56:01.083397520Z [2024-02-24 02:56:01,083: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:56:01.086055096Z [2024-02-24 02:56:01,085: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:56:01.086229351Z [2024-02-24 02:56:01,086: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:56:01.086358675Z [2024-02-24 02:56:01,086: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:56:01.086645391Z [2024-02-24 02:56:01,086: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:56:01.183682718Z [2024-02-24 02:56:01,183: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:56:01.428812244Z [2024-02-24 02:56:01,428: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:56:01.922468440Z [2024-02-24 02:56:01,922: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fbdfc385-77b9-46ae-b23e-834696c044d9] succeeded in 1.4309150429999136s: None
2024-02-24T02:56:02.115639407Z [2024-02-24 02:56:02,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[52c715f5-26a1-431a-be31-7607a01d2386] succeeded in 1.6403514620014903s: None
2024-02-24T02:56:02.262321968Z [2024-02-24 02:56:02,261: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:56:02.265849662Z [2024-02-24 02:56:02,265: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:56:02.293648340Z [2024-02-24 02:56:02,293: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:56:02.295361027Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:56:02.295411506Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:56:02.295636108Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:56:02.295708357Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:56:02.296030228Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:56:02.296565186Z [2024-02-24 02:56:02,295: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:56:02.433909488Z [2024-02-24 02:56:02,430: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:56:02.435569957Z [2024-02-24 02:56:02,434: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:56:02.452866741Z [2024-02-24 02:56:02,452: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:56:02.461666312Z [2024-02-24 02:56:02,461: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:56:02.466746323Z [2024-02-24 02:56:02,466: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:56:02.466772567Z [2024-02-24 02:56:02,466: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:56:02.466932856Z [2024-02-24 02:56:02,466: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:56:02.467098742Z [2024-02-24 02:56:02,466: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:56:02.467462582Z [2024-02-24 02:56:02,467: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:56:02.467509951Z [2024-02-24 02:56:02,467: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:56:02.580247417Z [2024-02-24 02:56:02,579: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:56:04.281692227Z [2024-02-24 02:56:04,281: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[64195eba-73f2-47c0-9d52-8e7eca20898a] succeeded in 3.795141799999328s: None
2024-02-24T02:56:05.247156508Z [2024-02-24 02:56:05,246: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[11b796e2-cf94-48c8-9637-96034f5be62d] succeeded in 4.7674321249996865s: None
2024-02-24T02:57:00.881330886Z [2024-02-24 02:57:00,880: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94be9e83-4dad-423b-8aca-9fa06efe3256] received
2024-02-24T02:57:00.889643759Z [2024-02-24 02:57:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f84291e8-805e-4bdf-b372-7c69b3480467] received
2024-02-24T02:57:00.896380943Z [2024-02-24 02:57:00,895: INFO/ForkPoolWorker-15] [94be9e83-4dad-423b-8aca-9fa06efe3256] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:57:00.906422684Z [2024-02-24 02:57:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a79f126-6459-4257-b4fb-91a145950085] received
2024-02-24T02:57:00.908309067Z [2024-02-24 02:57:00,907: INFO/ForkPoolWorker-16] [f84291e8-805e-4bdf-b372-7c69b3480467] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:57:00.920285042Z [2024-02-24 02:57:00,919: INFO/ForkPoolWorker-1] [1a79f126-6459-4257-b4fb-91a145950085] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:57:01.317946019Z [2024-02-24 02:57:01,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:57:01.328604723Z [2024-02-24 02:57:01,323: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:57:01.390930689Z [2024-02-24 02:57:01,387: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:57:01.513820985Z [2024-02-24 02:57:01,513: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T02:57:01.517962112Z [2024-02-24 02:57:01,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:57:01.543480182Z [2024-02-24 02:57:01,543: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:57:01.545032905Z [2024-02-24 02:57:01,544: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:57:01.545201466Z [2024-02-24 02:57:01,544: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:57:01.545330417Z [2024-02-24 02:57:01,545: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T02:57:01.545569670Z [2024-02-24 02:57:01,545: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:57:01.659433255Z [2024-02-24 02:57:01,659: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:57:02.330965613Z [2024-02-24 02:57:02,330: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94be9e83-4dad-423b-8aca-9fa06efe3256] succeeded in 1.4473362310000084s: None
2024-02-24T02:57:02.748219940Z [2024-02-24 02:57:02,747: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:57:02.754537057Z [2024-02-24 02:57:02,753: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:57:02.755654631Z [2024-02-24 02:57:02,755: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:57:02.762561665Z [2024-02-24 02:57:02,761: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:57:02.780416460Z [2024-02-24 02:57:02,780: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:57:02.782182409Z [2024-02-24 02:57:02,781: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:57:02.782398108Z [2024-02-24 02:57:02,782: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:57:02.782588981Z [2024-02-24 02:57:02,782: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:57:02.782656282Z [2024-02-24 02:57:02,782: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:57:02.783063432Z [2024-02-24 02:57:02,782: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:57:02.783308458Z [2024-02-24 02:57:02,783: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:57:02.800775405Z [2024-02-24 02:57:02,800: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:57:02.802778665Z [2024-02-24 02:57:02,802: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:57:02.802817924Z [2024-02-24 02:57:02,802: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:57:02.803023932Z [2024-02-24 02:57:02,802: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:57:02.803180716Z [2024-02-24 02:57:02,802: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:57:02.803607780Z [2024-02-24 02:57:02,803: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:57:02.804415435Z [2024-02-24 02:57:02,803: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:57:02.895296338Z [2024-02-24 02:57:02,894: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:57:02.899117570Z [2024-02-24 02:57:02,898: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:57:04.970409841Z [2024-02-24 02:57:04,969: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1a79f126-6459-4257-b4fb-91a145950085] succeeded in 4.060828843999843s: None
2024-02-24T02:57:05.167930112Z [2024-02-24 02:57:05,167: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f84291e8-805e-4bdf-b372-7c69b3480467] succeeded in 4.275159347000226s: None
2024-02-24T02:58:00.305021108Z [2024-02-24 02:58:00,304: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[abdbca2f-bb1b-4f1b-b06e-79d6e8734477] received
2024-02-24T02:58:00.314233826Z [2024-02-24 02:58:00,313: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d5e68ee1-e0ee-490b-963d-745c66e50b81] received
2024-02-24T02:58:00.318086477Z [2024-02-24 02:58:00,317: INFO/ForkPoolWorker-15] [abdbca2f-bb1b-4f1b-b06e-79d6e8734477] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T02:58:00.322941727Z [2024-02-24 02:58:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba6fb015-a566-4723-883c-020f879887e9] received
2024-02-24T02:58:00.327819448Z [2024-02-24 02:58:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1614b17-9905-4dc0-95ce-9c41f3bae042] received
2024-02-24T02:58:00.342615915Z [2024-02-24 02:58:00,342: INFO/ForkPoolWorker-16] [d5e68ee1-e0ee-490b-963d-745c66e50b81] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:58:00.345128639Z [2024-02-24 02:58:00,344: INFO/ForkPoolWorker-2] [f1614b17-9905-4dc0-95ce-9c41f3bae042] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:58:00.347925994Z [2024-02-24 02:58:00,347: INFO/ForkPoolWorker-1] [ba6fb015-a566-4723-883c-020f879887e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:58:00.662881641Z [2024-02-24 02:58:00,658: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:58:00.719742610Z [2024-02-24 02:58:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T02:58:00.748025030Z [2024-02-24 02:58:00,744: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:58:00.809484912Z [2024-02-24 02:58:00,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:58:00.827462968Z [2024-02-24 02:58:00,827: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T02:58:00.831799515Z [2024-02-24 02:58:00,831: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:58:00.877657823Z [2024-02-24 02:58:00,876: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T02:58:00.878090478Z [2024-02-24 02:58:00,877: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:58:00.878279910Z [2024-02-24 02:58:00,878: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:58:00.878434983Z [2024-02-24 02:58:00,878: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T02:58:00.878814641Z [2024-02-24 02:58:00,878: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:58:01.004241949Z [2024-02-24 02:58:01,003: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:58:01.016478553Z [2024-02-24 02:58:01,016: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:58:01.658737310Z [2024-02-24 02:58:01,658: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[abdbca2f-bb1b-4f1b-b06e-79d6e8734477] succeeded in 1.351573735999409s: None
2024-02-24T02:58:01.694809289Z [2024-02-24 02:58:01,694: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1614b17-9905-4dc0-95ce-9c41f3bae042] succeeded in 1.3595986830005131s: None
2024-02-24T02:58:02.200118050Z [2024-02-24 02:58:02,199: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:58:02.203981009Z [2024-02-24 02:58:02,203: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:58:02.227956938Z [2024-02-24 02:58:02,227: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:58:02.229625741Z [2024-02-24 02:58:02,229: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:58:02.229988802Z [2024-02-24 02:58:02,229: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:58:02.230287885Z [2024-02-24 02:58:02,230: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:58:02.230505899Z [2024-02-24 02:58:02,230: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:58:02.230903376Z [2024-02-24 02:58:02,230: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:58:02.231090622Z [2024-02-24 02:58:02,230: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:58:02.237283105Z [2024-02-24 02:58:02,236: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T02:58:02.241075809Z [2024-02-24 02:58:02,240: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:58:02.274245207Z [2024-02-24 02:58:02,273: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:58:02.276174492Z [2024-02-24 02:58:02,275: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:58:02.276215431Z [2024-02-24 02:58:02,276: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:58:02.276345175Z [2024-02-24 02:58:02,276: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:58:02.276380212Z [2024-02-24 02:58:02,276: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T02:58:02.276699181Z [2024-02-24 02:58:02,276: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:58:02.276760109Z [2024-02-24 02:58:02,276: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:58:02.321986689Z [2024-02-24 02:58:02,321: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:58:02.419899493Z [2024-02-24 02:58:02,419: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:58:04.011314382Z [2024-02-24 02:58:04,010: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ba6fb015-a566-4723-883c-020f879887e9] succeeded in 3.673390261001259s: None
2024-02-24T02:58:04.452074531Z [2024-02-24 02:58:04,451: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d5e68ee1-e0ee-490b-963d-745c66e50b81] succeeded in 4.135067621999042s: None
2024-02-24T02:59:00.648861921Z [2024-02-24 02:59:00,648: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[240e4671-2480-4c39-a00a-8394014815e6] received
2024-02-24T02:59:00.655066105Z [2024-02-24 02:59:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8df0677f-8551-4cfd-82e4-c64d1bd49f77] received
2024-02-24T02:59:00.655584715Z [2024-02-24 02:59:00,655: INFO/ForkPoolWorker-15] [240e4671-2480-4c39-a00a-8394014815e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T02:59:00.660153518Z [2024-02-24 02:59:00,659: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[074e122d-7814-41b9-9480-8044cadbf778] received
2024-02-24T02:59:00.670111027Z [2024-02-24 02:59:00,669: INFO/ForkPoolWorker-1] [074e122d-7814-41b9-9480-8044cadbf778] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T02:59:00.670543375Z [2024-02-24 02:59:00,670: INFO/ForkPoolWorker-16] [8df0677f-8551-4cfd-82e4-c64d1bd49f77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T02:59:00.964001674Z [2024-02-24 02:59:00,960: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T02:59:00.987432501Z [2024-02-24 02:59:00,984: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T02:59:01.018720533Z [2024-02-24 02:59:01,015: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T02:59:01.145549171Z [2024-02-24 02:59:01,145: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T02:59:01.149588556Z [2024-02-24 02:59:01,149: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:59:01.180870818Z [2024-02-24 02:59:01,180: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T02:59:01.182848162Z [2024-02-24 02:59:01,182: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T02:59:01.183061256Z [2024-02-24 02:59:01,182: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T02:59:01.183253290Z [2024-02-24 02:59:01,183: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T02:59:01.183577589Z [2024-02-24 02:59:01,183: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T02:59:01.302076021Z [2024-02-24 02:59:01,295: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:59:01.913712428Z [2024-02-24 02:59:01,913: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[074e122d-7814-41b9-9480-8044cadbf778] succeeded in 1.2517503189992567s: None
2024-02-24T02:59:02.369078422Z [2024-02-24 02:59:02,367: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T02:59:02.371013213Z [2024-02-24 02:59:02,370: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:59:02.385946556Z [2024-02-24 02:59:02,385: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T02:59:02.389202198Z [2024-02-24 02:59:02,388: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T02:59:02.410740444Z [2024-02-24 02:59:02,410: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T02:59:02.412808248Z [2024-02-24 02:59:02,412: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:59:02.412930666Z [2024-02-24 02:59:02,412: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:59:02.413480021Z [2024-02-24 02:59:02,413: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:59:02.413508496Z [2024-02-24 02:59:02,413: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T02:59:02.413689367Z [2024-02-24 02:59:02,413: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T02:59:02.414116770Z [2024-02-24 02:59:02,413: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T02:59:02.414938770Z [2024-02-24 02:59:02,414: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:59:02.415026883Z [2024-02-24 02:59:02,414: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T02:59:02.415073978Z [2024-02-24 02:59:02,414: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T02:59:02.415216289Z [2024-02-24 02:59:02,415: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T02:59:02.415224457Z [2024-02-24 02:59:02,415: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T02:59:02.415441033Z [2024-02-24 02:59:02,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T02:59:02.415454284Z [2024-02-24 02:59:02,415: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T02:59:02.495347551Z [2024-02-24 02:59:02,495: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:59:02.500532311Z [2024-02-24 02:59:02,500: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T02:59:04.117495975Z [2024-02-24 02:59:04,116: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8df0677f-8551-4cfd-82e4-c64d1bd49f77] succeeded in 3.458287286999621s: None
2024-02-24T02:59:04.399450119Z [2024-02-24 02:59:04,398: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[240e4671-2480-4c39-a00a-8394014815e6] succeeded in 3.748017231000631s: None
2024-02-24T03:00:01.133176131Z [2024-02-24 03:00:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d838799-4d1e-4b3d-b0d0-8a8c3b1cd803] received
2024-02-24T03:00:01.135348195Z [2024-02-24 03:00:01,135: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b11e03b6-cde2-434e-b809-cb052f344f96] received
2024-02-24T03:00:01.144304219Z [2024-02-24 03:00:01,143: INFO/ForkPoolWorker-16] [b11e03b6-cde2-434e-b809-cb052f344f96] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T02:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:00:01.148308803Z [2024-02-24 03:00:01,148: INFO/ForkPoolWorker-15] [4d838799-4d1e-4b3d-b0d0-8a8c3b1cd803] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:00:01.149329777Z [2024-02-24 03:00:01,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a9d73144-6009-4903-8923-bd7ee7d69fdd] received
2024-02-24T03:00:01.154813863Z [2024-02-24 03:00:01,154: INFO/ForkPoolWorker-1] [a9d73144-6009-4903-8923-bd7ee7d69fdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:00:01.155247119Z [2024-02-24 03:00:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15d2ff8e-4aa6-485f-86e4-de31465763af] received
2024-02-24T03:00:01.192176769Z [2024-02-24 03:00:01,191: INFO/ForkPoolWorker-2] [15d2ff8e-4aa6-485f-86e4-de31465763af] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:00:01.253943205Z [2024-02-24 03:00:01,251: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9015d9bd-dde0-49b0-8880-df2c918eaa2f] received
2024-02-24T03:00:01.290883889Z [2024-02-24 03:00:01,283: INFO/ForkPoolWorker-3] [9015d9bd-dde0-49b0-8880-df2c918eaa2f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T02:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:00:01.485122990Z [2024-02-24 03:00:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:00:01.617522680Z [2024-02-24 03:00:01,614: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:00:01.675156128Z [2024-02-24 03:00:01,671: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:00:01.716816614Z [2024-02-24 03:00:01,713: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:00:01.864938396Z [2024-02-24 03:00:01,864: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T03:00:01.870019934Z [2024-02-24 03:00:01,869: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:01.964131422Z [2024-02-24 03:00:01,959: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:00:01.986915220Z [2024-02-24 03:00:01,986: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T03:00:01.990718218Z [2024-02-24 03:00:01,990: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:00:01.990956098Z [2024-02-24 03:00:01,990: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:00:01.991191981Z [2024-02-24 03:00:01,990: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T03:00:01.991527341Z [2024-02-24 03:00:01,991: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:00:02.134439338Z [2024-02-24 03:00:02,134: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:02.413957202Z [2024-02-24 03:00:02,408: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T02:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:03.177148803Z [2024-02-24 03:00:03,176: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b11e03b6-cde2-434e-b809-cb052f344f96] succeeded in 2.0391417010014266s: None
2024-02-24T03:00:03.276395526Z [2024-02-24 03:00:03,275: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9015d9bd-dde0-49b0-8880-df2c918eaa2f] succeeded in 2.022776130001148s: None
2024-02-24T03:00:03.380030731Z [2024-02-24 03:00:03,379: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:00:03.387273591Z [2024-02-24 03:00:03,386: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:03.434043473Z [2024-02-24 03:00:03,433: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:00:03.435945512Z [2024-02-24 03:00:03,435: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:03.436225904Z [2024-02-24 03:00:03,436: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:03.436566216Z [2024-02-24 03:00:03,436: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:03.436823890Z [2024-02-24 03:00:03,436: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:00:03.437196837Z [2024-02-24 03:00:03,437: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:00:03.437381604Z [2024-02-24 03:00:03,437: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:03.571115579Z [2024-02-24 03:00:03,570: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:03.692189503Z [2024-02-24 03:00:03,691: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:00:03.697901640Z [2024-02-24 03:00:03,693: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:00:03.697925778Z [2024-02-24 03:00:03,695: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:03.699169407Z [2024-02-24 03:00:03,698: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:03.723909592Z [2024-02-24 03:00:03,723: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:00:03.727407634Z [2024-02-24 03:00:03,724: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:00:03.729510292Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:03.729525411Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:03.729532028Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:03.729535928Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:00:03.729539087Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:00:03.729543987Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:03.729547297Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-2] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:03.729550519Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:03.729553645Z [2024-02-24 03:00:03,728: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:03.729556729Z [2024-02-24 03:00:03,729: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:00:03.729676515Z [2024-02-24 03:00:03,729: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:00:03.729976681Z [2024-02-24 03:00:03,729: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:03.825860008Z [2024-02-24 03:00:03,824: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:03.851412839Z [2024-02-24 03:00:03,851: INFO/ForkPoolWorker-2] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T02:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:04.478935586Z [2024-02-24 03:00:04,478: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4d838799-4d1e-4b3d-b0d0-8a8c3b1cd803] succeeded in 3.3399961380000605s: None
2024-02-24T03:00:05.008117584Z [2024-02-24 03:00:05,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0035d6ff-87a9-41e5-b391-3756db174745] received
2024-02-24T03:00:05.017332703Z [2024-02-24 03:00:05,016: INFO/ForkPoolWorker-15] [0035d6ff-87a9-41e5-b391-3756db174745] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:00:05.294534625Z [2024-02-24 03:00:05,291: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:00:05.584326491Z [2024-02-24 03:00:05,583: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[15d2ff8e-4aa6-485f-86e4-de31465763af] succeeded in 4.423645135000697s: None
2024-02-24T03:00:06.241840225Z [2024-02-24 03:00:06,241: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a9d73144-6009-4903-8923-bd7ee7d69fdd] succeeded in 5.0908173759999045s: None
2024-02-24T03:00:06.416990493Z [2024-02-24 03:00:06,416: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:00:06.420246296Z [2024-02-24 03:00:06,419: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:06.439773230Z [2024-02-24 03:00:06,439: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:00:06.441474995Z [2024-02-24 03:00:06,441: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:06.441652477Z [2024-02-24 03:00:06,441: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:06.441891729Z [2024-02-24 03:00:06,441: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:06.442059095Z [2024-02-24 03:00:06,441: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:00:06.442372216Z [2024-02-24 03:00:06,442: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:00:06.442520213Z [2024-02-24 03:00:06,442: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:06.539574981Z [2024-02-24 03:00:06,539: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:07.131484762Z [2024-02-24 03:00:07,130: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0035d6ff-87a9-41e5-b391-3756db174745] succeeded in 2.1212958069991146s: None
2024-02-24T03:00:07.409252889Z [2024-02-24 03:00:07,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b69ecde2-7d72-447c-a029-f5990c731262] received
2024-02-24T03:00:07.417659772Z [2024-02-24 03:00:07,417: INFO/ForkPoolWorker-15] [b69ecde2-7d72-447c-a029-f5990c731262] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:00:07.750947851Z [2024-02-24 03:00:07,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:00:08.878333620Z [2024-02-24 03:00:08,877: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:00:08.881550079Z [2024-02-24 03:00:08,881: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:08.903674095Z [2024-02-24 03:00:08,903: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:00:08.905162295Z [2024-02-24 03:00:08,904: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:08.905337873Z [2024-02-24 03:00:08,905: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:08.905662948Z [2024-02-24 03:00:08,905: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:08.905885624Z [2024-02-24 03:00:08,905: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:00:08.906261670Z [2024-02-24 03:00:08,906: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:00:08.906413112Z [2024-02-24 03:00:08,906: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:08.985301000Z [2024-02-24 03:00:08,985: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T02:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:09.598298708Z [2024-02-24 03:00:09,597: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b69ecde2-7d72-447c-a029-f5990c731262] succeeded in 2.1873209519999364s: None
2024-02-24T03:00:09.729070033Z [2024-02-24 03:00:09,728: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[38f1cf53-cfd1-46a7-9c3f-198ea9380098] received
2024-02-24T03:00:09.739558920Z [2024-02-24 03:00:09,738: INFO/ForkPoolWorker-15] [38f1cf53-cfd1-46a7-9c3f-198ea9380098] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T02:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:00:10.048156686Z [2024-02-24 03:00:10,045: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:00:11.153183378Z [2024-02-24 03:00:11,152: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:00:11.156590747Z [2024-02-24 03:00:11,156: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:00:11.177184007Z [2024-02-24 03:00:11,176: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:00:11.179679922Z [2024-02-24 03:00:11,179: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:00:11.179956488Z [2024-02-24 03:00:11,179: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:00:11.180243668Z [2024-02-24 03:00:11,179: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:00:11.180434705Z [2024-02-24 03:00:11,180: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:00:11.180808091Z [2024-02-24 03:00:11,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:00:11.180886108Z [2024-02-24 03:00:11,180: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:00:11.320648748Z [2024-02-24 03:00:11,320: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T02:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:00:11.910328828Z [2024-02-24 03:00:11,909: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[38f1cf53-cfd1-46a7-9c3f-198ea9380098] succeeded in 2.1790881179986172s: None
2024-02-24T03:01:00.230801271Z [2024-02-24 03:01:00,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec7d74a7-76ee-48b0-8863-877bba1de2f1] received
2024-02-24T03:01:00.234689265Z [2024-02-24 03:01:00,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f5a922f0-51e2-4f84-b922-83bb966ba6e1] received
2024-02-24T03:01:00.240363593Z [2024-02-24 03:01:00,239: INFO/ForkPoolWorker-15] [ec7d74a7-76ee-48b0-8863-877bba1de2f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:01:00.242709664Z [2024-02-24 03:01:00,242: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89447d3f-58c7-4d33-9493-dfcbbfdd7a3c] received
2024-02-24T03:01:00.248608751Z [2024-02-24 03:01:00,248: INFO/ForkPoolWorker-16] [f5a922f0-51e2-4f84-b922-83bb966ba6e1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:01:00.258112222Z [2024-02-24 03:01:00,257: INFO/ForkPoolWorker-1] [89447d3f-58c7-4d33-9493-dfcbbfdd7a3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:01:00.573150069Z [2024-02-24 03:01:00,569: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:01:00.575956779Z [2024-02-24 03:01:00,572: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:01:00.657556068Z [2024-02-24 03:01:00,654: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:01:00.944220593Z [2024-02-24 03:01:00,943: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:01:00.948137139Z [2024-02-24 03:01:00,947: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:01:00.984316875Z [2024-02-24 03:01:00,984: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:01:00.985571584Z [2024-02-24 03:01:00,985: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:01:00.985862445Z [2024-02-24 03:01:00,985: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:01:00.986051876Z [2024-02-24 03:01:00,985: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:01:00.986548502Z [2024-02-24 03:01:00,986: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:01:01.157896942Z [2024-02-24 03:01:01,152: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:01:02.019678394Z [2024-02-24 03:01:02,019: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec7d74a7-76ee-48b0-8863-877bba1de2f1] succeeded in 1.7868608420012606s: None
2024-02-24T03:01:02.024594554Z [2024-02-24 03:01:02,024: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:01:02.029106499Z [2024-02-24 03:01:02,028: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:01:02.048712079Z [2024-02-24 03:01:02,048: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:01:02.050244516Z [2024-02-24 03:01:02,050: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:01:02.050533614Z [2024-02-24 03:01:02,050: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:01:02.050819912Z [2024-02-24 03:01:02,050: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:01:02.051028379Z [2024-02-24 03:01:02,050: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:01:02.051430646Z [2024-02-24 03:01:02,051: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:01:02.051659124Z [2024-02-24 03:01:02,051: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:01:02.075176930Z [2024-02-24 03:01:02,074: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:01:02.078543197Z [2024-02-24 03:01:02,078: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:01:02.101405926Z [2024-02-24 03:01:02,101: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:01:02.103565910Z [2024-02-24 03:01:02,103: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:01:02.103590158Z [2024-02-24 03:01:02,103: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:01:02.103879925Z [2024-02-24 03:01:02,103: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:01:02.103957534Z [2024-02-24 03:01:02,103: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:01:02.104383897Z [2024-02-24 03:01:02,104: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:01:02.104436881Z [2024-02-24 03:01:02,104: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:01:02.144000881Z [2024-02-24 03:01:02,143: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:01:02.221009398Z [2024-02-24 03:01:02,220: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:01:03.820761450Z [2024-02-24 03:01:03,820: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f5a922f0-51e2-4f84-b922-83bb966ba6e1] succeeded in 3.5828876590003347s: None
2024-02-24T03:01:04.083877243Z [2024-02-24 03:01:04,082: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89447d3f-58c7-4d33-9493-dfcbbfdd7a3c] succeeded in 3.8381914970013895s: None
2024-02-24T03:02:01.132223306Z [2024-02-24 03:02:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e0100c8-326d-4faf-8edc-7eefcd517bdd] received
2024-02-24T03:02:01.139661171Z [2024-02-24 03:02:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a2f8976-db24-4b11-aa55-d044cf68c5fc] received
2024-02-24T03:02:01.149365269Z [2024-02-24 03:02:01,149: INFO/ForkPoolWorker-16] [5a2f8976-db24-4b11-aa55-d044cf68c5fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:02:01.154494009Z [2024-02-24 03:02:01,154: INFO/ForkPoolWorker-15] [8e0100c8-326d-4faf-8edc-7eefcd517bdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:02:01.160872254Z [2024-02-24 03:02:01,160: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17b12bf9-006b-44fe-b2fe-6de365a6a19d] received
2024-02-24T03:02:01.166058894Z [2024-02-24 03:02:01,165: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a4cf202-35be-4b94-a975-2f9153513a7b] received
2024-02-24T03:02:01.171799753Z [2024-02-24 03:02:01,171: INFO/ForkPoolWorker-1] [17b12bf9-006b-44fe-b2fe-6de365a6a19d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:02:01.214424059Z [2024-02-24 03:02:01,214: INFO/ForkPoolWorker-2] [5a4cf202-35be-4b94-a975-2f9153513a7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:02:01.684685730Z [2024-02-24 03:02:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:02:01.697005744Z [2024-02-24 03:02:01,690: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:02:01.738801325Z [2024-02-24 03:02:01,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:02:01.830801907Z [2024-02-24 03:02:01,824: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:02:02.081561249Z [2024-02-24 03:02:02,079: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:02:02.096037963Z [2024-02-24 03:02:02,095: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:02:02.147112659Z [2024-02-24 03:02:02,146: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:02:02.151177880Z [2024-02-24 03:02:02,150: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:02:02.154247220Z [2024-02-24 03:02:02,153: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:02:02.154537396Z [2024-02-24 03:02:02,154: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:02:02.154855211Z [2024-02-24 03:02:02,154: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:02:02.196325293Z [2024-02-24 03:02:02,196: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:02:02.276958091Z [2024-02-24 03:02:02,276: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:02:03.079409375Z [2024-02-24 03:02:03,078: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8e0100c8-326d-4faf-8edc-7eefcd517bdd] succeeded in 1.9438928790004866s: None
2024-02-24T03:02:03.163499699Z [2024-02-24 03:02:03,163: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5a4cf202-35be-4b94-a975-2f9153513a7b] succeeded in 1.9937044950002019s: None
2024-02-24T03:02:03.444050381Z [2024-02-24 03:02:03,443: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:02:03.447586028Z [2024-02-24 03:02:03,447: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:02:03.482276696Z [2024-02-24 03:02:03,482: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:02:03.483998196Z [2024-02-24 03:02:03,483: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:02:03.484196218Z [2024-02-24 03:02:03,484: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:02:03.484414651Z [2024-02-24 03:02:03,484: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:02:03.484552991Z [2024-02-24 03:02:03,484: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:02:03.485034318Z [2024-02-24 03:02:03,484: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:02:03.485231554Z [2024-02-24 03:02:03,485: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:02:03.622229066Z [2024-02-24 03:02:03,621: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:02:03.629510456Z [2024-02-24 03:02:03,629: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:02:03.634361639Z [2024-02-24 03:02:03,633: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:02:03.754510765Z [2024-02-24 03:02:03,754: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:02:03.762669610Z [2024-02-24 03:02:03,762: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:02:03.762717839Z [2024-02-24 03:02:03,762: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:02:03.762793619Z [2024-02-24 03:02:03,762: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:02:03.762819967Z [2024-02-24 03:02:03,762: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:02:03.763102045Z [2024-02-24 03:02:03,762: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:02:03.763119868Z [2024-02-24 03:02:03,763: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:02:03.929492536Z [2024-02-24 03:02:03,925: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:02:06.002193892Z [2024-02-24 03:02:06,001: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17b12bf9-006b-44fe-b2fe-6de365a6a19d] succeeded in 4.838483151999753s: None
2024-02-24T03:02:07.059570434Z [2024-02-24 03:02:07,058: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a2f8976-db24-4b11-aa55-d044cf68c5fc] succeeded in 5.917657920999773s: None
2024-02-24T03:03:00.852482968Z [2024-02-24 03:03:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad3aace4-57fb-493f-b343-49e18cd5ca29] received
2024-02-24T03:03:00.858522810Z [2024-02-24 03:03:00,858: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e7ea37e-4bad-4915-9b9e-f25e4c65a4fd] received
2024-02-24T03:03:00.859076181Z [2024-02-24 03:03:00,858: INFO/ForkPoolWorker-15] [ad3aace4-57fb-493f-b343-49e18cd5ca29] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:03:00.865150255Z [2024-02-24 03:03:00,864: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ab35738-d1eb-48cc-b357-a9a4c3a3408d] received
2024-02-24T03:03:00.867640928Z [2024-02-24 03:03:00,867: INFO/ForkPoolWorker-16] [6e7ea37e-4bad-4915-9b9e-f25e4c65a4fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:03:00.874330635Z [2024-02-24 03:03:00,874: INFO/ForkPoolWorker-1] [5ab35738-d1eb-48cc-b357-a9a4c3a3408d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:03:01.151310710Z [2024-02-24 03:03:01,147: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:03:01.187015582Z [2024-02-24 03:03:01,183: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:03:01.334301880Z [2024-02-24 03:03:01,333: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:03:01.338248589Z [2024-02-24 03:03:01,337: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:03:01.355503168Z [2024-02-24 03:03:01,352: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:03:01.361957430Z [2024-02-24 03:03:01,361: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:03:01.363145063Z [2024-02-24 03:03:01,362: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:03:01.363338851Z [2024-02-24 03:03:01,363: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:03:01.363405684Z [2024-02-24 03:03:01,363: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:03:01.363759092Z [2024-02-24 03:03:01,363: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:03:01.467780059Z [2024-02-24 03:03:01,467: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:03:02.124326244Z [2024-02-24 03:03:02,123: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ad3aace4-57fb-493f-b343-49e18cd5ca29] succeeded in 1.2701521609997144s: None
2024-02-24T03:03:02.461747439Z [2024-02-24 03:03:02,461: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:03:02.465040855Z [2024-02-24 03:03:02,464: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:03:02.493589668Z [2024-02-24 03:03:02,493: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:03:02.496275887Z [2024-02-24 03:03:02,495: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:03:02.496459357Z [2024-02-24 03:03:02,496: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:03:02.496739968Z [2024-02-24 03:03:02,496: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:03:02.496941026Z [2024-02-24 03:03:02,496: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:03:02.497317127Z [2024-02-24 03:03:02,497: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:03:02.497435782Z [2024-02-24 03:03:02,497: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:03:02.597993265Z [2024-02-24 03:03:02,597: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:03:02.634102247Z [2024-02-24 03:03:02,624: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:03:02.634142442Z [2024-02-24 03:03:02,630: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:03:02.701900362Z [2024-02-24 03:03:02,698: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:03:02.706554601Z [2024-02-24 03:03:02,703: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:03:02.706571938Z [2024-02-24 03:03:02,704: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:03:02.706576132Z [2024-02-24 03:03:02,704: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:03:02.706580520Z [2024-02-24 03:03:02,704: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:03:02.706583749Z [2024-02-24 03:03:02,704: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:03:02.706586877Z [2024-02-24 03:03:02,704: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:03:02.862021530Z [2024-02-24 03:03:02,861: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:03:04.701252855Z [2024-02-24 03:03:04,700: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6e7ea37e-4bad-4915-9b9e-f25e4c65a4fd] succeeded in 3.840365303998624s: None
2024-02-24T03:03:04.934173132Z [2024-02-24 03:03:04,933: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5ab35738-d1eb-48cc-b357-a9a4c3a3408d] succeeded in 4.06726559100025s: None
2024-02-24T03:04:00.829503703Z [2024-02-24 03:04:00,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e373529-4d79-48b6-af45-90055fffffc2] received
2024-02-24T03:04:00.838828628Z [2024-02-24 03:04:00,838: INFO/ForkPoolWorker-15] [1e373529-4d79-48b6-af45-90055fffffc2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:04:00.841241430Z [2024-02-24 03:04:00,840: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01b8cccf-6744-4ec9-900a-089d147056c4] received
2024-02-24T03:04:00.846465092Z [2024-02-24 03:04:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a97919a9-7160-41fe-ba2e-988effbed9d9] received
2024-02-24T03:04:00.849681087Z [2024-02-24 03:04:00,849: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c91fb7e3-8662-4600-a19a-9bf1c872241e] received
2024-02-24T03:04:00.855556305Z [2024-02-24 03:04:00,855: INFO/ForkPoolWorker-1] [a97919a9-7160-41fe-ba2e-988effbed9d9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:04:00.856250697Z [2024-02-24 03:04:00,856: INFO/ForkPoolWorker-16] [01b8cccf-6744-4ec9-900a-089d147056c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:04:00.859033667Z [2024-02-24 03:04:00,858: INFO/ForkPoolWorker-2] [c91fb7e3-8662-4600-a19a-9bf1c872241e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:04:01.232347462Z [2024-02-24 03:04:01,223: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:04:01.313577146Z [2024-02-24 03:04:01,310: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:04:01.378525028Z [2024-02-24 03:04:01,375: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:04:01.399683599Z [2024-02-24 03:04:01,399: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:04:01.403894474Z [2024-02-24 03:04:01,403: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:04:01.450054133Z [2024-02-24 03:04:01,449: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:04:01.454235325Z [2024-02-24 03:04:01,453: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:04:01.454459501Z [2024-02-24 03:04:01,454: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:04:01.454613693Z [2024-02-24 03:04:01,454: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:04:01.454991257Z [2024-02-24 03:04:01,454: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:04:01.522721922Z [2024-02-24 03:04:01,518: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:04:01.594141835Z [2024-02-24 03:04:01,593: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:04:02.057043912Z [2024-02-24 03:04:02,056: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:04:02.244589081Z [2024-02-24 03:04:02,244: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[01b8cccf-6744-4ec9-900a-089d147056c4] succeeded in 1.40146354999888s: None
2024-02-24T03:04:02.860467020Z [2024-02-24 03:04:02,860: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:04:02.863648282Z [2024-02-24 03:04:02,863: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:04:02.894446366Z [2024-02-24 03:04:02,894: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a97919a9-7160-41fe-ba2e-988effbed9d9] succeeded in 2.0463042249994032s: None
2024-02-24T03:04:02.908588965Z [2024-02-24 03:04:02,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:04:02.910111475Z [2024-02-24 03:04:02,909: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:04:02.910293668Z [2024-02-24 03:04:02,910: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:04:02.910400341Z [2024-02-24 03:04:02,910: INFO/ForkPoolWorker-15] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:04:02.910605690Z [2024-02-24 03:04:02,910: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:04:02.910658386Z [2024-02-24 03:04:02,910: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:04:02.910975110Z [2024-02-24 03:04:02,910: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:04:02.911485720Z [2024-02-24 03:04:02,911: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:04:02.917972213Z [2024-02-24 03:04:02,916: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:04:02.946037712Z [2024-02-24 03:04:02,945: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:04:02.951465621Z [2024-02-24 03:04:02,950: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:04:02.971441731Z [2024-02-24 03:04:02,971: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:04:02.972867584Z [2024-02-24 03:04:02,972: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:04:02.972941966Z [2024-02-24 03:04:02,972: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:04:02.973036469Z [2024-02-24 03:04:02,972: INFO/ForkPoolWorker-2] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:04:02.973220311Z [2024-02-24 03:04:02,973: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:04:02.973284836Z [2024-02-24 03:04:02,973: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:04:02.973626479Z [2024-02-24 03:04:02,973: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:04:02.973727590Z [2024-02-24 03:04:02,973: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:04:02.982728598Z [2024-02-24 03:04:02,982: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:04:03.009404383Z [2024-02-24 03:04:03,009: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:04:03.062952329Z [2024-02-24 03:04:03,062: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:04:05.770891114Z [2024-02-24 03:04:05,770: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e373529-4d79-48b6-af45-90055fffffc2] succeeded in 4.938124448999588s: None
2024-02-24T03:04:06.210373654Z [2024-02-24 03:04:06,209: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c91fb7e3-8662-4600-a19a-9bf1c872241e] succeeded in 5.358299593999618s: None
2024-02-24T03:04:38.828222933Z [2024-02-24 03:04:38,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5052ad15-cda0-4fb3-9cad-080c5cd01ef2] received
2024-02-24T03:04:38.841742292Z [2024-02-24 03:04:38,841: INFO/ForkPoolWorker-15] [5052ad15-cda0-4fb3-9cad-080c5cd01ef2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224030437_611949', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T03:04:39.159997989Z [2024-02-24 03:04:39,156: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T03:04:39.481294029Z [2024-02-24 03:04:39,480: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224030437_611949 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:04:40.195021631Z [2024-02-24 03:04:40,193: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5052ad15-cda0-4fb3-9cad-080c5cd01ef2] succeeded in 1.363561940001091s: None
2024-02-24T03:05:00.544215886Z [2024-02-24 03:05:00,543: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[658ee2c2-108f-4ff1-86d1-03956f985f4b] received
2024-02-24T03:05:00.546707088Z [2024-02-24 03:05:00,546: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a1c691c2-270c-4a73-909c-715fa1466513] received
2024-02-24T03:05:00.557730542Z [2024-02-24 03:05:00,557: INFO/ForkPoolWorker-16] [a1c691c2-270c-4a73-909c-715fa1466513] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:05:00.559808204Z [2024-02-24 03:05:00,559: INFO/ForkPoolWorker-15] [658ee2c2-108f-4ff1-86d1-03956f985f4b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:05:00.560599558Z [2024-02-24 03:05:00,560: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d0748c9e-b3c0-4e3f-8759-b5aa245cdb64] received
2024-02-24T03:05:00.563397653Z [2024-02-24 03:05:00,563: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8ed50b98-f1db-42e9-8008-b8dcdcde9455] received
2024-02-24T03:05:00.586359983Z [2024-02-24 03:05:00,585: INFO/ForkPoolWorker-1] [d0748c9e-b3c0-4e3f-8759-b5aa245cdb64] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:05:00.588369325Z [2024-02-24 03:05:00,588: INFO/ForkPoolWorker-2] [8ed50b98-f1db-42e9-8008-b8dcdcde9455] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:05:00.887468055Z [2024-02-24 03:05:00,883: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:05:00.904223821Z [2024-02-24 03:05:00,900: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:05:00.916575372Z [2024-02-24 03:05:00,912: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:05:00.921007984Z [2024-02-24 03:05:00,917: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:05:01.060900885Z [2024-02-24 03:05:01,060: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:05:01.065041732Z [2024-02-24 03:05:01,064: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:01.102919081Z [2024-02-24 03:05:01,102: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:05:01.104560367Z [2024-02-24 03:05:01,104: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:05:01.104789405Z [2024-02-24 03:05:01,104: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:05:01.104937748Z [2024-02-24 03:05:01,104: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:05:01.105231342Z [2024-02-24 03:05:01,105: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:05:01.296307603Z [2024-02-24 03:05:01,288: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:01.844004446Z [2024-02-24 03:05:01,843: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8ed50b98-f1db-42e9-8008-b8dcdcde9455] succeeded in 1.2725611630012281s: None
2024-02-24T03:05:02.317260201Z [2024-02-24 03:05:02,316: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:05:02.320988708Z [2024-02-24 03:05:02,320: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:02.341260670Z [2024-02-24 03:05:02,340: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:05:02.345404864Z [2024-02-24 03:05:02,344: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:02.360875906Z [2024-02-24 03:05:02,360: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:05:02.374069516Z [2024-02-24 03:05:02,373: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:02.374086354Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:02.374136780Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:02.374277683Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:02.374290387Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:05:02.374835860Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:05:02.374907105Z [2024-02-24 03:05:02,374: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:02.382374626Z [2024-02-24 03:05:02,379: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:05:02.383184800Z [2024-02-24 03:05:02,382: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:05:02.388644696Z [2024-02-24 03:05:02,388: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:02.394118622Z [2024-02-24 03:05:02,393: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:05:02.395384649Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:02.395526350Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:02.395599499Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:02.395749965Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:02.395824379Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:05:02.396286311Z [2024-02-24 03:05:02,395: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:05:02.396292197Z [2024-02-24 03:05:02,396: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:02.405919894Z [2024-02-24 03:05:02,405: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:05:02.438675203Z [2024-02-24 03:05:02,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:05:02.439948279Z [2024-02-24 03:05:02,439: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:02.440181124Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:02.440298932Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:02.440466801Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:02.440518267Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:05:02.440840923Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:02.440957967Z [2024-02-24 03:05:02,440: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:02.447718942Z [2024-02-24 03:05:02,447: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:02.492532315Z [2024-02-24 03:05:02,492: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:02.524907260Z [2024-02-24 03:05:02,524: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:02.577652574Z [2024-02-24 03:05:02,577: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:03.406761175Z [2024-02-24 03:05:03,406: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[658ee2c2-108f-4ff1-86d1-03956f985f4b] succeeded in 2.8552076530013437s: None
2024-02-24T03:05:04.289418118Z [2024-02-24 03:05:04,288: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d0748c9e-b3c0-4e3f-8759-b5aa245cdb64] succeeded in 3.7240749310003594s: None
2024-02-24T03:05:04.342974270Z [2024-02-24 03:05:04,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9240f0a-d175-4a77-a575-8ddd7796410b] received
2024-02-24T03:05:04.357364805Z [2024-02-24 03:05:04,356: INFO/ForkPoolWorker-15] [d9240f0a-d175-4a77-a575-8ddd7796410b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:05:04.691098036Z [2024-02-24 03:05:04,687: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:05:04.884046571Z [2024-02-24 03:05:04,883: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a1c691c2-270c-4a73-909c-715fa1466513] succeeded in 4.33604205300071s: None
2024-02-24T03:05:05.825700888Z [2024-02-24 03:05:05,825: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:05:05.830059826Z [2024-02-24 03:05:05,829: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:05.848092301Z [2024-02-24 03:05:05,847: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:05:05.849481250Z [2024-02-24 03:05:05,849: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:05.849574216Z [2024-02-24 03:05:05,849: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:05.849654029Z [2024-02-24 03:05:05,849: INFO/ForkPoolWorker-15] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:05.849867735Z [2024-02-24 03:05:05,849: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:05.849903334Z [2024-02-24 03:05:05,849: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:05:05.850201397Z [2024-02-24 03:05:05,850: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:05.850274429Z [2024-02-24 03:05:05,850: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:05.857203460Z [2024-02-24 03:05:05,856: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:05.925699309Z [2024-02-24 03:05:05,925: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:06.580446377Z [2024-02-24 03:05:06,579: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9240f0a-d175-4a77-a575-8ddd7796410b] succeeded in 2.2332741009995516s: None
2024-02-24T03:05:06.926200694Z [2024-02-24 03:05:06,925: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e878a15b-0bdd-4be4-b6bc-715ae190e856] received
2024-02-24T03:05:06.944915794Z [2024-02-24 03:05:06,944: INFO/ForkPoolWorker-15] [e878a15b-0bdd-4be4-b6bc-715ae190e856] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:05:07.248123562Z [2024-02-24 03:05:07,244: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:05:08.329093017Z [2024-02-24 03:05:08,328: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:05:08.332065174Z [2024-02-24 03:05:08,331: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:08.359033475Z [2024-02-24 03:05:08,358: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:05:08.360286694Z [2024-02-24 03:05:08,359: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:08.360325299Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:08.360403779Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:08.360465497Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:08.360505736Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:05:08.360718314Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:08.360750537Z [2024-02-24 03:05:08,360: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:08.367377407Z [2024-02-24 03:05:08,367: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:08.455178202Z [2024-02-24 03:05:08,454: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:09.046705379Z [2024-02-24 03:05:09,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e878a15b-0bdd-4be4-b6bc-715ae190e856] succeeded in 2.115278060999117s: None
2024-02-24T03:05:09.291404275Z [2024-02-24 03:05:09,291: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f005e27-0500-44f7-a971-ea4dcc162374] received
2024-02-24T03:05:09.303421512Z [2024-02-24 03:05:09,302: INFO/ForkPoolWorker-15] [6f005e27-0500-44f7-a971-ea4dcc162374] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:05:09.625426389Z [2024-02-24 03:05:09,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:05:10.749928992Z [2024-02-24 03:05:10,749: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:05:10.752973418Z [2024-02-24 03:05:10,752: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:05:10.774309974Z [2024-02-24 03:05:10,774: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:05:10.775761278Z [2024-02-24 03:05:10,775: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:05:10.775778324Z [2024-02-24 03:05:10,775: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:05:10.775786428Z [2024-02-24 03:05:10,775: INFO/ForkPoolWorker-15] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:05:10.775923917Z [2024-02-24 03:05:10,775: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:05:10.775943418Z [2024-02-24 03:05:10,775: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:05:10.776304072Z [2024-02-24 03:05:10,776: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:10.776408430Z [2024-02-24 03:05:10,776: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:05:10.782320693Z [2024-02-24 03:05:10,782: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:05:10.876014465Z [2024-02-24 03:05:10,875: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:05:11.476361050Z [2024-02-24 03:05:11,475: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6f005e27-0500-44f7-a971-ea4dcc162374] succeeded in 2.183050153000295s: None
2024-02-24T03:06:00.426633111Z [2024-02-24 03:06:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a0fd9d65-92a2-428e-b254-545c93a789b8] received
2024-02-24T03:06:00.430020979Z [2024-02-24 03:06:00,429: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc07fd05-8168-4c94-8770-075803bb0bfc] received
2024-02-24T03:06:00.435033599Z [2024-02-24 03:06:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b997629-80d9-404c-88e5-cb60f99f3405] received
2024-02-24T03:06:00.437858489Z [2024-02-24 03:06:00,437: INFO/ForkPoolWorker-15] [a0fd9d65-92a2-428e-b254-545c93a789b8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:06:00.459956616Z [2024-02-24 03:06:00,459: INFO/ForkPoolWorker-16] [dc07fd05-8168-4c94-8770-075803bb0bfc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:06:00.463444184Z [2024-02-24 03:06:00,463: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea09c0cc-8ad7-42c4-9d17-480eba48be51] received
2024-02-24T03:06:00.469598127Z [2024-02-24 03:06:00,469: INFO/ForkPoolWorker-2] [ea09c0cc-8ad7-42c4-9d17-480eba48be51] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:06:00.472267169Z [2024-02-24 03:06:00,471: INFO/ForkPoolWorker-1] [9b997629-80d9-404c-88e5-cb60f99f3405] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:06:00.786179966Z [2024-02-24 03:06:00,781: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:06:00.804229166Z [2024-02-24 03:06:00,801: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:06:00.834675603Z [2024-02-24 03:06:00,828: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:06:00.843976651Z [2024-02-24 03:06:00,840: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:06:00.984583797Z [2024-02-24 03:06:00,984: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:06:00.989891617Z [2024-02-24 03:06:00,989: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:06:01.039128096Z [2024-02-24 03:06:01,038: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:06:01.040037352Z [2024-02-24 03:06:01,039: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:06:01.040094116Z [2024-02-24 03:06:01,039: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:06:01.040164952Z [2024-02-24 03:06:01,040: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:06:01.040310955Z [2024-02-24 03:06:01,040: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:06:01.107122593Z [2024-02-24 03:06:01,106: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:06:01.191810805Z [2024-02-24 03:06:01,191: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:06:01.791915904Z [2024-02-24 03:06:01,790: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a0fd9d65-92a2-428e-b254-545c93a789b8] succeeded in 1.3626635369982978s: None
2024-02-24T03:06:01.874201842Z [2024-02-24 03:06:01,873: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ea09c0cc-8ad7-42c4-9d17-480eba48be51] succeeded in 1.409216149000713s: None
2024-02-24T03:06:02.151642772Z [2024-02-24 03:06:02,151: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:06:02.154978585Z [2024-02-24 03:06:02,154: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:06:02.176735529Z [2024-02-24 03:06:02,176: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:06:02.178239169Z [2024-02-24 03:06:02,177: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:06:02.178338380Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:06:02.178414627Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:06:02.178609673Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:06:02.178688897Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:06:02.178969224Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:06:02.179320994Z [2024-02-24 03:06:02,178: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:06:02.183671744Z [2024-02-24 03:06:02,183: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:06:02.189104510Z [2024-02-24 03:06:02,188: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:06:02.192523658Z [2024-02-24 03:06:02,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:06:02.215158178Z [2024-02-24 03:06:02,214: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:06:02.216842677Z [2024-02-24 03:06:02,216: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:06:02.216994522Z [2024-02-24 03:06:02,216: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:06:02.217135461Z [2024-02-24 03:06:02,216: INFO/ForkPoolWorker-16] Read VIM 5ca147f7-ac28-4360-8739-dcd34d81807a (k8s07_dummy)
2024-02-24T03:06:02.217377804Z [2024-02-24 03:06:02,217: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}, {'_id': '5ca147f7-ac28-4360-8739-dcd34d81807a', 'name': 'k8s07_dummy', 'vim_type': 'dummy'}]
2024-02-24T03:06:02.217528079Z [2024-02-24 03:06:02,217: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:06:02.218089335Z [2024-02-24 03:06:02,217: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:06:02.218239239Z [2024-02-24 03:06:02,218: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:06:02.223482478Z [2024-02-24 03:06:02,223: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:06:02.306519824Z [2024-02-24 03:06:02,305: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:06:02.313652043Z [2024-02-24 03:06:02,313: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:06:03.954769633Z [2024-02-24 03:06:03,954: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b997629-80d9-404c-88e5-cb60f99f3405] succeeded in 3.517694476999168s: None
2024-02-24T03:06:04.454413818Z [2024-02-24 03:06:04,453: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dc07fd05-8168-4c94-8770-075803bb0bfc] succeeded in 4.019294907000585s: None
2024-02-24T03:06:38.574609176Z [2024-02-24 03:06:38,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[951263ac-f075-4d5d-a367-aad8a4346ba2] received
2024-02-24T03:06:38.595526126Z [2024-02-24 03:06:38,595: INFO/ForkPoolWorker-15] [951263ac-f075-4d5d-a367-aad8a4346ba2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224030637_634119', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T03:06:38.851402775Z [2024-02-24 03:06:38,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T03:06:39.146783771Z [2024-02-24 03:06:39,146: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224030637_634119 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:06:39.844910620Z [2024-02-24 03:06:39,844: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[951263ac-f075-4d5d-a367-aad8a4346ba2] succeeded in 1.265677269999287s: None
2024-02-24T03:07:01.359040315Z [2024-02-24 03:07:01,358: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e52921bd-03dc-409b-9670-06d0c218e331] received
2024-02-24T03:07:01.364034832Z [2024-02-24 03:07:01,363: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a600979-33ef-42f1-8b3b-67e2a947cacf] received
2024-02-24T03:07:01.365811404Z [2024-02-24 03:07:01,365: INFO/ForkPoolWorker-15] [e52921bd-03dc-409b-9670-06d0c218e331] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:07:01.369309333Z [2024-02-24 03:07:01,366: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7b053ac-4a60-4159-b35b-b87839817b8d] received
2024-02-24T03:07:01.378446101Z [2024-02-24 03:07:01,378: INFO/ForkPoolWorker-16] [5a600979-33ef-42f1-8b3b-67e2a947cacf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:07:01.390969379Z [2024-02-24 03:07:01,390: INFO/ForkPoolWorker-1] [f7b053ac-4a60-4159-b35b-b87839817b8d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:07:01.732384317Z [2024-02-24 03:07:01,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:07:01.734811250Z [2024-02-24 03:07:01,731: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:07:01.818105760Z [2024-02-24 03:07:01,814: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:07:01.937876475Z [2024-02-24 03:07:01,937: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:07:01.942230302Z [2024-02-24 03:07:01,941: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:07:01.961663526Z [2024-02-24 03:07:01,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:07:01.962813021Z [2024-02-24 03:07:01,962: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:07:01.962978663Z [2024-02-24 03:07:01,962: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:07:01.963097668Z [2024-02-24 03:07:01,962: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:07:01.963443913Z [2024-02-24 03:07:01,963: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:07:02.086188123Z [2024-02-24 03:07:02,085: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:07:02.805916350Z [2024-02-24 03:07:02,802: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e52921bd-03dc-409b-9670-06d0c218e331] succeeded in 1.4424670959997457s: None
2024-02-24T03:07:03.076082918Z [2024-02-24 03:07:03,075: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:07:03.079273303Z [2024-02-24 03:07:03,078: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:07:03.103221818Z [2024-02-24 03:07:03,103: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:07:03.104412328Z [2024-02-24 03:07:03,104: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:07:03.104559332Z [2024-02-24 03:07:03,104: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:07:03.104769535Z [2024-02-24 03:07:03,104: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:07:03.104875252Z [2024-02-24 03:07:03,104: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:07:03.105238914Z [2024-02-24 03:07:03,105: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:07:03.105377154Z [2024-02-24 03:07:03,105: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:07:03.133100400Z [2024-02-24 03:07:03,132: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:07:03.138761096Z [2024-02-24 03:07:03,138: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:07:03.168179824Z [2024-02-24 03:07:03,167: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:07:03.169379067Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:07:03.169450288Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:07:03.169682189Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:07:03.169687019Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:07:03.170005762Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:07:03.170048354Z [2024-02-24 03:07:03,169: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:07:03.195705511Z [2024-02-24 03:07:03,195: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:07:03.241979797Z [2024-02-24 03:07:03,241: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:07:05.813609195Z [2024-02-24 03:07:05,813: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f7b053ac-4a60-4159-b35b-b87839817b8d] succeeded in 4.444962698000381s: None
2024-02-24T03:07:06.552851842Z [2024-02-24 03:07:06,552: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a600979-33ef-42f1-8b3b-67e2a947cacf] succeeded in 5.184562201999142s: None
2024-02-24T03:08:01.112000461Z [2024-02-24 03:08:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ce8d819-bc83-4467-a458-89eb136d1880] received
2024-02-24T03:08:01.122490388Z [2024-02-24 03:08:01,122: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[df2a1450-fe2c-41e9-b8ff-f9f5a0c91b45] received
2024-02-24T03:08:01.129617486Z [2024-02-24 03:08:01,129: INFO/ForkPoolWorker-15] [9ce8d819-bc83-4467-a458-89eb136d1880] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:08:01.130405590Z [2024-02-24 03:08:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b89c79b8-ae54-4bbf-8594-39ea31de25e4] received
2024-02-24T03:08:01.132079697Z [2024-02-24 03:08:01,131: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb5b0554-7973-407f-b363-9820dbf17880] received
2024-02-24T03:08:01.133678100Z [2024-02-24 03:08:01,133: INFO/ForkPoolWorker-16] [df2a1450-fe2c-41e9-b8ff-f9f5a0c91b45] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:08:01.140845053Z [2024-02-24 03:08:01,140: INFO/ForkPoolWorker-1] [b89c79b8-ae54-4bbf-8594-39ea31de25e4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:08:01.166624207Z [2024-02-24 03:08:01,166: INFO/ForkPoolWorker-2] [cb5b0554-7973-407f-b363-9820dbf17880] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:08:01.517642580Z [2024-02-24 03:08:01,514: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:08:01.536483885Z [2024-02-24 03:08:01,530: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:08:01.598808480Z [2024-02-24 03:08:01,594: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:08:01.765369451Z [2024-02-24 03:08:01,764: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:08:01.769410426Z [2024-02-24 03:08:01,768: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:08:01.805050875Z [2024-02-24 03:08:01,804: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:08:01.808870814Z [2024-02-24 03:08:01,808: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:08:01.810699379Z [2024-02-24 03:08:01,810: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:08:01.810775986Z [2024-02-24 03:08:01,810: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:08:01.810850630Z [2024-02-24 03:08:01,810: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:08:01.811107550Z [2024-02-24 03:08:01,810: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:08:01.858676507Z [2024-02-24 03:08:01,854: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:08:02.005362547Z [2024-02-24 03:08:02,005: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:08:02.711854834Z [2024-02-24 03:08:02,709: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9ce8d819-bc83-4467-a458-89eb136d1880] succeeded in 1.5894331300005433s: None
2024-02-24T03:08:02.746740544Z [2024-02-24 03:08:02,746: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cb5b0554-7973-407f-b363-9820dbf17880] succeeded in 1.6114408680005s: None
2024-02-24T03:08:03.090678052Z [2024-02-24 03:08:03,090: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:08:03.094060857Z [2024-02-24 03:08:03,093: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:08:03.117517446Z [2024-02-24 03:08:03,117: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:08:03.119270531Z [2024-02-24 03:08:03,119: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:08:03.119499728Z [2024-02-24 03:08:03,119: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:08:03.119825246Z [2024-02-24 03:08:03,119: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:08:03.120056580Z [2024-02-24 03:08:03,119: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:08:03.120756387Z [2024-02-24 03:08:03,120: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:08:03.120976929Z [2024-02-24 03:08:03,120: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:08:03.206817971Z [2024-02-24 03:08:03,206: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:08:03.361280392Z [2024-02-24 03:08:03,360: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:08:03.364698317Z [2024-02-24 03:08:03,364: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:08:03.385871614Z [2024-02-24 03:08:03,385: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:08:03.387431938Z [2024-02-24 03:08:03,387: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:08:03.387556474Z [2024-02-24 03:08:03,387: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:08:03.387787181Z [2024-02-24 03:08:03,387: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:08:03.387909114Z [2024-02-24 03:08:03,387: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:08:03.388219061Z [2024-02-24 03:08:03,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:08:03.388361288Z [2024-02-24 03:08:03,388: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:08:03.480909621Z [2024-02-24 03:08:03,480: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:08:05.165217072Z [2024-02-24 03:08:05,164: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[df2a1450-fe2c-41e9-b8ff-f9f5a0c91b45] succeeded in 4.038366844999473s: None
2024-02-24T03:08:05.359157776Z [2024-02-24 03:08:05,358: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b89c79b8-ae54-4bbf-8594-39ea31de25e4] succeeded in 4.2265304180000385s: None
2024-02-24T03:09:01.084477545Z [2024-02-24 03:09:01,084: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d936223b-4ad5-470b-8a7f-c8f6eba7a981] received
2024-02-24T03:09:01.090387503Z [2024-02-24 03:09:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8a42b1b1-d198-4881-8edb-7dfeccb794c3] received
2024-02-24T03:09:01.092388173Z [2024-02-24 03:09:01,092: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cee0bf9a-2170-4efc-a707-27d5e121c5ac] received
2024-02-24T03:09:01.107431313Z [2024-02-24 03:09:01,107: INFO/ForkPoolWorker-16] [8a42b1b1-d198-4881-8edb-7dfeccb794c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:09:01.110331385Z [2024-02-24 03:09:01,109: INFO/ForkPoolWorker-1] [cee0bf9a-2170-4efc-a707-27d5e121c5ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:09:01.114329954Z [2024-02-24 03:09:01,114: INFO/ForkPoolWorker-15] [d936223b-4ad5-470b-8a7f-c8f6eba7a981] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:09:01.436430367Z [2024-02-24 03:09:01,433: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:09:01.458942979Z [2024-02-24 03:09:01,455: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:09:01.468106714Z [2024-02-24 03:09:01,464: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:09:01.626822856Z [2024-02-24 03:09:01,626: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:09:01.630658806Z [2024-02-24 03:09:01,630: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:09:01.649624193Z [2024-02-24 03:09:01,649: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:09:01.650720176Z [2024-02-24 03:09:01,650: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:09:01.651241969Z [2024-02-24 03:09:01,650: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:09:01.651373050Z [2024-02-24 03:09:01,651: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:09:01.651639367Z [2024-02-24 03:09:01,651: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:09:01.737755550Z [2024-02-24 03:09:01,737: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:09:02.368222271Z [2024-02-24 03:09:02,367: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d936223b-4ad5-470b-8a7f-c8f6eba7a981] succeeded in 1.2807745359987166s: None
2024-02-24T03:09:02.681820079Z [2024-02-24 03:09:02,681: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:09:02.685841126Z [2024-02-24 03:09:02,685: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:09:02.733622293Z [2024-02-24 03:09:02,733: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:09:02.755084319Z [2024-02-24 03:09:02,754: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:09:02.757259627Z [2024-02-24 03:09:02,756: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:09:02.759126838Z [2024-02-24 03:09:02,758: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:09:02.759346975Z [2024-02-24 03:09:02,759: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:09:02.759688056Z [2024-02-24 03:09:02,759: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:09:02.759972360Z [2024-02-24 03:09:02,759: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:09:02.760655850Z [2024-02-24 03:09:02,760: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:09:02.760892994Z [2024-02-24 03:09:02,760: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:09:02.822830477Z [2024-02-24 03:09:02,822: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:09:02.825065506Z [2024-02-24 03:09:02,824: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:09:02.825686447Z [2024-02-24 03:09:02,824: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:09:02.826026792Z [2024-02-24 03:09:02,825: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:09:02.826382267Z [2024-02-24 03:09:02,826: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:09:02.827053297Z [2024-02-24 03:09:02,826: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:09:02.827222510Z [2024-02-24 03:09:02,827: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:09:02.865443535Z [2024-02-24 03:09:02,865: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:09:02.935896648Z [2024-02-24 03:09:02,935: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:09:04.706641016Z [2024-02-24 03:09:04,706: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8a42b1b1-d198-4881-8edb-7dfeccb794c3] succeeded in 3.611727683000936s: None
2024-02-24T03:09:05.536827828Z [2024-02-24 03:09:05,535: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cee0bf9a-2170-4efc-a707-27d5e121c5ac] succeeded in 4.437511034000636s: None
2024-02-24T03:10:01.108705896Z [2024-02-24 03:10:01,108: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19fcb199-92fa-4a06-8ef9-48a983a9ae5e] received
2024-02-24T03:10:01.110455416Z [2024-02-24 03:10:01,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6b48d1d8-887a-45f7-a9e2-c02b04ec2963] received
2024-02-24T03:10:01.120921536Z [2024-02-24 03:10:01,120: INFO/ForkPoolWorker-15] [19fcb199-92fa-4a06-8ef9-48a983a9ae5e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:10:01.125251669Z [2024-02-24 03:10:01,125: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9bc9d3d-6fbb-494c-a897-df51470c134f] received
2024-02-24T03:10:01.131049091Z [2024-02-24 03:10:01,130: INFO/ForkPoolWorker-1] [d9bc9d3d-6fbb-494c-a897-df51470c134f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:10:01.132873836Z [2024-02-24 03:10:01,132: INFO/ForkPoolWorker-16] [6b48d1d8-887a-45f7-a9e2-c02b04ec2963] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:10:01.138857636Z [2024-02-24 03:10:01,138: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6ecb7e1-917d-4810-9c87-512426e7eeae] received
2024-02-24T03:10:01.151798196Z [2024-02-24 03:10:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2ca393aa-6995-485f-9e38-36a051c19957] received
2024-02-24T03:10:01.152632615Z [2024-02-24 03:10:01,152: INFO/ForkPoolWorker-2] [c6ecb7e1-917d-4810-9c87-512426e7eeae] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:10:01.169902196Z [2024-02-24 03:10:01,169: INFO/ForkPoolWorker-3] [2ca393aa-6995-485f-9e38-36a051c19957] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:10:01.721619690Z [2024-02-24 03:10:01,717: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:10:01.728766032Z [2024-02-24 03:10:01,725: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:10:01.742537919Z [2024-02-24 03:10:01,738: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:10:01.902044261Z [2024-02-24 03:10:01,894: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:10:02.089174165Z [2024-02-24 03:10:02,088: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:10:02.093448032Z [2024-02-24 03:10:02,093: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:02.163985347Z [2024-02-24 03:10:02,163: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:10:02.166563293Z [2024-02-24 03:10:02,166: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:10:02.166579791Z [2024-02-24 03:10:02,166: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:10:02.166651112Z [2024-02-24 03:10:02,166: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:10:02.167219263Z [2024-02-24 03:10:02,167: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:10:02.296199205Z [2024-02-24 03:10:02,295: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:02.337462293Z [2024-02-24 03:10:02,324: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:10:02.414122207Z [2024-02-24 03:10:02,410: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:03.304938746Z [2024-02-24 03:10:03,304: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d9bc9d3d-6fbb-494c-a897-df51470c134f] succeeded in 2.17808022600002s: None
2024-02-24T03:10:03.345232116Z [2024-02-24 03:10:03,344: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:10:03.348582945Z [2024-02-24 03:10:03,348: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:03.371270616Z [2024-02-24 03:10:03,370: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6b48d1d8-887a-45f7-a9e2-c02b04ec2963] succeeded in 2.2525682560008136s: None
2024-02-24T03:10:03.380423230Z [2024-02-24 03:10:03,380: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:10:03.381722113Z [2024-02-24 03:10:03,381: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:03.381991340Z [2024-02-24 03:10:03,381: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:03.382139418Z [2024-02-24 03:10:03,381: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:03.382210427Z [2024-02-24 03:10:03,382: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:10:03.382530921Z [2024-02-24 03:10:03,382: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:10:03.382637045Z [2024-02-24 03:10:03,382: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:03.466965979Z [2024-02-24 03:10:03,466: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:03.731479319Z [2024-02-24 03:10:03,731: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:10:03.735516294Z [2024-02-24 03:10:03,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:03.764340848Z [2024-02-24 03:10:03,764: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:10:03.767487337Z [2024-02-24 03:10:03,766: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:03.767533122Z [2024-02-24 03:10:03,766: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:03.767543429Z [2024-02-24 03:10:03,766: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:03.767548982Z [2024-02-24 03:10:03,766: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:10:03.767572010Z [2024-02-24 03:10:03,767: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:10:03.767577005Z [2024-02-24 03:10:03,767: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:03.889892443Z [2024-02-24 03:10:03,887: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:04.145316734Z [2024-02-24 03:10:04,144: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[19fcb199-92fa-4a06-8ef9-48a983a9ae5e] succeeded in 3.0327038330015057s: None
2024-02-24T03:10:04.196717382Z [2024-02-24 03:10:04,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c681b51-db4a-42e1-910b-02d081ff720e] received
2024-02-24T03:10:04.208165910Z [2024-02-24 03:10:04,207: INFO/ForkPoolWorker-15] [9c681b51-db4a-42e1-910b-02d081ff720e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:10:04.417543131Z [2024-02-24 03:10:04,417: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T03:10:04.420700634Z [2024-02-24 03:10:04,420: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:04.441956142Z [2024-02-24 03:10:04,441: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T03:10:04.443183315Z [2024-02-24 03:10:04,442: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:04.443200688Z [2024-02-24 03:10:04,443: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:04.443330962Z [2024-02-24 03:10:04,443: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:04.443341238Z [2024-02-24 03:10:04,443: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T03:10:04.443591710Z [2024-02-24 03:10:04,443: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:10:04.443603279Z [2024-02-24 03:10:04,443: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:04.522239917Z [2024-02-24 03:10:04,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:10:04.544537402Z [2024-02-24 03:10:04,544: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:05.666816613Z [2024-02-24 03:10:05,666: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:10:05.670039133Z [2024-02-24 03:10:05,669: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:05.690984914Z [2024-02-24 03:10:05,690: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:10:05.692560120Z [2024-02-24 03:10:05,692: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:05.692865857Z [2024-02-24 03:10:05,692: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:05.693213634Z [2024-02-24 03:10:05,692: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:05.693431451Z [2024-02-24 03:10:05,693: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:10:05.694063754Z [2024-02-24 03:10:05,693: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:10:05.694294124Z [2024-02-24 03:10:05,694: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:05.811617143Z [2024-02-24 03:10:05,811: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:05.952601885Z [2024-02-24 03:10:05,952: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c6ecb7e1-917d-4810-9c87-512426e7eeae] succeeded in 4.81181413000013s: None
2024-02-24T03:10:06.341766578Z [2024-02-24 03:10:06,341: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[2ca393aa-6995-485f-9e38-36a051c19957] succeeded in 5.182964505998825s: None
2024-02-24T03:10:06.520749579Z [2024-02-24 03:10:06,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c681b51-db4a-42e1-910b-02d081ff720e] succeeded in 2.3175760449994414s: None
2024-02-24T03:10:07.497523341Z [2024-02-24 03:10:07,496: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c55eed07-6eae-4dc3-91f3-b165240eff75] received
2024-02-24T03:10:07.512792130Z [2024-02-24 03:10:07,512: INFO/ForkPoolWorker-15] [c55eed07-6eae-4dc3-91f3-b165240eff75] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:10:07.831615747Z [2024-02-24 03:10:07,828: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:10:08.967899088Z [2024-02-24 03:10:08,967: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:10:08.971178534Z [2024-02-24 03:10:08,970: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:08.990785542Z [2024-02-24 03:10:08,990: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:10:08.991905741Z [2024-02-24 03:10:08,991: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:08.991950900Z [2024-02-24 03:10:08,991: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:08.992070217Z [2024-02-24 03:10:08,991: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:08.992079422Z [2024-02-24 03:10:08,991: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:10:08.992373090Z [2024-02-24 03:10:08,992: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:10:08.992500559Z [2024-02-24 03:10:08,992: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:09.082522254Z [2024-02-24 03:10:09,082: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:09.716848065Z [2024-02-24 03:10:09,716: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c55eed07-6eae-4dc3-91f3-b165240eff75] succeeded in 2.217327630998625s: None
2024-02-24T03:10:09.830090517Z [2024-02-24 03:10:09,829: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35483362-f0f1-489c-a7f5-7e95f4501c78] received
2024-02-24T03:10:09.839620147Z [2024-02-24 03:10:09,839: INFO/ForkPoolWorker-15] [35483362-f0f1-489c-a7f5-7e95f4501c78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:10:10.135577343Z [2024-02-24 03:10:10,132: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:10:11.315303118Z [2024-02-24 03:10:11,314: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:10:11.318457394Z [2024-02-24 03:10:11,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:10:11.337521195Z [2024-02-24 03:10:11,337: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:10:11.339367506Z [2024-02-24 03:10:11,339: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:10:11.339628177Z [2024-02-24 03:10:11,339: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:10:11.339981204Z [2024-02-24 03:10:11,339: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:10:11.340208188Z [2024-02-24 03:10:11,339: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:10:11.340727350Z [2024-02-24 03:10:11,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:10:11.341039319Z [2024-02-24 03:10:11,340: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:10:11.451818174Z [2024-02-24 03:10:11,451: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:10:12.087005428Z [2024-02-24 03:10:12,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35483362-f0f1-489c-a7f5-7e95f4501c78] succeeded in 2.252881169999455s: None
2024-02-24T03:11:00.303647213Z [2024-02-24 03:11:00,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5bdb8313-e49b-4410-909e-4f9368aba901] received
2024-02-24T03:11:00.307039810Z [2024-02-24 03:11:00,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ce4f6c2b-e0fc-4af3-851e-7e06712a8fba] received
2024-02-24T03:11:00.316945798Z [2024-02-24 03:11:00,316: INFO/ForkPoolWorker-15] [5bdb8313-e49b-4410-909e-4f9368aba901] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:11:00.317444758Z [2024-02-24 03:11:00,317: INFO/ForkPoolWorker-16] [ce4f6c2b-e0fc-4af3-851e-7e06712a8fba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:11:00.318236318Z [2024-02-24 03:11:00,318: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d33f539c-aa66-444c-be7f-cd9ca65fd3fd] received
2024-02-24T03:11:00.327174678Z [2024-02-24 03:11:00,326: INFO/ForkPoolWorker-1] [d33f539c-aa66-444c-be7f-cd9ca65fd3fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:11:00.585283574Z [2024-02-24 03:11:00,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:11:00.629993530Z [2024-02-24 03:11:00,625: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:11:00.663804670Z [2024-02-24 03:11:00,659: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:11:00.822318068Z [2024-02-24 03:11:00,821: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:11:00.826268900Z [2024-02-24 03:11:00,825: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:11:00.869158355Z [2024-02-24 03:11:00,868: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:11:00.870954593Z [2024-02-24 03:11:00,870: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:11:00.871073643Z [2024-02-24 03:11:00,870: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:11:00.871168623Z [2024-02-24 03:11:00,871: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:11:00.871374477Z [2024-02-24 03:11:00,871: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:11:00.997654542Z [2024-02-24 03:11:00,997: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:11:01.731436163Z [2024-02-24 03:11:01,730: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d33f539c-aa66-444c-be7f-cd9ca65fd3fd] succeeded in 1.4115742730009515s: None
2024-02-24T03:11:02.116594309Z [2024-02-24 03:11:02,116: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:11:02.120164588Z [2024-02-24 03:11:02,119: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:11:02.148250564Z [2024-02-24 03:11:02,147: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:11:02.150257657Z [2024-02-24 03:11:02,149: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:11:02.150458212Z [2024-02-24 03:11:02,150: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:11:02.150673352Z [2024-02-24 03:11:02,150: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:11:02.150686488Z [2024-02-24 03:11:02,150: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:11:02.151020954Z [2024-02-24 03:11:02,150: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:11:02.151101237Z [2024-02-24 03:11:02,150: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:11:02.264758646Z [2024-02-24 03:11:02,264: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:11:02.304018036Z [2024-02-24 03:11:02,303: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:11:02.308060863Z [2024-02-24 03:11:02,307: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:11:02.337503329Z [2024-02-24 03:11:02,337: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:11:02.339384722Z [2024-02-24 03:11:02,339: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:11:02.339533127Z [2024-02-24 03:11:02,339: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:11:02.339811542Z [2024-02-24 03:11:02,339: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:11:02.339984860Z [2024-02-24 03:11:02,339: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:11:02.340431253Z [2024-02-24 03:11:02,340: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:11:02.340583332Z [2024-02-24 03:11:02,340: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:11:02.445071639Z [2024-02-24 03:11:02,444: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:11:04.299906491Z [2024-02-24 03:11:04,299: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5bdb8313-e49b-4410-909e-4f9368aba901] succeeded in 3.991577734001112s: None
2024-02-24T03:11:04.590500581Z [2024-02-24 03:11:04,589: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ce4f6c2b-e0fc-4af3-851e-7e06712a8fba] succeeded in 4.281713460000901s: None
2024-02-24T03:12:00.244940074Z [2024-02-24 03:12:00,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fe16ba4c-ac06-49a6-ad2d-e8f4319d001a] received
2024-02-24T03:12:00.247878186Z [2024-02-24 03:12:00,247: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[07e0491d-8e6c-42cb-9175-781d89429cd4] received
2024-02-24T03:12:00.252899596Z [2024-02-24 03:12:00,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[68ec09eb-d78a-4abd-a030-dc11b119e6a7] received
2024-02-24T03:12:00.254653692Z [2024-02-24 03:12:00,254: INFO/ForkPoolWorker-15] [fe16ba4c-ac06-49a6-ad2d-e8f4319d001a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:12:00.257308560Z [2024-02-24 03:12:00,256: INFO/ForkPoolWorker-16] [07e0491d-8e6c-42cb-9175-781d89429cd4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:12:00.258580662Z [2024-02-24 03:12:00,258: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c16456f-f128-4648-8e74-a4478d3078ed] received
2024-02-24T03:12:00.276928997Z [2024-02-24 03:12:00,276: INFO/ForkPoolWorker-2] [5c16456f-f128-4648-8e74-a4478d3078ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:12:00.278312100Z [2024-02-24 03:12:00,278: INFO/ForkPoolWorker-1] [68ec09eb-d78a-4abd-a030-dc11b119e6a7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:12:00.554011194Z [2024-02-24 03:12:00,550: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:12:00.635409648Z [2024-02-24 03:12:00,631: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:12:00.715011041Z [2024-02-24 03:12:00,710: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:12:00.746957191Z [2024-02-24 03:12:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:12:00.851290017Z [2024-02-24 03:12:00,851: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:12:00.909977833Z [2024-02-24 03:12:00,909: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:12:00.918699158Z [2024-02-24 03:12:00,918: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:12:00.971014105Z [2024-02-24 03:12:00,970: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:12:00.972598101Z [2024-02-24 03:12:00,972: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:12:00.972931139Z [2024-02-24 03:12:00,972: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:12:00.972985714Z [2024-02-24 03:12:00,972: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:12:00.973234436Z [2024-02-24 03:12:00,973: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:12:01.112614218Z [2024-02-24 03:12:01,112: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:12:01.611127756Z [2024-02-24 03:12:01,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fe16ba4c-ac06-49a6-ad2d-e8f4319d001a] succeeded in 1.3617400809998799s: None
2024-02-24T03:12:01.904469626Z [2024-02-24 03:12:01,904: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5c16456f-f128-4648-8e74-a4478d3078ed] succeeded in 1.6349719890004053s: None
2024-02-24T03:12:02.042189593Z [2024-02-24 03:12:02,041: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:12:02.045562851Z [2024-02-24 03:12:02,045: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:12:02.078113653Z [2024-02-24 03:12:02,077: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:12:02.080514766Z [2024-02-24 03:12:02,079: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:12:02.080821896Z [2024-02-24 03:12:02,080: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:12:02.081157956Z [2024-02-24 03:12:02,080: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:12:02.081373652Z [2024-02-24 03:12:02,081: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:12:02.083000025Z [2024-02-24 03:12:02,082: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:12:02.083193870Z [2024-02-24 03:12:02,082: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:12:02.211146478Z [2024-02-24 03:12:02,210: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:12:02.326803588Z [2024-02-24 03:12:02,326: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:12:02.330634129Z [2024-02-24 03:12:02,329: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:12:02.361958229Z [2024-02-24 03:12:02,360: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:12:02.361981498Z [2024-02-24 03:12:02,361: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:12:02.361993856Z [2024-02-24 03:12:02,361: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:12:02.362112725Z [2024-02-24 03:12:02,361: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:12:02.362240628Z [2024-02-24 03:12:02,362: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:12:02.362480993Z [2024-02-24 03:12:02,362: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:12:02.362489858Z [2024-02-24 03:12:02,362: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:12:02.529044042Z [2024-02-24 03:12:02,528: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:12:04.260249912Z [2024-02-24 03:12:04,259: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[68ec09eb-d78a-4abd-a030-dc11b119e6a7] succeeded in 4.000153077000505s: None
2024-02-24T03:12:04.316106229Z [2024-02-24 03:12:04,315: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[07e0491d-8e6c-42cb-9175-781d89429cd4] succeeded in 4.0663204490010685s: None
2024-02-24T03:13:01.195268962Z [2024-02-24 03:13:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1a1d2a2-ed65-4fa9-a806-be928afeed20] received
2024-02-24T03:13:01.198117702Z [2024-02-24 03:13:01,197: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e36fdfec-abe8-40df-96e2-889acf816dbb] received
2024-02-24T03:13:01.203594872Z [2024-02-24 03:13:01,203: INFO/ForkPoolWorker-15] [b1a1d2a2-ed65-4fa9-a806-be928afeed20] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:13:01.217425794Z [2024-02-24 03:13:01,213: INFO/ForkPoolWorker-16] [e36fdfec-abe8-40df-96e2-889acf816dbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:13:01.219507684Z [2024-02-24 03:13:01,219: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[273aa18d-78bd-4931-9350-34433e8c6115] received
2024-02-24T03:13:01.230923478Z [2024-02-24 03:13:01,230: INFO/ForkPoolWorker-1] [273aa18d-78bd-4931-9350-34433e8c6115] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:13:01.563928205Z [2024-02-24 03:13:01,560: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:13:01.585541873Z [2024-02-24 03:13:01,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:13:01.744150410Z [2024-02-24 03:13:01,740: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:13:01.751442686Z [2024-02-24 03:13:01,751: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:13:01.756178254Z [2024-02-24 03:13:01,755: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:13:01.807500077Z [2024-02-24 03:13:01,807: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:13:01.810773961Z [2024-02-24 03:13:01,810: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:13:01.810837570Z [2024-02-24 03:13:01,810: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:13:01.810884816Z [2024-02-24 03:13:01,810: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:13:01.811141364Z [2024-02-24 03:13:01,811: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:13:01.930206847Z [2024-02-24 03:13:01,929: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:13:02.607441713Z [2024-02-24 03:13:02,607: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b1a1d2a2-ed65-4fa9-a806-be928afeed20] succeeded in 1.4102536570007942s: None
2024-02-24T03:13:02.985657030Z [2024-02-24 03:13:02,985: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:13:02.989290950Z [2024-02-24 03:13:02,988: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:13:03.029271877Z [2024-02-24 03:13:03,028: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:13:03.032440212Z [2024-02-24 03:13:03,032: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:13:03.032519849Z [2024-02-24 03:13:03,032: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:13:03.033086184Z [2024-02-24 03:13:03,032: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:13:03.033223262Z [2024-02-24 03:13:03,033: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:13:03.033682020Z [2024-02-24 03:13:03,033: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:13:03.033788118Z [2024-02-24 03:13:03,033: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:13:03.125882698Z [2024-02-24 03:13:03,125: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:13:03.294695744Z [2024-02-24 03:13:03,292: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:13:03.298475277Z [2024-02-24 03:13:03,296: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:13:03.320362633Z [2024-02-24 03:13:03,320: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:13:03.321799715Z [2024-02-24 03:13:03,321: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:13:03.321826397Z [2024-02-24 03:13:03,321: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:13:03.321983586Z [2024-02-24 03:13:03,321: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:13:03.322027089Z [2024-02-24 03:13:03,321: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:13:03.322453805Z [2024-02-24 03:13:03,322: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:13:03.322469541Z [2024-02-24 03:13:03,322: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:13:03.441180612Z [2024-02-24 03:13:03,440: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:13:05.753869435Z [2024-02-24 03:13:05,753: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e36fdfec-abe8-40df-96e2-889acf816dbb] succeeded in 4.5541882240013365s: None
2024-02-24T03:13:05.886921544Z [2024-02-24 03:13:05,886: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[273aa18d-78bd-4931-9350-34433e8c6115] succeeded in 4.665636263000124s: None
2024-02-24T03:14:01.026456283Z [2024-02-24 03:14:01,026: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[936fe6c3-6055-4cb7-bc23-0919d98024bb] received
2024-02-24T03:14:01.034442202Z [2024-02-24 03:14:01,034: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[499f6a3f-dcd7-455b-b4a5-b82146f304fc] received
2024-02-24T03:14:01.037954355Z [2024-02-24 03:14:01,037: INFO/ForkPoolWorker-15] [936fe6c3-6055-4cb7-bc23-0919d98024bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:14:01.045660817Z [2024-02-24 03:14:01,045: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3524e120-d08b-4201-b87f-2ec55f2c1b4c] received
2024-02-24T03:14:01.046531340Z [2024-02-24 03:14:01,046: INFO/ForkPoolWorker-16] [499f6a3f-dcd7-455b-b4a5-b82146f304fc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:14:01.062495835Z [2024-02-24 03:14:01,062: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a3df314-cc13-4cf6-b33e-3162e64d5bd1] received
2024-02-24T03:14:01.068731128Z [2024-02-24 03:14:01,068: INFO/ForkPoolWorker-1] [3524e120-d08b-4201-b87f-2ec55f2c1b4c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:14:01.088934890Z [2024-02-24 03:14:01,088: INFO/ForkPoolWorker-2] [1a3df314-cc13-4cf6-b33e-3162e64d5bd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:14:01.496116276Z [2024-02-24 03:14:01,492: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:14:01.548000626Z [2024-02-24 03:14:01,544: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:14:01.563422925Z [2024-02-24 03:14:01,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:14:01.730278364Z [2024-02-24 03:14:01,729: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:14:01.734631073Z [2024-02-24 03:14:01,734: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:14:01.775629370Z [2024-02-24 03:14:01,775: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:14:01.776862522Z [2024-02-24 03:14:01,776: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:14:01.776943583Z [2024-02-24 03:14:01,776: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:14:01.776973582Z [2024-02-24 03:14:01,776: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:14:01.777168245Z [2024-02-24 03:14:01,777: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:14:01.871063609Z [2024-02-24 03:14:01,870: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:14:01.915432307Z [2024-02-24 03:14:01,915: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:14:02.066737462Z [2024-02-24 03:14:02,063: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:14:02.539487913Z [2024-02-24 03:14:02,539: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[936fe6c3-6055-4cb7-bc23-0919d98024bb] succeeded in 1.5087115059995995s: None
2024-02-24T03:14:02.604369592Z [2024-02-24 03:14:02,603: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1a3df314-cc13-4cf6-b33e-3162e64d5bd1] succeeded in 1.5319044860007125s: None
2024-02-24T03:14:03.103609300Z [2024-02-24 03:14:03,103: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:14:03.107093010Z [2024-02-24 03:14:03,106: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:14:03.130642870Z [2024-02-24 03:14:03,130: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:14:03.132198939Z [2024-02-24 03:14:03,131: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:14:03.132211887Z [2024-02-24 03:14:03,132: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:14:03.132348983Z [2024-02-24 03:14:03,132: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:14:03.132354032Z [2024-02-24 03:14:03,132: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:14:03.132601143Z [2024-02-24 03:14:03,132: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:14:03.132641983Z [2024-02-24 03:14:03,132: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:14:03.223787187Z [2024-02-24 03:14:03,223: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:14:03.492098038Z [2024-02-24 03:14:03,491: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:14:03.495529062Z [2024-02-24 03:14:03,495: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:14:03.515251205Z [2024-02-24 03:14:03,515: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:14:03.516605602Z [2024-02-24 03:14:03,516: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:14:03.516744687Z [2024-02-24 03:14:03,516: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:14:03.516942210Z [2024-02-24 03:14:03,516: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:14:03.517061783Z [2024-02-24 03:14:03,516: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:14:03.517353423Z [2024-02-24 03:14:03,517: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:14:03.517476860Z [2024-02-24 03:14:03,517: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:14:03.656379778Z [2024-02-24 03:14:03,656: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:14:06.315515414Z [2024-02-24 03:14:06,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3524e120-d08b-4201-b87f-2ec55f2c1b4c] succeeded in 5.2584604370003944s: None
2024-02-24T03:14:07.277552381Z [2024-02-24 03:14:07,276: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[499f6a3f-dcd7-455b-b4a5-b82146f304fc] succeeded in 6.240014021999741s: None
2024-02-24T03:15:00.913033723Z [2024-02-24 03:15:00,912: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7357e51a-3def-4c34-8c8d-4e25d565ad5c] received
2024-02-24T03:15:00.920732176Z [2024-02-24 03:15:00,920: INFO/ForkPoolWorker-15] [7357e51a-3def-4c34-8c8d-4e25d565ad5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:15:00.924006332Z [2024-02-24 03:15:00,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c42b177-ab71-43e4-be17-2191295a2170] received
2024-02-24T03:15:00.930277550Z [2024-02-24 03:15:00,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0a39be0-64c8-4f17-85cf-a2b06c6212f2] received
2024-02-24T03:15:00.931848356Z [2024-02-24 03:15:00,931: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3d0dd50-1339-4df5-80d2-51fcd6a634f2] received
2024-02-24T03:15:00.940776290Z [2024-02-24 03:15:00,940: INFO/ForkPoolWorker-16] [2c42b177-ab71-43e4-be17-2191295a2170] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:15:00.949039947Z [2024-02-24 03:15:00,948: INFO/ForkPoolWorker-1] [b0a39be0-64c8-4f17-85cf-a2b06c6212f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:15:00.949580990Z [2024-02-24 03:15:00,949: INFO/ForkPoolWorker-2] [a3d0dd50-1339-4df5-80d2-51fcd6a634f2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:15:01.335170480Z [2024-02-24 03:15:01,327: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:15:01.516065713Z [2024-02-24 03:15:01,487: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:15:01.553702265Z [2024-02-24 03:15:01,548: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:15:01.696963661Z [2024-02-24 03:15:01,688: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:15:01.941500426Z [2024-02-24 03:15:01,941: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:15:01.945501580Z [2024-02-24 03:15:01,945: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:01.982445351Z [2024-02-24 03:15:01,982: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:15:01.983876082Z [2024-02-24 03:15:01,983: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:15:01.990264374Z [2024-02-24 03:15:01,983: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:15:01.990325575Z [2024-02-24 03:15:01,990: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:15:01.990629029Z [2024-02-24 03:15:01,990: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:15:02.154202083Z [2024-02-24 03:15:02,153: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:03.235632702Z [2024-02-24 03:15:03,235: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[a3d0dd50-1339-4df5-80d2-51fcd6a634f2] succeeded in 2.2978472099985083s: None
2024-02-24T03:15:03.381944782Z [2024-02-24 03:15:03,381: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:15:03.386450182Z [2024-02-24 03:15:03,385: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:03.408733011Z [2024-02-24 03:15:03,408: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:15:03.413374950Z [2024-02-24 03:15:03,412: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:03.415063916Z [2024-02-24 03:15:03,414: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:15:03.417904631Z [2024-02-24 03:15:03,417: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:03.418070491Z [2024-02-24 03:15:03,417: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:03.418270336Z [2024-02-24 03:15:03,418: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:03.418439220Z [2024-02-24 03:15:03,418: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:15:03.418789599Z [2024-02-24 03:15:03,418: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:15:03.418938352Z [2024-02-24 03:15:03,418: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:03.452305925Z [2024-02-24 03:15:03,451: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:15:03.462933973Z [2024-02-24 03:15:03,462: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:03.462964559Z [2024-02-24 03:15:03,462: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:03.463189484Z [2024-02-24 03:15:03,462: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:03.463262271Z [2024-02-24 03:15:03,463: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:15:03.463654943Z [2024-02-24 03:15:03,463: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:15:03.463706671Z [2024-02-24 03:15:03,463: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:03.549303603Z [2024-02-24 03:15:03,548: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:03.586684843Z [2024-02-24 03:15:03,586: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:15:03.590564169Z [2024-02-24 03:15:03,590: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:03.622210432Z [2024-02-24 03:15:03,622: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:03.659422769Z [2024-02-24 03:15:03,659: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:15:03.675012715Z [2024-02-24 03:15:03,674: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:03.675076035Z [2024-02-24 03:15:03,674: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:03.675089469Z [2024-02-24 03:15:03,674: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:03.675127063Z [2024-02-24 03:15:03,675: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:15:03.675699396Z [2024-02-24 03:15:03,675: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:15:03.675734185Z [2024-02-24 03:15:03,675: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:03.996899655Z [2024-02-24 03:15:03,996: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:04.511807945Z [2024-02-24 03:15:04,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7357e51a-3def-4c34-8c8d-4e25d565ad5c] succeeded in 3.5965854130008665s: None
2024-02-24T03:15:04.738074769Z [2024-02-24 03:15:04,737: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3cc3761-c135-470e-aeea-c193ccac333c] received
2024-02-24T03:15:04.745972658Z [2024-02-24 03:15:04,745: INFO/ForkPoolWorker-15] [c3cc3761-c135-470e-aeea-c193ccac333c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:15:05.064719723Z [2024-02-24 03:15:05,061: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:15:05.348787077Z [2024-02-24 03:15:05,348: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2c42b177-ab71-43e4-be17-2191295a2170] succeeded in 4.417309458998716s: None
2024-02-24T03:15:06.179370568Z [2024-02-24 03:15:06,176: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b0a39be0-64c8-4f17-85cf-a2b06c6212f2] succeeded in 5.243037252001159s: None
2024-02-24T03:15:06.253429081Z [2024-02-24 03:15:06,252: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:15:06.256650643Z [2024-02-24 03:15:06,256: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:06.274244487Z [2024-02-24 03:15:06,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:15:06.275792142Z [2024-02-24 03:15:06,275: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:06.275816094Z [2024-02-24 03:15:06,275: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:06.275946644Z [2024-02-24 03:15:06,275: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:06.275997993Z [2024-02-24 03:15:06,275: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:15:06.276281692Z [2024-02-24 03:15:06,276: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:15:06.276411356Z [2024-02-24 03:15:06,276: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:06.390105324Z [2024-02-24 03:15:06,389: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:07.003881729Z [2024-02-24 03:15:07,003: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c3cc3761-c135-470e-aeea-c193ccac333c] succeeded in 2.264114117000645s: None
2024-02-24T03:15:07.147481758Z [2024-02-24 03:15:07,147: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04625b9b-d874-4d1b-a235-9ded7f379d9e] received
2024-02-24T03:15:07.154601281Z [2024-02-24 03:15:07,154: INFO/ForkPoolWorker-15] [04625b9b-d874-4d1b-a235-9ded7f379d9e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:15:07.463933043Z [2024-02-24 03:15:07,460: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:15:08.804941029Z [2024-02-24 03:15:08,804: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:15:08.808452845Z [2024-02-24 03:15:08,807: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:08.828412714Z [2024-02-24 03:15:08,828: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:15:08.829942691Z [2024-02-24 03:15:08,829: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:08.829963314Z [2024-02-24 03:15:08,829: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:08.830184778Z [2024-02-24 03:15:08,829: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:08.830314008Z [2024-02-24 03:15:08,830: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:15:08.830599992Z [2024-02-24 03:15:08,830: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:15:08.830753270Z [2024-02-24 03:15:08,830: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:08.923319660Z [2024-02-24 03:15:08,922: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:09.519171678Z [2024-02-24 03:15:09,518: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[04625b9b-d874-4d1b-a235-9ded7f379d9e] succeeded in 2.3700373399988166s: None
2024-02-24T03:15:09.905493298Z [2024-02-24 03:15:09,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[108133ca-c064-4b9b-8bf2-e9fe595f0e5f] received
2024-02-24T03:15:09.919568286Z [2024-02-24 03:15:09,919: INFO/ForkPoolWorker-15] [108133ca-c064-4b9b-8bf2-e9fe595f0e5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:15:10.191078692Z [2024-02-24 03:15:10,187: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:15:11.316283548Z [2024-02-24 03:15:11,315: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:15:11.319341934Z [2024-02-24 03:15:11,318: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:15:11.343640748Z [2024-02-24 03:15:11,343: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:15:11.345091727Z [2024-02-24 03:15:11,344: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:15:11.345112411Z [2024-02-24 03:15:11,344: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:15:11.345291869Z [2024-02-24 03:15:11,345: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:15:11.345350427Z [2024-02-24 03:15:11,345: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:15:11.345985058Z [2024-02-24 03:15:11,345: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:15:11.346006778Z [2024-02-24 03:15:11,345: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:15:11.450319882Z [2024-02-24 03:15:11,449: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:15:12.063162869Z [2024-02-24 03:15:12,062: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[108133ca-c064-4b9b-8bf2-e9fe595f0e5f] succeeded in 2.1543290839999827s: None
2024-02-24T03:16:00.866411981Z [2024-02-24 03:16:00,866: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bc09de6-5c12-435c-b187-2967b92a7fa9] received
2024-02-24T03:16:00.871321353Z [2024-02-24 03:16:00,871: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a708e093-4472-44ac-a6e6-62df6b72ab70] received
2024-02-24T03:16:00.872748930Z [2024-02-24 03:16:00,872: INFO/ForkPoolWorker-15] [9bc09de6-5c12-435c-b187-2967b92a7fa9] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:16:00.874085490Z [2024-02-24 03:16:00,873: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f4e8282-70a4-4da3-8995-3ca6f9462375] received
2024-02-24T03:16:00.878932600Z [2024-02-24 03:16:00,878: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d37e3529-179d-473a-9d24-e5bba167d506] received
2024-02-24T03:16:00.886631500Z [2024-02-24 03:16:00,886: INFO/ForkPoolWorker-16] [a708e093-4472-44ac-a6e6-62df6b72ab70] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:16:00.901467453Z [2024-02-24 03:16:00,901: INFO/ForkPoolWorker-2] [d37e3529-179d-473a-9d24-e5bba167d506] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:16:00.901807841Z [2024-02-24 03:16:00,898: INFO/ForkPoolWorker-1] [7f4e8282-70a4-4da3-8995-3ca6f9462375] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:16:01.325401585Z [2024-02-24 03:16:01,322: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:16:01.340320467Z [2024-02-24 03:16:01,332: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:16:01.342848151Z [2024-02-24 03:16:01,339: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:16:01.472481871Z [2024-02-24 03:16:01,469: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:16:01.594668268Z [2024-02-24 03:16:01,594: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:16:01.647278648Z [2024-02-24 03:16:01,646: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:16:01.651190334Z [2024-02-24 03:16:01,650: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:16:01.670626385Z [2024-02-24 03:16:01,670: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:16:01.671747363Z [2024-02-24 03:16:01,671: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:16:01.671879707Z [2024-02-24 03:16:01,671: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:16:01.671953800Z [2024-02-24 03:16:01,671: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:16:01.672480351Z [2024-02-24 03:16:01,672: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:16:01.774613173Z [2024-02-24 03:16:01,774: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:16:02.287609292Z [2024-02-24 03:16:02,287: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9bc09de6-5c12-435c-b187-2967b92a7fa9] succeeded in 1.419355848000123s: None
2024-02-24T03:16:02.461912715Z [2024-02-24 03:16:02,461: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d37e3529-179d-473a-9d24-e5bba167d506] succeeded in 1.5812338720006665s: None
2024-02-24T03:16:02.893364331Z [2024-02-24 03:16:02,892: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:16:02.896984500Z [2024-02-24 03:16:02,896: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:16:02.918435373Z [2024-02-24 03:16:02,918: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:16:02.919946982Z [2024-02-24 03:16:02,919: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:16:02.919981441Z [2024-02-24 03:16:02,919: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:16:02.920207565Z [2024-02-24 03:16:02,919: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:16:02.920230409Z [2024-02-24 03:16:02,920: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:16:02.920707591Z [2024-02-24 03:16:02,920: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:16:02.920871106Z [2024-02-24 03:16:02,920: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:16:03.014004088Z [2024-02-24 03:16:03,013: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:16:03.114601626Z [2024-02-24 03:16:03,114: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:16:03.118595394Z [2024-02-24 03:16:03,117: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:16:03.149427037Z [2024-02-24 03:16:03,149: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:16:03.150793831Z [2024-02-24 03:16:03,150: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:16:03.150829128Z [2024-02-24 03:16:03,150: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:16:03.151019090Z [2024-02-24 03:16:03,150: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:16:03.151460784Z [2024-02-24 03:16:03,150: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:16:03.151773003Z [2024-02-24 03:16:03,151: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:16:03.151847968Z [2024-02-24 03:16:03,151: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:16:03.229724603Z [2024-02-24 03:16:03,229: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:16:05.517907288Z [2024-02-24 03:16:05,517: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a708e093-4472-44ac-a6e6-62df6b72ab70] succeeded in 4.643345739001234s: None
2024-02-24T03:16:06.458966677Z [2024-02-24 03:16:06,458: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7f4e8282-70a4-4da3-8995-3ca6f9462375] succeeded in 5.582985953000389s: None
2024-02-24T03:17:00.434720641Z [2024-02-24 03:17:00,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffded87a-215f-4dfd-8620-d3072ae19b94] received
2024-02-24T03:17:00.440580587Z [2024-02-24 03:17:00,440: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c2a03f4-55c4-460d-8c63-1537b12f522f] received
2024-02-24T03:17:00.442419518Z [2024-02-24 03:17:00,442: INFO/ForkPoolWorker-15] [ffded87a-215f-4dfd-8620-d3072ae19b94] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:17:00.444945133Z [2024-02-24 03:17:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81ae1a3f-3f63-4f78-b49f-ac3e4a87592d] received
2024-02-24T03:17:00.451908831Z [2024-02-24 03:17:00,451: INFO/ForkPoolWorker-16] [1c2a03f4-55c4-460d-8c63-1537b12f522f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:17:00.453889848Z [2024-02-24 03:17:00,453: INFO/ForkPoolWorker-1] [81ae1a3f-3f63-4f78-b49f-ac3e4a87592d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:17:00.742439909Z [2024-02-24 03:17:00,739: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:17:00.795284586Z [2024-02-24 03:17:00,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:17:00.826610064Z [2024-02-24 03:17:00,823: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:17:00.949834047Z [2024-02-24 03:17:00,949: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:17:00.953635112Z [2024-02-24 03:17:00,953: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:17:00.970636547Z [2024-02-24 03:17:00,970: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:17:00.971615831Z [2024-02-24 03:17:00,971: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:17:00.971741249Z [2024-02-24 03:17:00,971: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:17:00.971871262Z [2024-02-24 03:17:00,971: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:17:00.972321640Z [2024-02-24 03:17:00,972: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:17:01.082478824Z [2024-02-24 03:17:01,082: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:17:01.705410325Z [2024-02-24 03:17:01,704: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1c2a03f4-55c4-460d-8c63-1537b12f522f] succeeded in 1.2617923859997973s: None
2024-02-24T03:17:02.058108303Z [2024-02-24 03:17:02,057: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:17:02.061620955Z [2024-02-24 03:17:02,061: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:17:02.066167661Z [2024-02-24 03:17:02,065: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:17:02.069558004Z [2024-02-24 03:17:02,069: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:17:02.094833917Z [2024-02-24 03:17:02,094: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:17:02.096400735Z [2024-02-24 03:17:02,096: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:17:02.096818811Z [2024-02-24 03:17:02,096: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:17:02.096858784Z [2024-02-24 03:17:02,096: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:17:02.097055332Z [2024-02-24 03:17:02,096: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:17:02.097149776Z [2024-02-24 03:17:02,097: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:17:02.097877471Z [2024-02-24 03:17:02,097: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:17:02.098129515Z [2024-02-24 03:17:02,097: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:17:02.099576888Z [2024-02-24 03:17:02,099: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:17:02.101580708Z [2024-02-24 03:17:02,101: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:17:02.102795536Z [2024-02-24 03:17:02,101: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:17:02.102859573Z [2024-02-24 03:17:02,102: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:17:02.103255548Z [2024-02-24 03:17:02,103: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:17:02.104614947Z [2024-02-24 03:17:02,104: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:17:02.195665390Z [2024-02-24 03:17:02,195: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:17:02.234048729Z [2024-02-24 03:17:02,233: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:17:03.707588860Z [2024-02-24 03:17:03,707: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81ae1a3f-3f63-4f78-b49f-ac3e4a87592d] succeeded in 3.2605441539999447s: None
2024-02-24T03:17:04.241883330Z [2024-02-24 03:17:04,241: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffded87a-215f-4dfd-8620-d3072ae19b94] succeeded in 3.8044411030004994s: None
2024-02-24T03:18:00.801338536Z [2024-02-24 03:18:00,801: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49ea1dde-5d31-4e0d-8f48-8704fea45a61] received
2024-02-24T03:18:00.805535153Z [2024-02-24 03:18:00,805: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2a1fd1c-b704-46e9-8243-8cfcd0a64650] received
2024-02-24T03:18:00.813087921Z [2024-02-24 03:18:00,812: INFO/ForkPoolWorker-16] [c2a1fd1c-b704-46e9-8243-8cfcd0a64650] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:18:00.814174980Z [2024-02-24 03:18:00,813: INFO/ForkPoolWorker-15] [49ea1dde-5d31-4e0d-8f48-8704fea45a61] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:18:00.817921624Z [2024-02-24 03:18:00,817: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3ae93e13-b5be-4b77-be58-7018b3507b6f] received
2024-02-24T03:18:00.827530741Z [2024-02-24 03:18:00,826: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3c091156-7c98-42cb-8f9b-1ddc834415ed] received
2024-02-24T03:18:00.833698397Z [2024-02-24 03:18:00,833: INFO/ForkPoolWorker-1] [3ae93e13-b5be-4b77-be58-7018b3507b6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:18:00.838458211Z [2024-02-24 03:18:00,838: INFO/ForkPoolWorker-2] [3c091156-7c98-42cb-8f9b-1ddc834415ed] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:18:01.183240198Z [2024-02-24 03:18:01,179: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:18:01.197240834Z [2024-02-24 03:18:01,193: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:18:01.203231366Z [2024-02-24 03:18:01,199: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:18:01.394989470Z [2024-02-24 03:18:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:18:01.477460729Z [2024-02-24 03:18:01,477: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:18:01.493904993Z [2024-02-24 03:18:01,493: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:18:01.526285733Z [2024-02-24 03:18:01,526: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:18:01.528723686Z [2024-02-24 03:18:01,528: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:18:01.528921387Z [2024-02-24 03:18:01,528: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:18:01.529143828Z [2024-02-24 03:18:01,528: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:18:01.529445471Z [2024-02-24 03:18:01,529: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:18:01.652514622Z [2024-02-24 03:18:01,652: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:18:01.688852089Z [2024-02-24 03:18:01,688: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:18:02.288993898Z [2024-02-24 03:18:02,288: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3c091156-7c98-42cb-8f9b-1ddc834415ed] succeeded in 1.4580807269994693s: None
2024-02-24T03:18:02.397868240Z [2024-02-24 03:18:02,396: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[49ea1dde-5d31-4e0d-8f48-8704fea45a61] succeeded in 1.591969233000782s: None
2024-02-24T03:18:02.733360692Z [2024-02-24 03:18:02,732: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:18:02.737212949Z [2024-02-24 03:18:02,736: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:18:02.798116804Z [2024-02-24 03:18:02,797: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:18:02.799484117Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:18:02.799497246Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:18:02.799609211Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:18:02.799638435Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:18:02.799860232Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:18:02.799906154Z [2024-02-24 03:18:02,799: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:18:02.881499046Z [2024-02-24 03:18:02,881: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:18:02.929270794Z [2024-02-24 03:18:02,928: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:18:02.933016978Z [2024-02-24 03:18:02,932: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:18:02.951767358Z [2024-02-24 03:18:02,951: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:18:02.953464944Z [2024-02-24 03:18:02,953: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:18:02.953700958Z [2024-02-24 03:18:02,953: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:18:02.953982291Z [2024-02-24 03:18:02,953: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:18:02.954123873Z [2024-02-24 03:18:02,954: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:18:02.954450324Z [2024-02-24 03:18:02,954: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:18:02.954603472Z [2024-02-24 03:18:02,954: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:18:03.080697276Z [2024-02-24 03:18:03,080: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:18:05.814633182Z [2024-02-24 03:18:05,814: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c2a1fd1c-b704-46e9-8243-8cfcd0a64650] succeeded in 5.007383655000012s: None
2024-02-24T03:18:05.861048326Z [2024-02-24 03:18:05,860: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3ae93e13-b5be-4b77-be58-7018b3507b6f] succeeded in 5.041411721000259s: None
2024-02-24T03:19:01.256844276Z [2024-02-24 03:19:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[35ed2632-f9ec-42f7-a246-580997b08bcf] received
2024-02-24T03:19:01.261109041Z [2024-02-24 03:19:01,260: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27906433-a8cf-465c-a3f4-196fc348c904] received
2024-02-24T03:19:01.265522643Z [2024-02-24 03:19:01,265: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4957f3dd-b365-49f3-a70a-c7a3ae7118c0] received
2024-02-24T03:19:01.273850884Z [2024-02-24 03:19:01,269: INFO/ForkPoolWorker-15] [35ed2632-f9ec-42f7-a246-580997b08bcf] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:19:01.287301675Z [2024-02-24 03:19:01,284: INFO/ForkPoolWorker-16] [27906433-a8cf-465c-a3f4-196fc348c904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:19:01.290451814Z [2024-02-24 03:19:01,288: INFO/ForkPoolWorker-1] [4957f3dd-b365-49f3-a70a-c7a3ae7118c0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:19:01.764319620Z [2024-02-24 03:19:01,760: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:19:01.795768749Z [2024-02-24 03:19:01,791: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:19:01.825284659Z [2024-02-24 03:19:01,822: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:19:01.997859416Z [2024-02-24 03:19:01,997: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:19:02.001685849Z [2024-02-24 03:19:02,001: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:19:02.057556097Z [2024-02-24 03:19:02,056: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:19:02.064462428Z [2024-02-24 03:19:02,064: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:19:02.064534886Z [2024-02-24 03:19:02,064: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:19:02.067154738Z [2024-02-24 03:19:02,064: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:19:02.070472402Z [2024-02-24 03:19:02,068: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:19:02.188447098Z [2024-02-24 03:19:02,188: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:19:02.992051180Z [2024-02-24 03:19:02,991: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[35ed2632-f9ec-42f7-a246-580997b08bcf] succeeded in 1.7332023099988874s: None
2024-02-24T03:19:03.352906071Z [2024-02-24 03:19:03,352: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:19:03.356500461Z [2024-02-24 03:19:03,356: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:19:03.386331466Z [2024-02-24 03:19:03,386: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:19:03.388060753Z [2024-02-24 03:19:03,387: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:19:03.388087807Z [2024-02-24 03:19:03,387: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:19:03.388322146Z [2024-02-24 03:19:03,388: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:19:03.388562854Z [2024-02-24 03:19:03,388: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:19:03.389009049Z [2024-02-24 03:19:03,388: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:19:03.389378818Z [2024-02-24 03:19:03,389: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:19:03.432446720Z [2024-02-24 03:19:03,432: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:19:03.435727514Z [2024-02-24 03:19:03,435: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:19:03.462119358Z [2024-02-24 03:19:03,461: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:19:03.464062032Z [2024-02-24 03:19:03,463: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:19:03.464273856Z [2024-02-24 03:19:03,464: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:19:03.464398320Z [2024-02-24 03:19:03,464: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:19:03.464407231Z [2024-02-24 03:19:03,464: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:19:03.464758517Z [2024-02-24 03:19:03,464: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:19:03.464793436Z [2024-02-24 03:19:03,464: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:19:03.478962216Z [2024-02-24 03:19:03,478: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:19:03.546854400Z [2024-02-24 03:19:03,546: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:19:05.417510548Z [2024-02-24 03:19:05,416: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4957f3dd-b365-49f3-a70a-c7a3ae7118c0] succeeded in 4.150360686999193s: None
2024-02-24T03:19:06.104236440Z [2024-02-24 03:19:06,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[27906433-a8cf-465c-a3f4-196fc348c904] succeeded in 4.841763845999594s: None
2024-02-24T03:20:00.770165057Z [2024-02-24 03:20:00,769: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d495f7c8-8d47-4875-b0ce-f6827b30a3c3] received
2024-02-24T03:20:00.771428586Z [2024-02-24 03:20:00,771: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d97c63cc-f98d-4005-9ac4-045397b1c5b1] received
2024-02-24T03:20:00.777285206Z [2024-02-24 03:20:00,777: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1121e6c-699d-4382-8f64-a537336fa18d] received
2024-02-24T03:20:00.777871406Z [2024-02-24 03:20:00,777: INFO/ForkPoolWorker-16] [d97c63cc-f98d-4005-9ac4-045397b1c5b1] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:20:00.781706034Z [2024-02-24 03:20:00,781: INFO/ForkPoolWorker-15] [d495f7c8-8d47-4875-b0ce-f6827b30a3c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:20:00.791281522Z [2024-02-24 03:20:00,790: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[461c6e34-e7a6-464f-b065-f3dbaf0b4457] received
2024-02-24T03:20:00.793916985Z [2024-02-24 03:20:00,793: INFO/ForkPoolWorker-1] [b1121e6c-699d-4382-8f64-a537336fa18d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:20:00.798154434Z [2024-02-24 03:20:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb6e11ab-b54f-496c-b244-cec18b85b993] received
2024-02-24T03:20:00.819246121Z [2024-02-24 03:20:00,817: INFO/ForkPoolWorker-2] [461c6e34-e7a6-464f-b065-f3dbaf0b4457] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:20:00.834533335Z [2024-02-24 03:20:00,834: INFO/ForkPoolWorker-3] [bb6e11ab-b54f-496c-b244-cec18b85b993] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:20:01.185026438Z [2024-02-24 03:20:01,181: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:20:01.222495575Z [2024-02-24 03:20:01,218: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:20:01.514481768Z [2024-02-24 03:20:01,511: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:20:01.674159919Z [2024-02-24 03:20:01,670: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:20:01.688282103Z [2024-02-24 03:20:01,687: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:20:01.692341026Z [2024-02-24 03:20:01,691: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:01.707946048Z [2024-02-24 03:20:01,704: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:20:01.733629537Z [2024-02-24 03:20:01,733: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:20:01.735394931Z [2024-02-24 03:20:01,735: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:20:01.735863007Z [2024-02-24 03:20:01,735: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:20:01.736162738Z [2024-02-24 03:20:01,735: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:20:01.736623744Z [2024-02-24 03:20:01,736: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:20:01.879271625Z [2024-02-24 03:20:01,879: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:02.042472311Z [2024-02-24 03:20:02,042: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:02.655762455Z [2024-02-24 03:20:02,654: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d97c63cc-f98d-4005-9ac4-045397b1c5b1] succeeded in 1.882449971000824s: None
2024-02-24T03:20:02.772001505Z [2024-02-24 03:20:02,771: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[bb6e11ab-b54f-496c-b244-cec18b85b993] succeeded in 1.9671939910003857s: None
2024-02-24T03:20:02.872313227Z [2024-02-24 03:20:02,871: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:20:02.875716304Z [2024-02-24 03:20:02,875: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:02.898146624Z [2024-02-24 03:20:02,897: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:20:02.899522912Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:02.899540205Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:02.899696811Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:02.899729674Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:20:02.899967611Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:20:02.899989170Z [2024-02-24 03:20:02,899: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:02.975018589Z [2024-02-24 03:20:02,974: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:03.142578685Z [2024-02-24 03:20:03,142: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:20:03.146213005Z [2024-02-24 03:20:03,145: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:03.150034462Z [2024-02-24 03:20:03,149: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:20:03.153372929Z [2024-02-24 03:20:03,152: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:03.174826017Z [2024-02-24 03:20:03,174: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:20:03.176662380Z [2024-02-24 03:20:03,176: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:03.176815877Z [2024-02-24 03:20:03,176: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:03.177101217Z [2024-02-24 03:20:03,176: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:03.177240155Z [2024-02-24 03:20:03,177: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:20:03.177728270Z [2024-02-24 03:20:03,177: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:20:03.177757602Z [2024-02-24 03:20:03,177: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:03.184485056Z [2024-02-24 03:20:03,184: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:20:03.186406553Z [2024-02-24 03:20:03,186: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:03.186700489Z [2024-02-24 03:20:03,186: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:03.186913154Z [2024-02-24 03:20:03,186: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:03.187064402Z [2024-02-24 03:20:03,186: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:20:03.187569424Z [2024-02-24 03:20:03,187: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:20:03.187761473Z [2024-02-24 03:20:03,187: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:03.299170429Z [2024-02-24 03:20:03,298: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:03.323679407Z [2024-02-24 03:20:03,323: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:03.741810464Z [2024-02-24 03:20:03,741: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[461c6e34-e7a6-464f-b065-f3dbaf0b4457] succeeded in 2.9418701529993996s: None
2024-02-24T03:20:03.831848711Z [2024-02-24 03:20:03,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c7b8e34f-7922-41d9-bf7c-e8d5a6400191] received
2024-02-24T03:20:03.845241387Z [2024-02-24 03:20:03,844: INFO/ForkPoolWorker-16] [c7b8e34f-7922-41d9-bf7c-e8d5a6400191] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:20:04.138021914Z [2024-02-24 03:20:04,134: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:20:04.992059152Z [2024-02-24 03:20:04,991: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1121e6c-699d-4382-8f64-a537336fa18d] succeeded in 4.208140618000471s: None
2024-02-24T03:20:05.300561304Z [2024-02-24 03:20:05,299: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:20:05.304619009Z [2024-02-24 03:20:05,303: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:05.319128607Z [2024-02-24 03:20:05,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d495f7c8-8d47-4875-b0ce-f6827b30a3c3] succeeded in 4.545358011999269s: None
2024-02-24T03:20:05.331959312Z [2024-02-24 03:20:05,331: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:20:05.334178218Z [2024-02-24 03:20:05,333: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:05.334257872Z [2024-02-24 03:20:05,334: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:05.334407243Z [2024-02-24 03:20:05,334: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:05.334482168Z [2024-02-24 03:20:05,334: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:20:05.334805559Z [2024-02-24 03:20:05,334: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:20:05.334900430Z [2024-02-24 03:20:05,334: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:05.425856639Z [2024-02-24 03:20:05,425: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:06.126526610Z [2024-02-24 03:20:06,125: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c7b8e34f-7922-41d9-bf7c-e8d5a6400191] succeeded in 2.292535360000329s: None
2024-02-24T03:20:06.854856605Z [2024-02-24 03:20:06,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ce38fe2-699d-4965-bc9b-42b280d69b41] received
2024-02-24T03:20:06.865309993Z [2024-02-24 03:20:06,864: INFO/ForkPoolWorker-15] [4ce38fe2-699d-4965-bc9b-42b280d69b41] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:20:07.151741497Z [2024-02-24 03:20:07,148: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:20:08.289047952Z [2024-02-24 03:20:08,288: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:20:08.292323149Z [2024-02-24 03:20:08,291: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:08.312962523Z [2024-02-24 03:20:08,312: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:20:08.314206024Z [2024-02-24 03:20:08,313: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:08.314348801Z [2024-02-24 03:20:08,314: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:08.314528427Z [2024-02-24 03:20:08,314: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:08.314625843Z [2024-02-24 03:20:08,314: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:20:08.314972446Z [2024-02-24 03:20:08,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:20:08.315079524Z [2024-02-24 03:20:08,314: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:08.397298908Z [2024-02-24 03:20:08,396: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:08.983771524Z [2024-02-24 03:20:08,983: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ce38fe2-699d-4965-bc9b-42b280d69b41] succeeded in 2.1267287880000367s: None
2024-02-24T03:20:09.046428632Z [2024-02-24 03:20:09,046: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9274643f-237a-4053-8b70-49d649f9a79f] received
2024-02-24T03:20:09.054947557Z [2024-02-24 03:20:09,054: INFO/ForkPoolWorker-15] [9274643f-237a-4053-8b70-49d649f9a79f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:20:09.352012004Z [2024-02-24 03:20:09,348: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:20:10.664565232Z [2024-02-24 03:20:10,663: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:20:10.670004351Z [2024-02-24 03:20:10,669: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:20:10.695275808Z [2024-02-24 03:20:10,694: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:20:10.697243874Z [2024-02-24 03:20:10,696: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:20:10.697278193Z [2024-02-24 03:20:10,697: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:20:10.697502614Z [2024-02-24 03:20:10,697: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:20:10.697569868Z [2024-02-24 03:20:10,697: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:20:10.698136812Z [2024-02-24 03:20:10,697: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:20:10.698223827Z [2024-02-24 03:20:10,698: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:20:10.807389711Z [2024-02-24 03:20:10,806: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:20:11.529213721Z [2024-02-24 03:20:11,528: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9274643f-237a-4053-8b70-49d649f9a79f] succeeded in 2.480538865998824s: None
2024-02-24T03:21:00.677615882Z [2024-02-24 03:21:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4ebe7f7-70ca-4085-bc59-0c568db1033d] received
2024-02-24T03:21:00.677647406Z [2024-02-24 03:21:00,676: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[80fc70ac-7895-4b71-ad76-8c3b54cbe9ba] received
2024-02-24T03:21:00.678947306Z [2024-02-24 03:21:00,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e44d3d6-5ed9-45f7-9380-cf6eb384494a] received
2024-02-24T03:21:00.692670809Z [2024-02-24 03:21:00,689: INFO/ForkPoolWorker-1] [1e44d3d6-5ed9-45f7-9380-cf6eb384494a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:21:00.702053677Z [2024-02-24 03:21:00,700: INFO/ForkPoolWorker-16] [80fc70ac-7895-4b71-ad76-8c3b54cbe9ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:21:00.713698623Z [2024-02-24 03:21:00,713: INFO/ForkPoolWorker-15] [c4ebe7f7-70ca-4085-bc59-0c568db1033d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:21:01.159408210Z [2024-02-24 03:21:01,155: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:21:01.249893688Z [2024-02-24 03:21:01,245: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:21:01.260139750Z [2024-02-24 03:21:01,250: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:21:01.347570385Z [2024-02-24 03:21:01,347: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:21:01.352162282Z [2024-02-24 03:21:01,351: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:21:01.399462418Z [2024-02-24 03:21:01,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:21:01.401356221Z [2024-02-24 03:21:01,401: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:21:01.402089487Z [2024-02-24 03:21:01,401: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:21:01.402341416Z [2024-02-24 03:21:01,402: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:21:01.402738860Z [2024-02-24 03:21:01,402: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:21:01.591272724Z [2024-02-24 03:21:01,590: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:21:02.670109672Z [2024-02-24 03:21:02,661: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c4ebe7f7-70ca-4085-bc59-0c568db1033d] succeeded in 1.9843205569995916s: None
2024-02-24T03:21:03.100580710Z [2024-02-24 03:21:03,093: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:21:03.100619230Z [2024-02-24 03:21:03,097: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:21:03.143119828Z [2024-02-24 03:21:03,137: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:21:03.143146833Z [2024-02-24 03:21:03,139: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:21:03.143150551Z [2024-02-24 03:21:03,140: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:21:03.143155920Z [2024-02-24 03:21:03,140: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:21:03.143160634Z [2024-02-24 03:21:03,140: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:21:03.143163807Z [2024-02-24 03:21:03,140: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:21:03.143166984Z [2024-02-24 03:21:03,140: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:21:03.267005090Z [2024-02-24 03:21:03,265: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:21:03.415418189Z [2024-02-24 03:21:03,415: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:21:03.429852057Z [2024-02-24 03:21:03,421: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:21:03.464945806Z [2024-02-24 03:21:03,464: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:21:03.466258412Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:21:03.466276644Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:21:03.466345409Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:21:03.466415904Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:21:03.466647935Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:21:03.467936430Z [2024-02-24 03:21:03,466: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:21:03.744210063Z [2024-02-24 03:21:03,743: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:21:07.821885112Z [2024-02-24 03:21:07,821: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[80fc70ac-7895-4b71-ad76-8c3b54cbe9ba] succeeded in 7.139076841000133s: None
2024-02-24T03:21:07.939626832Z [2024-02-24 03:21:07,939: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1e44d3d6-5ed9-45f7-9380-cf6eb384494a] succeeded in 7.259815012999752s: None
2024-02-24T03:22:00.308970288Z [2024-02-24 03:22:00,308: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b5ccc97-7aa1-478f-9fde-df8744efedbe] received
2024-02-24T03:22:00.315807210Z [2024-02-24 03:22:00,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c4de449f-f15f-49b6-a005-c5f19afc7ccb] received
2024-02-24T03:22:00.328281858Z [2024-02-24 03:22:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c3e1a63-8b6f-4175-bb06-56292dfc10f9] received
2024-02-24T03:22:00.331955310Z [2024-02-24 03:22:00,331: INFO/ForkPoolWorker-15] [8b5ccc97-7aa1-478f-9fde-df8744efedbe] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:22:00.338189687Z [2024-02-24 03:22:00,337: INFO/ForkPoolWorker-16] [c4de449f-f15f-49b6-a005-c5f19afc7ccb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:22:00.338591315Z [2024-02-24 03:22:00,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b974f35d-bcf8-4611-8af0-67179b819069] received
2024-02-24T03:22:00.340109666Z [2024-02-24 03:22:00,339: INFO/ForkPoolWorker-1] [5c3e1a63-8b6f-4175-bb06-56292dfc10f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:22:00.345446722Z [2024-02-24 03:22:00,345: INFO/ForkPoolWorker-2] [b974f35d-bcf8-4611-8af0-67179b819069] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:22:00.630650368Z [2024-02-24 03:22:00,623: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:22:00.643973139Z [2024-02-24 03:22:00,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:22:00.753338712Z [2024-02-24 03:22:00,749: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:22:00.759773777Z [2024-02-24 03:22:00,755: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:22:00.943029505Z [2024-02-24 03:22:00,942: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:22:00.947373835Z [2024-02-24 03:22:00,946: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:22:00.995412262Z [2024-02-24 03:22:00,995: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:22:01.000088464Z [2024-02-24 03:22:00,999: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:22:01.000656514Z [2024-02-24 03:22:01,000: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:22:01.000874721Z [2024-02-24 03:22:01,000: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:22:01.001204742Z [2024-02-24 03:22:01,001: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:22:01.019264652Z [2024-02-24 03:22:01,019: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:22:01.130448011Z [2024-02-24 03:22:01,130: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:22:01.702539312Z [2024-02-24 03:22:01,702: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b5ccc97-7aa1-478f-9fde-df8744efedbe] succeeded in 1.385578962001091s: None
2024-02-24T03:22:01.817388277Z [2024-02-24 03:22:01,816: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b974f35d-bcf8-4611-8af0-67179b819069] succeeded in 1.4770509079990006s: None
2024-02-24T03:22:02.177602235Z [2024-02-24 03:22:02,177: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:22:02.181395421Z [2024-02-24 03:22:02,180: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:22:02.211497420Z [2024-02-24 03:22:02,211: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:22:02.212825119Z [2024-02-24 03:22:02,212: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:22:02.212843368Z [2024-02-24 03:22:02,212: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:22:02.213020605Z [2024-02-24 03:22:02,212: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:22:02.213030814Z [2024-02-24 03:22:02,212: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:22:02.213724747Z [2024-02-24 03:22:02,213: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:22:02.213737891Z [2024-02-24 03:22:02,213: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:22:02.276618441Z [2024-02-24 03:22:02,276: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:22:02.280258401Z [2024-02-24 03:22:02,279: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:22:02.304306599Z [2024-02-24 03:22:02,304: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:22:02.305754702Z [2024-02-24 03:22:02,305: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:22:02.305809248Z [2024-02-24 03:22:02,305: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:22:02.306096094Z [2024-02-24 03:22:02,305: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:22:02.306162226Z [2024-02-24 03:22:02,306: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:22:02.306402362Z [2024-02-24 03:22:02,306: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:22:02.306849839Z [2024-02-24 03:22:02,306: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:22:02.316710808Z [2024-02-24 03:22:02,316: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:22:02.473629433Z [2024-02-24 03:22:02,473: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:22:04.739269603Z [2024-02-24 03:22:04,738: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5c3e1a63-8b6f-4175-bb06-56292dfc10f9] succeeded in 4.408821240000179s: None
2024-02-24T03:22:05.018467506Z [2024-02-24 03:22:05,017: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c4de449f-f15f-49b6-a005-c5f19afc7ccb] succeeded in 4.6995740379989s: None
2024-02-24T03:23:01.339682954Z [2024-02-24 03:23:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f9c70666-b377-47c1-bc56-13a0a8cf6412] received
2024-02-24T03:23:01.345510745Z [2024-02-24 03:23:01,345: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dbfcc24-c465-4b2d-9adc-f09262494809] received
2024-02-24T03:23:01.350062364Z [2024-02-24 03:23:01,349: INFO/ForkPoolWorker-15] [f9c70666-b377-47c1-bc56-13a0a8cf6412] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:23:01.353495398Z [2024-02-24 03:23:01,353: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6b214a0-ba1c-4472-a5d9-35f3b40c194f] received
2024-02-24T03:23:01.367157762Z [2024-02-24 03:23:01,366: INFO/ForkPoolWorker-16] [0dbfcc24-c465-4b2d-9adc-f09262494809] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:23:01.375373118Z [2024-02-24 03:23:01,374: INFO/ForkPoolWorker-1] [c6b214a0-ba1c-4472-a5d9-35f3b40c194f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:23:01.826922530Z [2024-02-24 03:23:01,823: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:23:01.885979685Z [2024-02-24 03:23:01,881: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:23:01.952876006Z [2024-02-24 03:23:01,949: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:23:02.068914895Z [2024-02-24 03:23:02,068: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:23:02.074638288Z [2024-02-24 03:23:02,073: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:23:02.098657792Z [2024-02-24 03:23:02,098: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:23:02.099829021Z [2024-02-24 03:23:02,099: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:23:02.100064535Z [2024-02-24 03:23:02,099: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:23:02.100220932Z [2024-02-24 03:23:02,100: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:23:02.100501500Z [2024-02-24 03:23:02,100: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:23:02.248236892Z [2024-02-24 03:23:02,247: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:23:03.077124466Z [2024-02-24 03:23:03,076: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c6b214a0-ba1c-4472-a5d9-35f3b40c194f] succeeded in 1.7208029520006676s: None
2024-02-24T03:23:03.393344821Z [2024-02-24 03:23:03,392: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:23:03.396763870Z [2024-02-24 03:23:03,396: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:23:03.415382746Z [2024-02-24 03:23:03,415: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:23:03.416696360Z [2024-02-24 03:23:03,416: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:23:03.417298716Z [2024-02-24 03:23:03,416: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:23:03.417704637Z [2024-02-24 03:23:03,417: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:23:03.417896450Z [2024-02-24 03:23:03,417: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:23:03.418514682Z [2024-02-24 03:23:03,418: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:23:03.418651316Z [2024-02-24 03:23:03,418: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:23:03.438962752Z [2024-02-24 03:23:03,438: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:23:03.442131081Z [2024-02-24 03:23:03,441: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:23:03.461366094Z [2024-02-24 03:23:03,461: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:23:03.462617784Z [2024-02-24 03:23:03,462: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:23:03.462655843Z [2024-02-24 03:23:03,462: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:23:03.462797961Z [2024-02-24 03:23:03,462: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:23:03.462825098Z [2024-02-24 03:23:03,462: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:23:03.463069073Z [2024-02-24 03:23:03,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:23:03.463091986Z [2024-02-24 03:23:03,463: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:23:03.507729386Z [2024-02-24 03:23:03,507: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:23:03.538187155Z [2024-02-24 03:23:03,536: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:23:05.757633765Z [2024-02-24 03:23:05,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0dbfcc24-c465-4b2d-9adc-f09262494809] succeeded in 4.409255514001416s: None
2024-02-24T03:23:06.533791986Z [2024-02-24 03:23:06,533: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f9c70666-b377-47c1-bc56-13a0a8cf6412] succeeded in 5.192660074000742s: None
2024-02-24T03:24:01.307361387Z [2024-02-24 03:24:01,306: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[257855bd-a9a1-456a-a36e-09c3d982aa1f] received
2024-02-24T03:24:01.311479137Z [2024-02-24 03:24:01,310: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cc13ce6-6194-488b-a6fa-a94c769a3904] received
2024-02-24T03:24:01.320971898Z [2024-02-24 03:24:01,320: INFO/ForkPoolWorker-15] [257855bd-a9a1-456a-a36e-09c3d982aa1f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:24:01.346960267Z [2024-02-24 03:24:01,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f260c454-0209-4245-9920-788d780e40c8] received
2024-02-24T03:24:01.347881050Z [2024-02-24 03:24:01,347: INFO/ForkPoolWorker-16] [7cc13ce6-6194-488b-a6fa-a94c769a3904] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:24:01.357965953Z [2024-02-24 03:24:01,357: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f2106e27-07fb-4cb4-856b-02f9d7947553] received
2024-02-24T03:24:01.383566009Z [2024-02-24 03:24:01,383: INFO/ForkPoolWorker-1] [f260c454-0209-4245-9920-788d780e40c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:24:01.392541344Z [2024-02-24 03:24:01,390: INFO/ForkPoolWorker-2] [f2106e27-07fb-4cb4-856b-02f9d7947553] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:24:01.863859684Z [2024-02-24 03:24:01,860: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:24:01.891131973Z [2024-02-24 03:24:01,882: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:24:02.026800011Z [2024-02-24 03:24:02,021: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:24:02.078580084Z [2024-02-24 03:24:02,078: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:24:02.092987820Z [2024-02-24 03:24:02,092: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:24:02.114090335Z [2024-02-24 03:24:02,101: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:24:02.157650020Z [2024-02-24 03:24:02,157: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:24:02.158729049Z [2024-02-24 03:24:02,158: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:24:02.158909768Z [2024-02-24 03:24:02,158: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:24:02.159109224Z [2024-02-24 03:24:02,158: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:24:02.159409666Z [2024-02-24 03:24:02,159: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:24:02.283301344Z [2024-02-24 03:24:02,283: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:24:02.478949960Z [2024-02-24 03:24:02,478: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:24:03.429445768Z [2024-02-24 03:24:03,429: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f2106e27-07fb-4cb4-856b-02f9d7947553] succeeded in 2.066219260001162s: None
2024-02-24T03:24:03.593366668Z [2024-02-24 03:24:03,592: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[257855bd-a9a1-456a-a36e-09c3d982aa1f] succeeded in 2.2838108359992475s: None
2024-02-24T03:24:03.695037936Z [2024-02-24 03:24:03,694: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:24:03.698938912Z [2024-02-24 03:24:03,698: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:24:03.723821493Z [2024-02-24 03:24:03,723: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:24:03.726126497Z [2024-02-24 03:24:03,725: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:24:03.726143260Z [2024-02-24 03:24:03,726: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:24:03.726261617Z [2024-02-24 03:24:03,726: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:24:03.726300462Z [2024-02-24 03:24:03,726: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:24:03.726513464Z [2024-02-24 03:24:03,726: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:24:03.726586483Z [2024-02-24 03:24:03,726: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:24:03.807120467Z [2024-02-24 03:24:03,806: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:24:04.239887055Z [2024-02-24 03:24:04,239: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:24:04.243418144Z [2024-02-24 03:24:04,242: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:24:04.264557112Z [2024-02-24 03:24:04,264: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:24:04.265980347Z [2024-02-24 03:24:04,265: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:24:04.266027963Z [2024-02-24 03:24:04,265: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:24:04.266162755Z [2024-02-24 03:24:04,265: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:24:04.266180218Z [2024-02-24 03:24:04,266: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:24:04.266412498Z [2024-02-24 03:24:04,266: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:24:04.266429834Z [2024-02-24 03:24:04,266: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:24:04.385458458Z [2024-02-24 03:24:04,385: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:24:07.950067857Z [2024-02-24 03:24:07,949: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f260c454-0209-4245-9920-788d780e40c8] succeeded in 6.59277909299999s: None
2024-02-24T03:24:08.060004227Z [2024-02-24 03:24:08,059: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7cc13ce6-6194-488b-a6fa-a94c769a3904] succeeded in 6.743986399000278s: None
2024-02-24T03:25:01.187483311Z [2024-02-24 03:25:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dbbe2cad-9636-4c6e-bbb6-b44cb408a67b] received
2024-02-24T03:25:01.191042683Z [2024-02-24 03:25:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec6b5e55-283e-4bd5-9a55-d73908a50dd1] received
2024-02-24T03:25:01.198679305Z [2024-02-24 03:25:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94ec6a26-6b54-4610-9aa3-9b712b43bc21] received
2024-02-24T03:25:01.204934577Z [2024-02-24 03:25:01,204: INFO/ForkPoolWorker-16] [ec6b5e55-283e-4bd5-9a55-d73908a50dd1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:25:01.205172002Z [2024-02-24 03:25:01,204: INFO/ForkPoolWorker-15] [dbbe2cad-9636-4c6e-bbb6-b44cb408a67b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:25:01.207600629Z [2024-02-24 03:25:01,205: INFO/ForkPoolWorker-1] [94ec6a26-6b54-4610-9aa3-9b712b43bc21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:25:01.219390471Z [2024-02-24 03:25:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f452f47-ee05-407e-a205-ec099056a3e8] received
2024-02-24T03:25:01.245766704Z [2024-02-24 03:25:01,241: INFO/ForkPoolWorker-2] [7f452f47-ee05-407e-a205-ec099056a3e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:25:01.614984512Z [2024-02-24 03:25:01,611: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:25:01.712516380Z [2024-02-24 03:25:01,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:25:01.729955643Z [2024-02-24 03:25:01,724: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:25:01.903187099Z [2024-02-24 03:25:01,897: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:25:02.147311711Z [2024-02-24 03:25:02,146: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:25:02.151785052Z [2024-02-24 03:25:02,151: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:02.186687951Z [2024-02-24 03:25:02,186: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:25:02.188146850Z [2024-02-24 03:25:02,187: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:25:02.188403597Z [2024-02-24 03:25:02,188: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:25:02.188634159Z [2024-02-24 03:25:02,188: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:25:02.188974055Z [2024-02-24 03:25:02,188: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:25:02.326594707Z [2024-02-24 03:25:02,326: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:03.209612661Z [2024-02-24 03:25:03,209: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f452f47-ee05-407e-a205-ec099056a3e8] succeeded in 1.9895522909991996s: None
2024-02-24T03:25:03.323094107Z [2024-02-24 03:25:03,322: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:25:03.326510385Z [2024-02-24 03:25:03,325: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:03.354035640Z [2024-02-24 03:25:03,353: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:25:03.355821543Z [2024-02-24 03:25:03,355: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:03.355860769Z [2024-02-24 03:25:03,355: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:03.356167279Z [2024-02-24 03:25:03,355: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:03.356224011Z [2024-02-24 03:25:03,356: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:25:03.356553765Z [2024-02-24 03:25:03,356: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:25:03.356630257Z [2024-02-24 03:25:03,356: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:03.449619046Z [2024-02-24 03:25:03,449: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:03.464301691Z [2024-02-24 03:25:03,463: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:25:03.467744871Z [2024-02-24 03:25:03,467: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:03.472564687Z [2024-02-24 03:25:03,472: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:25:03.475897433Z [2024-02-24 03:25:03,475: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:03.495926693Z [2024-02-24 03:25:03,495: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:25:03.497101662Z [2024-02-24 03:25:03,496: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:03.497116516Z [2024-02-24 03:25:03,497: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:03.497222867Z [2024-02-24 03:25:03,497: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:03.497256821Z [2024-02-24 03:25:03,497: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:25:03.497485426Z [2024-02-24 03:25:03,497: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:25:03.497528501Z [2024-02-24 03:25:03,497: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:03.510364421Z [2024-02-24 03:25:03,510: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:25:03.516149891Z [2024-02-24 03:25:03,515: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:03.516203828Z [2024-02-24 03:25:03,516: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:03.516305820Z [2024-02-24 03:25:03,516: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:03.516362038Z [2024-02-24 03:25:03,516: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:25:03.516620728Z [2024-02-24 03:25:03,516: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:25:03.516719954Z [2024-02-24 03:25:03,516: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:03.614000714Z [2024-02-24 03:25:03,613: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:03.646604999Z [2024-02-24 03:25:03,646: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:04.249658947Z [2024-02-24 03:25:04,249: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dbbe2cad-9636-4c6e-bbb6-b44cb408a67b] succeeded in 3.0553154469998844s: None
2024-02-24T03:25:04.993493714Z [2024-02-24 03:25:04,993: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cf11050-8b3f-410e-a8d5-8d7f74102bb1] received
2024-02-24T03:25:05.006681359Z [2024-02-24 03:25:05,006: INFO/ForkPoolWorker-15] [7cf11050-8b3f-410e-a8d5-8d7f74102bb1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:25:05.333365149Z [2024-02-24 03:25:05,330: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:25:05.790269703Z [2024-02-24 03:25:05,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec6b5e55-283e-4bd5-9a55-d73908a50dd1] succeeded in 4.595810765998976s: None
2024-02-24T03:25:06.191822127Z [2024-02-24 03:25:06,191: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[94ec6a26-6b54-4610-9aa3-9b712b43bc21] succeeded in 4.991254952999952s: None
2024-02-24T03:25:06.649265764Z [2024-02-24 03:25:06,648: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:25:06.652662451Z [2024-02-24 03:25:06,652: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:06.685084638Z [2024-02-24 03:25:06,684: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:25:06.687868926Z [2024-02-24 03:25:06,687: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:06.688134461Z [2024-02-24 03:25:06,687: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:06.688664713Z [2024-02-24 03:25:06,688: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:06.688947931Z [2024-02-24 03:25:06,688: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:25:06.689461592Z [2024-02-24 03:25:06,689: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:25:06.689522060Z [2024-02-24 03:25:06,689: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:06.793748055Z [2024-02-24 03:25:06,793: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:07.496334848Z [2024-02-24 03:25:07,495: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7cf11050-8b3f-410e-a8d5-8d7f74102bb1] succeeded in 2.4995652840007097s: None
2024-02-24T03:25:07.522025295Z [2024-02-24 03:25:07,521: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3184e30f-307b-48f5-8ee2-f440d0835bc4] received
2024-02-24T03:25:07.530019038Z [2024-02-24 03:25:07,529: INFO/ForkPoolWorker-15] [3184e30f-307b-48f5-8ee2-f440d0835bc4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:25:07.811628934Z [2024-02-24 03:25:07,808: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:25:08.940938744Z [2024-02-24 03:25:08,940: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:25:08.944220643Z [2024-02-24 03:25:08,943: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:08.973709360Z [2024-02-24 03:25:08,973: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:25:08.976036208Z [2024-02-24 03:25:08,975: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:08.976207189Z [2024-02-24 03:25:08,975: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:08.976522043Z [2024-02-24 03:25:08,976: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:08.976674704Z [2024-02-24 03:25:08,976: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:25:08.977065481Z [2024-02-24 03:25:08,976: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:25:08.977184801Z [2024-02-24 03:25:08,976: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:09.074111552Z [2024-02-24 03:25:09,073: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:09.661647117Z [2024-02-24 03:25:09,661: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3184e30f-307b-48f5-8ee2-f440d0835bc4] succeeded in 2.1379241610011377s: None
2024-02-24T03:25:09.929330271Z [2024-02-24 03:25:09,929: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a6b6a3a7-6549-4deb-ac40-f64a592d8f0c] received
2024-02-24T03:25:09.938282196Z [2024-02-24 03:25:09,938: INFO/ForkPoolWorker-15] [a6b6a3a7-6549-4deb-ac40-f64a592d8f0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:25:10.319699644Z [2024-02-24 03:25:10,316: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:25:11.522031148Z [2024-02-24 03:25:11,521: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:25:11.525408569Z [2024-02-24 03:25:11,524: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:25:11.550745096Z [2024-02-24 03:25:11,550: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:25:11.552510579Z [2024-02-24 03:25:11,552: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:25:11.552755880Z [2024-02-24 03:25:11,552: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:25:11.553045104Z [2024-02-24 03:25:11,552: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:25:11.553070231Z [2024-02-24 03:25:11,552: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:25:11.553417462Z [2024-02-24 03:25:11,553: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:25:11.553629238Z [2024-02-24 03:25:11,553: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:25:11.665481999Z [2024-02-24 03:25:11,665: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:25:12.279008346Z [2024-02-24 03:25:12,278: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a6b6a3a7-6549-4deb-ac40-f64a592d8f0c] succeeded in 2.3452879159995064s: None
2024-02-24T03:26:00.307608640Z [2024-02-24 03:26:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e12dfefb-a7ca-424f-b43a-d4b5f87b8939] received
2024-02-24T03:26:00.313069680Z [2024-02-24 03:26:00,312: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0126bfde-be6f-4a00-9365-0377f8e35514] received
2024-02-24T03:26:00.324183918Z [2024-02-24 03:26:00,323: INFO/ForkPoolWorker-16] [0126bfde-be6f-4a00-9365-0377f8e35514] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:26:00.324371710Z [2024-02-24 03:26:00,324: INFO/ForkPoolWorker-15] [e12dfefb-a7ca-424f-b43a-d4b5f87b8939] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:26:00.327313778Z [2024-02-24 03:26:00,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f85c3395-c643-48b8-8e03-baa85c6ff160] received
2024-02-24T03:26:00.331434904Z [2024-02-24 03:26:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3b6031b5-48f1-4e65-b6e4-4c8e81f0f646] received
2024-02-24T03:26:00.334862601Z [2024-02-24 03:26:00,334: INFO/ForkPoolWorker-1] [f85c3395-c643-48b8-8e03-baa85c6ff160] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:26:00.338343297Z [2024-02-24 03:26:00,338: INFO/ForkPoolWorker-2] [3b6031b5-48f1-4e65-b6e4-4c8e81f0f646] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:26:00.650497523Z [2024-02-24 03:26:00,645: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:26:00.668180283Z [2024-02-24 03:26:00,664: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:26:00.795525741Z [2024-02-24 03:26:00,792: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:26:00.811674701Z [2024-02-24 03:26:00,807: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:26:00.837356068Z [2024-02-24 03:26:00,836: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:26:00.841250392Z [2024-02-24 03:26:00,840: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:26:00.874938408Z [2024-02-24 03:26:00,874: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:26:00.876802283Z [2024-02-24 03:26:00,876: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:26:00.880023688Z [2024-02-24 03:26:00,877: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:26:00.881753960Z [2024-02-24 03:26:00,881: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:26:00.882855363Z [2024-02-24 03:26:00,882: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:26:00.951584500Z [2024-02-24 03:26:00,951: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:26:00.990681957Z [2024-02-24 03:26:00,990: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:26:01.634962215Z [2024-02-24 03:26:01,634: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e12dfefb-a7ca-424f-b43a-d4b5f87b8939] succeeded in 1.3244953329995042s: None
2024-02-24T03:26:01.756095712Z [2024-02-24 03:26:01,755: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3b6031b5-48f1-4e65-b6e4-4c8e81f0f646] succeeded in 1.4233061009999801s: None
2024-02-24T03:26:02.197242170Z [2024-02-24 03:26:02,196: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:26:02.200494734Z [2024-02-24 03:26:02,199: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:26:02.230384101Z [2024-02-24 03:26:02,230: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:26:02.231977041Z [2024-02-24 03:26:02,231: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:26:02.232286451Z [2024-02-24 03:26:02,232: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:26:02.232567254Z [2024-02-24 03:26:02,232: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:26:02.232670021Z [2024-02-24 03:26:02,232: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:26:02.233960695Z [2024-02-24 03:26:02,232: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:26:02.234110170Z [2024-02-24 03:26:02,233: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:26:02.236337466Z [2024-02-24 03:26:02,235: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:26:02.239762644Z [2024-02-24 03:26:02,239: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:26:02.272439513Z [2024-02-24 03:26:02,272: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:26:02.274544063Z [2024-02-24 03:26:02,274: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:26:02.274723122Z [2024-02-24 03:26:02,274: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:26:02.274974250Z [2024-02-24 03:26:02,274: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:26:02.275134194Z [2024-02-24 03:26:02,274: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:26:02.275533409Z [2024-02-24 03:26:02,275: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:26:02.275751910Z [2024-02-24 03:26:02,275: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:26:02.345337207Z [2024-02-24 03:26:02,344: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:26:02.394291497Z [2024-02-24 03:26:02,389: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:26:04.276858147Z [2024-02-24 03:26:04,276: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f85c3395-c643-48b8-8e03-baa85c6ff160] succeeded in 3.9471309910004493s: None
2024-02-24T03:26:04.660840752Z [2024-02-24 03:26:04,658: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0126bfde-be6f-4a00-9365-0377f8e35514] succeeded in 4.343401644000551s: None
2024-02-24T03:27:00.336431222Z [2024-02-24 03:27:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d3f52894-a461-4b64-b32f-7c3b1ba824e0] received
2024-02-24T03:27:00.342401784Z [2024-02-24 03:27:00,342: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd189cbe-c57f-44a1-a44b-c8d4a731b5e5] received
2024-02-24T03:27:00.344841172Z [2024-02-24 03:27:00,344: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c119c70c-e50c-4f48-937d-40ae4a074442] received
2024-02-24T03:27:00.356563842Z [2024-02-24 03:27:00,356: INFO/ForkPoolWorker-16] [dd189cbe-c57f-44a1-a44b-c8d4a731b5e5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:27:00.356878097Z [2024-02-24 03:27:00,355: INFO/ForkPoolWorker-1] [c119c70c-e50c-4f48-937d-40ae4a074442] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:27:00.357518426Z [2024-02-24 03:27:00,356: INFO/ForkPoolWorker-15] [d3f52894-a461-4b64-b32f-7c3b1ba824e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:27:00.641042643Z [2024-02-24 03:27:00,637: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:27:00.648212176Z [2024-02-24 03:27:00,645: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:27:00.693081143Z [2024-02-24 03:27:00,689: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:27:00.799159590Z [2024-02-24 03:27:00,798: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:27:00.803119259Z [2024-02-24 03:27:00,802: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:27:00.832085971Z [2024-02-24 03:27:00,831: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:27:00.833815481Z [2024-02-24 03:27:00,833: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:27:00.834022658Z [2024-02-24 03:27:00,833: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:27:00.834161022Z [2024-02-24 03:27:00,834: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:27:00.834439830Z [2024-02-24 03:27:00,834: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:27:00.926382703Z [2024-02-24 03:27:00,926: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:27:01.502553181Z [2024-02-24 03:27:01,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d3f52894-a461-4b64-b32f-7c3b1ba824e0] succeeded in 1.162401037001473s: None
2024-02-24T03:27:01.860749448Z [2024-02-24 03:27:01,860: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:27:01.864241956Z [2024-02-24 03:27:01,863: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:27:01.887674953Z [2024-02-24 03:27:01,887: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:27:01.889263423Z [2024-02-24 03:27:01,888: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:27:01.889318781Z [2024-02-24 03:27:01,889: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:27:01.889879404Z [2024-02-24 03:27:01,889: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:27:01.890044066Z [2024-02-24 03:27:01,889: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:27:01.890472169Z [2024-02-24 03:27:01,890: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:27:01.890711919Z [2024-02-24 03:27:01,890: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:27:01.999960137Z [2024-02-24 03:27:01,999: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:27:02.003235079Z [2024-02-24 03:27:02,002: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:27:02.013291645Z [2024-02-24 03:27:02,013: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:27:02.027247839Z [2024-02-24 03:27:02,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:27:02.030003656Z [2024-02-24 03:27:02,029: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:27:02.030135127Z [2024-02-24 03:27:02,030: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:27:02.030343115Z [2024-02-24 03:27:02,030: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:27:02.030427951Z [2024-02-24 03:27:02,030: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:27:02.030735507Z [2024-02-24 03:27:02,030: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:27:02.030894020Z [2024-02-24 03:27:02,030: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:27:02.163901496Z [2024-02-24 03:27:02,163: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:27:03.428194196Z [2024-02-24 03:27:03,427: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c119c70c-e50c-4f48-937d-40ae4a074442] succeeded in 3.080875190998995s: None
2024-02-24T03:27:04.071267860Z [2024-02-24 03:27:04,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd189cbe-c57f-44a1-a44b-c8d4a731b5e5] succeeded in 3.726526249998642s: None
2024-02-24T03:28:01.317705747Z [2024-02-24 03:28:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5bb9a71-e632-4ac5-9827-68ef790df62c] received
2024-02-24T03:28:01.321548339Z [2024-02-24 03:28:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00ec61e9-760c-4abb-9734-452143c5db3c] received
2024-02-24T03:28:01.329149224Z [2024-02-24 03:28:01,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f848ee9-52dc-469a-a5f4-e4c8d4760e7b] received
2024-02-24T03:28:01.335381140Z [2024-02-24 03:28:01,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d768ce7e-f8ba-46cf-b326-49cf9018b6e2] received
2024-02-24T03:28:01.335637837Z [2024-02-24 03:28:01,335: INFO/ForkPoolWorker-1] [9f848ee9-52dc-469a-a5f4-e4c8d4760e7b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:28:01.344217884Z [2024-02-24 03:28:01,343: INFO/ForkPoolWorker-2] [d768ce7e-f8ba-46cf-b326-49cf9018b6e2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:28:01.345448086Z [2024-02-24 03:28:01,343: INFO/ForkPoolWorker-16] [00ec61e9-760c-4abb-9734-452143c5db3c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:28:01.346152715Z [2024-02-24 03:28:01,345: INFO/ForkPoolWorker-15] [c5bb9a71-e632-4ac5-9827-68ef790df62c] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:28:01.650633244Z [2024-02-24 03:28:01,647: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:28:01.686057629Z [2024-02-24 03:28:01,682: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:28:01.724144606Z [2024-02-24 03:28:01,720: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:28:01.758030811Z [2024-02-24 03:28:01,754: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:28:01.853448412Z [2024-02-24 03:28:01,853: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:28:01.858625449Z [2024-02-24 03:28:01,858: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:28:01.895124348Z [2024-02-24 03:28:01,894: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:28:01.898362334Z [2024-02-24 03:28:01,898: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:28:01.899109000Z [2024-02-24 03:28:01,898: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:28:01.899201101Z [2024-02-24 03:28:01,899: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:28:01.900070939Z [2024-02-24 03:28:01,899: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:28:02.055207536Z [2024-02-24 03:28:02,054: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:28:02.101050188Z [2024-02-24 03:28:02,100: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:28:02.940627070Z [2024-02-24 03:28:02,940: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[d768ce7e-f8ba-46cf-b326-49cf9018b6e2] succeeded in 1.603673998000886s: None
2024-02-24T03:28:02.950746803Z [2024-02-24 03:28:02,950: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5bb9a71-e632-4ac5-9827-68ef790df62c] succeeded in 1.626999407000767s: None
2024-02-24T03:28:03.444685901Z [2024-02-24 03:28:03,444: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:28:03.448075206Z [2024-02-24 03:28:03,447: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:28:03.469833675Z [2024-02-24 03:28:03,469: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:28:03.471165885Z [2024-02-24 03:28:03,470: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:28:03.471314608Z [2024-02-24 03:28:03,471: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:28:03.471495716Z [2024-02-24 03:28:03,471: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:28:03.471624073Z [2024-02-24 03:28:03,471: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:28:03.471918902Z [2024-02-24 03:28:03,471: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:28:03.472048829Z [2024-02-24 03:28:03,471: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:28:03.486767804Z [2024-02-24 03:28:03,486: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:28:03.490307099Z [2024-02-24 03:28:03,489: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:28:03.508375301Z [2024-02-24 03:28:03,508: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:28:03.509644635Z [2024-02-24 03:28:03,509: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:28:03.509810421Z [2024-02-24 03:28:03,509: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:28:03.510019629Z [2024-02-24 03:28:03,509: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:28:03.510087167Z [2024-02-24 03:28:03,510: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:28:03.510695232Z [2024-02-24 03:28:03,510: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:28:03.510924445Z [2024-02-24 03:28:03,510: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:28:03.582280858Z [2024-02-24 03:28:03,582: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:28:03.675488786Z [2024-02-24 03:28:03,674: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:28:08.481032170Z [2024-02-24 03:28:08,480: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9f848ee9-52dc-469a-a5f4-e4c8d4760e7b] succeeded in 7.150182966999637s: None
2024-02-24T03:28:09.788323627Z [2024-02-24 03:28:09,786: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[00ec61e9-760c-4abb-9734-452143c5db3c] succeeded in 8.458568078998724s: None
2024-02-24T03:29:01.180504375Z [2024-02-24 03:29:01,180: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa982102-ce6b-4325-a945-efce1aeb76fe] received
2024-02-24T03:29:01.189585889Z [2024-02-24 03:29:01,189: INFO/ForkPoolWorker-15] [aa982102-ce6b-4325-a945-efce1aeb76fe] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:29:01.199000980Z [2024-02-24 03:29:01,198: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4c8f407a-ef2d-478f-8c16-e7d75f4bb06d] received
2024-02-24T03:29:01.213956440Z [2024-02-24 03:29:01,211: INFO/ForkPoolWorker-16] [4c8f407a-ef2d-478f-8c16-e7d75f4bb06d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:29:01.218376841Z [2024-02-24 03:29:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[571094dc-2dea-4eb7-bb75-7a9b777e311b] received
2024-02-24T03:29:01.277851021Z [2024-02-24 03:29:01,261: INFO/ForkPoolWorker-1] [571094dc-2dea-4eb7-bb75-7a9b777e311b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:29:01.480884839Z [2024-02-24 03:29:01,477: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:29:01.545654792Z [2024-02-24 03:29:01,539: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:29:01.601000312Z [2024-02-24 03:29:01,597: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:29:01.812442822Z [2024-02-24 03:29:01,812: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:29:01.816911489Z [2024-02-24 03:29:01,816: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:29:01.846365769Z [2024-02-24 03:29:01,846: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:29:01.849189722Z [2024-02-24 03:29:01,848: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:29:01.849428249Z [2024-02-24 03:29:01,849: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:29:01.854789478Z [2024-02-24 03:29:01,854: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:29:01.855104277Z [2024-02-24 03:29:01,854: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:29:01.976541834Z [2024-02-24 03:29:01,976: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:29:02.691612470Z [2024-02-24 03:29:02,690: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[571094dc-2dea-4eb7-bb75-7a9b777e311b] succeeded in 1.4706433529991045s: None
2024-02-24T03:29:02.787457739Z [2024-02-24 03:29:02,787: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:29:02.793239367Z [2024-02-24 03:29:02,792: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:29:02.843518931Z [2024-02-24 03:29:02,843: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:29:02.848739751Z [2024-02-24 03:29:02,847: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:29:02.848953655Z [2024-02-24 03:29:02,848: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:29:02.849260510Z [2024-02-24 03:29:02,848: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:29:02.849362492Z [2024-02-24 03:29:02,849: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:29:02.852338947Z [2024-02-24 03:29:02,849: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:29:02.852434517Z [2024-02-24 03:29:02,852: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:29:02.942298774Z [2024-02-24 03:29:02,942: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:29:02.943997380Z [2024-02-24 03:29:02,943: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:29:02.947264036Z [2024-02-24 03:29:02,946: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:29:02.964100208Z [2024-02-24 03:29:02,963: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:29:02.965490597Z [2024-02-24 03:29:02,965: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:29:02.965988729Z [2024-02-24 03:29:02,965: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:29:02.966243507Z [2024-02-24 03:29:02,966: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:29:02.966364166Z [2024-02-24 03:29:02,966: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:29:02.966960290Z [2024-02-24 03:29:02,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:29:02.967064452Z [2024-02-24 03:29:02,966: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:29:03.063116922Z [2024-02-24 03:29:03,062: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:29:04.856713341Z [2024-02-24 03:29:04,856: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[aa982102-ce6b-4325-a945-efce1aeb76fe] succeeded in 3.6731903060008335s: None
2024-02-24T03:29:05.542529403Z [2024-02-24 03:29:05,541: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4c8f407a-ef2d-478f-8c16-e7d75f4bb06d] succeeded in 4.340918152998711s: None
2024-02-24T03:30:01.182397974Z [2024-02-24 03:30:01,182: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0741dadc-01ea-4dfe-8e90-7d1dd2d8b8f1] received
2024-02-24T03:30:01.185371994Z [2024-02-24 03:30:01,185: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c4effee-1637-4ea9-8308-93a3edd77943] received
2024-02-24T03:30:01.187358785Z [2024-02-24 03:30:01,187: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2b031671-d4ab-44cd-aced-0b0765b48a02] received
2024-02-24T03:30:01.189657835Z [2024-02-24 03:30:01,189: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05664788-d992-4866-9cfd-75caff32c967] received
2024-02-24T03:30:01.193889976Z [2024-02-24 03:30:01,193: INFO/ForkPoolWorker-15] [0741dadc-01ea-4dfe-8e90-7d1dd2d8b8f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:30:01.194846153Z [2024-02-24 03:30:01,194: INFO/ForkPoolWorker-1] [2b031671-d4ab-44cd-aced-0b0765b48a02] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:30:01.195526857Z [2024-02-24 03:30:01,195: INFO/ForkPoolWorker-16] [9c4effee-1637-4ea9-8308-93a3edd77943] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:30:01.199079570Z [2024-02-24 03:30:01,198: INFO/ForkPoolWorker-2] [05664788-d992-4866-9cfd-75caff32c967] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:30:01.203763001Z [2024-02-24 03:30:01,203: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[12f83cd6-a071-4c7f-a93f-9081dafda427] received
2024-02-24T03:30:01.255017987Z [2024-02-24 03:30:01,247: INFO/ForkPoolWorker-3] [12f83cd6-a071-4c7f-a93f-9081dafda427] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:30:01.615011495Z [2024-02-24 03:30:01,611: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:30:01.682437221Z [2024-02-24 03:30:01,658: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:30:01.711384831Z [2024-02-24 03:30:01,708: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:30:01.804152892Z [2024-02-24 03:30:01,800: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:30:01.806484326Z [2024-02-24 03:30:01,797: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:30:02.059969802Z [2024-02-24 03:30:02,059: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T03:30:02.065425188Z [2024-02-24 03:30:02,064: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:02.115747846Z [2024-02-24 03:30:02,115: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T03:30:02.118908700Z [2024-02-24 03:30:02,118: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:30:02.119005342Z [2024-02-24 03:30:02,118: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:30:02.119013643Z [2024-02-24 03:30:02,118: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T03:30:02.119376114Z [2024-02-24 03:30:02,119: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:30:02.234311177Z [2024-02-24 03:30:02,234: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:02.257166361Z [2024-02-24 03:30:02,256: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:03.327998691Z [2024-02-24 03:30:03,327: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05664788-d992-4866-9cfd-75caff32c967] succeeded in 2.135782683000798s: None
2024-02-24T03:30:03.364196671Z [2024-02-24 03:30:03,363: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[12f83cd6-a071-4c7f-a93f-9081dafda427] succeeded in 2.152186654000616s: None
2024-02-24T03:30:03.835753395Z [2024-02-24 03:30:03,835: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:30:03.842859466Z [2024-02-24 03:30:03,840: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:03.867165786Z [2024-02-24 03:30:03,866: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:30:03.868912788Z [2024-02-24 03:30:03,868: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:03.869035716Z [2024-02-24 03:30:03,868: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:03.869313840Z [2024-02-24 03:30:03,869: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:03.869424889Z [2024-02-24 03:30:03,869: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:30:03.869727008Z [2024-02-24 03:30:03,869: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:30:03.870243741Z [2024-02-24 03:30:03,869: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:03.892004134Z [2024-02-24 03:30:03,891: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:30:03.895755529Z [2024-02-24 03:30:03,895: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:03.942229738Z [2024-02-24 03:30:03,941: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:30:03.945476289Z [2024-02-24 03:30:03,944: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:03.945507867Z [2024-02-24 03:30:03,945: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:03.945515158Z [2024-02-24 03:30:03,945: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:03.945524366Z [2024-02-24 03:30:03,945: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:30:03.945588761Z [2024-02-24 03:30:03,945: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:30:03.945618526Z [2024-02-24 03:30:03,945: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:03.976563306Z [2024-02-24 03:30:03,976: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:04.043527579Z [2024-02-24 03:30:04,043: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:04.082764211Z [2024-02-24 03:30:04,082: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:30:04.086464889Z [2024-02-24 03:30:04,085: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:04.119155655Z [2024-02-24 03:30:04,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:30:04.120974403Z [2024-02-24 03:30:04,120: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:04.121158154Z [2024-02-24 03:30:04,120: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:04.121544333Z [2024-02-24 03:30:04,121: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:04.121707853Z [2024-02-24 03:30:04,121: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:30:04.122098107Z [2024-02-24 03:30:04,121: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:30:04.122705525Z [2024-02-24 03:30:04,122: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:04.229396138Z [2024-02-24 03:30:04,229: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:04.686805153Z [2024-02-24 03:30:04,686: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2b031671-d4ab-44cd-aced-0b0765b48a02] succeeded in 3.4979170100014016s: None
2024-02-24T03:30:05.024366726Z [2024-02-24 03:30:05,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f71bb301-ae22-4f99-b5c4-a02c669b8233] received
2024-02-24T03:30:05.038649012Z [2024-02-24 03:30:05,038: INFO/ForkPoolWorker-1] [f71bb301-ae22-4f99-b5c4-a02c669b8233] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:30:05.331546730Z [2024-02-24 03:30:05,328: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:30:05.576681962Z [2024-02-24 03:30:05,576: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9c4effee-1637-4ea9-8308-93a3edd77943] succeeded in 4.388854629998605s: None
2024-02-24T03:30:06.271777347Z [2024-02-24 03:30:06,271: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0741dadc-01ea-4dfe-8e90-7d1dd2d8b8f1] succeeded in 5.087011096999049s: None
2024-02-24T03:30:06.548315798Z [2024-02-24 03:30:06,547: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:30:06.552706578Z [2024-02-24 03:30:06,551: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:06.581636378Z [2024-02-24 03:30:06,581: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:30:06.583885715Z [2024-02-24 03:30:06,583: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:06.584180738Z [2024-02-24 03:30:06,583: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:06.584493598Z [2024-02-24 03:30:06,584: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:06.584737922Z [2024-02-24 03:30:06,584: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:30:06.585357023Z [2024-02-24 03:30:06,585: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:30:06.585624611Z [2024-02-24 03:30:06,585: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:06.696403184Z [2024-02-24 03:30:06,695: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:07.326850182Z [2024-02-24 03:30:07,326: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f71bb301-ae22-4f99-b5c4-a02c669b8233] succeeded in 2.2975001509985304s: None
2024-02-24T03:30:07.520870970Z [2024-02-24 03:30:07,520: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[006f834e-4124-40f3-a302-fc9c2b6cdbb6] received
2024-02-24T03:30:07.529733989Z [2024-02-24 03:30:07,529: INFO/ForkPoolWorker-15] [006f834e-4124-40f3-a302-fc9c2b6cdbb6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:30:07.809068928Z [2024-02-24 03:30:07,805: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:30:08.924387862Z [2024-02-24 03:30:08,923: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:30:08.927692151Z [2024-02-24 03:30:08,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:08.942936185Z [2024-02-24 03:30:08,942: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:30:08.944810019Z [2024-02-24 03:30:08,944: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:08.944837914Z [2024-02-24 03:30:08,944: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:08.945014488Z [2024-02-24 03:30:08,944: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:08.945154277Z [2024-02-24 03:30:08,944: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:30:08.945537350Z [2024-02-24 03:30:08,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:30:08.945751919Z [2024-02-24 03:30:08,945: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:09.030990456Z [2024-02-24 03:30:09,030: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:10.611771417Z [2024-02-24 03:30:10,611: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[006f834e-4124-40f3-a302-fc9c2b6cdbb6] succeeded in 3.0889767259996006s: None
2024-02-24T03:30:11.338988526Z [2024-02-24 03:30:11,338: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7949c671-7801-4c13-90fa-edd89a3db699] received
2024-02-24T03:30:11.352392325Z [2024-02-24 03:30:11,351: INFO/ForkPoolWorker-15] [7949c671-7801-4c13-90fa-edd89a3db699] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:30:11.650683048Z [2024-02-24 03:30:11,646: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:30:12.844581625Z [2024-02-24 03:30:12,844: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:30:12.847999504Z [2024-02-24 03:30:12,847: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:30:12.879025149Z [2024-02-24 03:30:12,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:30:12.880306649Z [2024-02-24 03:30:12,880: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:30:12.880437005Z [2024-02-24 03:30:12,880: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:30:12.880669267Z [2024-02-24 03:30:12,880: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:30:12.880806471Z [2024-02-24 03:30:12,880: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:30:12.881116341Z [2024-02-24 03:30:12,880: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:30:12.881227334Z [2024-02-24 03:30:12,881: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:30:12.959017197Z [2024-02-24 03:30:12,958: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:30:13.553512844Z [2024-02-24 03:30:13,553: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7949c671-7801-4c13-90fa-edd89a3db699] succeeded in 2.21161042499989s: None
2024-02-24T03:31:00.277494279Z [2024-02-24 03:31:00,277: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8530a004-27fb-4c0b-89fd-b6c2ae4d2d42] received
2024-02-24T03:31:00.285469530Z [2024-02-24 03:31:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92d08d74-c984-45bf-8e3e-c6b16e45ef24] received
2024-02-24T03:31:00.288585184Z [2024-02-24 03:31:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9100e571-561b-463c-91fb-470687351edd] received
2024-02-24T03:31:00.288818697Z [2024-02-24 03:31:00,288: INFO/ForkPoolWorker-15] [8530a004-27fb-4c0b-89fd-b6c2ae4d2d42] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:31:00.308494977Z [2024-02-24 03:31:00,308: INFO/ForkPoolWorker-16] [92d08d74-c984-45bf-8e3e-c6b16e45ef24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:31:00.313907070Z [2024-02-24 03:31:00,313: INFO/ForkPoolWorker-1] [9100e571-561b-463c-91fb-470687351edd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:31:00.655600263Z [2024-02-24 03:31:00,652: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:31:00.664301957Z [2024-02-24 03:31:00,659: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:31:00.815997321Z [2024-02-24 03:31:00,812: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:31:00.999659003Z [2024-02-24 03:31:00,999: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:31:01.003776447Z [2024-02-24 03:31:01,003: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:31:01.036313583Z [2024-02-24 03:31:01,036: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:31:01.038232821Z [2024-02-24 03:31:01,038: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:31:01.038297003Z [2024-02-24 03:31:01,038: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:31:01.038359401Z [2024-02-24 03:31:01,038: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:31:01.038544440Z [2024-02-24 03:31:01,038: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:31:01.176539114Z [2024-02-24 03:31:01,176: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:31:02.013243899Z [2024-02-24 03:31:02,012: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9100e571-561b-463c-91fb-470687351edd] succeeded in 1.7222170260010898s: None
2024-02-24T03:31:02.058844188Z [2024-02-24 03:31:02,058: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:31:02.062286538Z [2024-02-24 03:31:02,061: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:31:02.087879822Z [2024-02-24 03:31:02,087: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:31:02.092676245Z [2024-02-24 03:31:02,092: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:31:02.092701457Z [2024-02-24 03:31:02,092: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:31:02.092930839Z [2024-02-24 03:31:02,092: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:31:02.093014120Z [2024-02-24 03:31:02,092: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:31:02.093372104Z [2024-02-24 03:31:02,093: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:31:02.093386953Z [2024-02-24 03:31:02,093: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:31:02.197720439Z [2024-02-24 03:31:02,197: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:31:02.216001487Z [2024-02-24 03:31:02,215: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:31:02.219294059Z [2024-02-24 03:31:02,218: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:31:02.244260074Z [2024-02-24 03:31:02,243: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:31:02.246056859Z [2024-02-24 03:31:02,245: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:31:02.246083734Z [2024-02-24 03:31:02,245: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:31:02.246200545Z [2024-02-24 03:31:02,246: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:31:02.246213925Z [2024-02-24 03:31:02,246: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:31:02.246562973Z [2024-02-24 03:31:02,246: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:31:02.246587804Z [2024-02-24 03:31:02,246: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:31:02.334118851Z [2024-02-24 03:31:02,333: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:31:04.333137270Z [2024-02-24 03:31:04,332: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[92d08d74-c984-45bf-8e3e-c6b16e45ef24] succeeded in 4.044797885000662s: None
2024-02-24T03:31:05.059103426Z [2024-02-24 03:31:05,058: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8530a004-27fb-4c0b-89fd-b6c2ae4d2d42] succeeded in 4.780042266998862s: None
2024-02-24T03:32:00.576426492Z [2024-02-24 03:32:00,576: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1522587-6d14-4f9f-be0b-00f45b2f30f1] received
2024-02-24T03:32:00.581221867Z [2024-02-24 03:32:00,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[016dd26a-05bb-422e-a1b6-3bf495897ca5] received
2024-02-24T03:32:00.585685969Z [2024-02-24 03:32:00,585: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[85f11f66-563f-4400-999d-c38b6529268d] received
2024-02-24T03:32:00.588139326Z [2024-02-24 03:32:00,587: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fa9de7a3-6a68-48f3-b03d-aa836753478d] received
2024-02-24T03:32:00.590523375Z [2024-02-24 03:32:00,590: INFO/ForkPoolWorker-15] [e1522587-6d14-4f9f-be0b-00f45b2f30f1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:32:00.598965250Z [2024-02-24 03:32:00,598: INFO/ForkPoolWorker-16] [016dd26a-05bb-422e-a1b6-3bf495897ca5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:32:00.610838253Z [2024-02-24 03:32:00,610: INFO/ForkPoolWorker-1] [85f11f66-563f-4400-999d-c38b6529268d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:32:00.612181599Z [2024-02-24 03:32:00,611: INFO/ForkPoolWorker-2] [fa9de7a3-6a68-48f3-b03d-aa836753478d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:32:00.917681028Z [2024-02-24 03:32:00,908: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:32:01.016180903Z [2024-02-24 03:32:01,011: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:32:01.067506034Z [2024-02-24 03:32:01,063: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:32:01.114417564Z [2024-02-24 03:32:01,113: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:32:01.118576147Z [2024-02-24 03:32:01,118: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:32:01.125757338Z [2024-02-24 03:32:01,121: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:32:01.149389619Z [2024-02-24 03:32:01,149: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:32:01.150701406Z [2024-02-24 03:32:01,150: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:32:01.150769104Z [2024-02-24 03:32:01,150: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:32:01.150900625Z [2024-02-24 03:32:01,150: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:32:01.151160348Z [2024-02-24 03:32:01,151: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:32:01.246347842Z [2024-02-24 03:32:01,245: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:32:01.397520048Z [2024-02-24 03:32:01,397: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:32:02.071307536Z [2024-02-24 03:32:02,070: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[016dd26a-05bb-422e-a1b6-3bf495897ca5] succeeded in 1.4881637660000706s: None
2024-02-24T03:32:02.137445339Z [2024-02-24 03:32:02,136: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[85f11f66-563f-4400-999d-c38b6529268d] succeeded in 1.5490043949994288s: None
2024-02-24T03:32:02.683072121Z [2024-02-24 03:32:02,682: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:32:02.689861817Z [2024-02-24 03:32:02,686: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:32:02.837919098Z [2024-02-24 03:32:02,834: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:32:02.864602545Z [2024-02-24 03:32:02,858: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:32:02.864630314Z [2024-02-24 03:32:02,858: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:32:02.864635534Z [2024-02-24 03:32:02,859: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:32:02.864639897Z [2024-02-24 03:32:02,859: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:32:02.864643724Z [2024-02-24 03:32:02,859: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:32:02.864664645Z [2024-02-24 03:32:02,862: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:32:02.945405863Z [2024-02-24 03:32:02,945: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:32:03.097985348Z [2024-02-24 03:32:03,097: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:32:03.101253322Z [2024-02-24 03:32:03,100: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:32:03.118780743Z [2024-02-24 03:32:03,118: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:32:03.120021087Z [2024-02-24 03:32:03,119: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:32:03.120111140Z [2024-02-24 03:32:03,120: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:32:03.120271542Z [2024-02-24 03:32:03,120: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:32:03.120357468Z [2024-02-24 03:32:03,120: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:32:03.120624880Z [2024-02-24 03:32:03,120: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:32:03.120752082Z [2024-02-24 03:32:03,120: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:32:03.203439979Z [2024-02-24 03:32:03,203: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:32:04.852559441Z [2024-02-24 03:32:04,852: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1522587-6d14-4f9f-be0b-00f45b2f30f1] succeeded in 4.27306264300023s: None
2024-02-24T03:32:05.024853459Z [2024-02-24 03:32:05,024: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[fa9de7a3-6a68-48f3-b03d-aa836753478d] succeeded in 4.431775551000101s: None
2024-02-24T03:33:00.827327658Z [2024-02-24 03:33:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0780ed71-a986-442d-bed8-35197d4f882f] received
2024-02-24T03:33:00.831636334Z [2024-02-24 03:33:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c63047b-753b-427e-bb8e-c9f98509124d] received
2024-02-24T03:33:00.834076049Z [2024-02-24 03:33:00,833: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ecda74f-e7c1-4186-8975-a90a70143821] received
2024-02-24T03:33:00.834519267Z [2024-02-24 03:33:00,834: INFO/ForkPoolWorker-15] [0780ed71-a986-442d-bed8-35197d4f882f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:33:00.842833288Z [2024-02-24 03:33:00,842: INFO/ForkPoolWorker-1] [7ecda74f-e7c1-4186-8975-a90a70143821] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:33:00.846192778Z [2024-02-24 03:33:00,845: INFO/ForkPoolWorker-16] [8c63047b-753b-427e-bb8e-c9f98509124d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:33:01.185553909Z [2024-02-24 03:33:01,182: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:33:01.217922149Z [2024-02-24 03:33:01,210: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:33:01.309610362Z [2024-02-24 03:33:01,306: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:33:01.407080239Z [2024-02-24 03:33:01,406: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:33:01.411230047Z [2024-02-24 03:33:01,410: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:33:01.438281902Z [2024-02-24 03:33:01,438: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:33:01.440220689Z [2024-02-24 03:33:01,439: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:33:01.440411495Z [2024-02-24 03:33:01,440: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:33:01.440522288Z [2024-02-24 03:33:01,440: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:33:01.440875939Z [2024-02-24 03:33:01,440: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:33:01.560350360Z [2024-02-24 03:33:01,560: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:33:02.344589191Z [2024-02-24 03:33:02,343: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0780ed71-a986-442d-bed8-35197d4f882f] succeeded in 1.515319141000873s: None
2024-02-24T03:33:02.474701994Z [2024-02-24 03:33:02,474: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:33:02.478058900Z [2024-02-24 03:33:02,477: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:33:02.505741266Z [2024-02-24 03:33:02,505: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:33:02.507471488Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:33:02.507495835Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:33:02.507604679Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:33:02.507629172Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:33:02.507928041Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:33:02.507937719Z [2024-02-24 03:33:02,507: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:33:02.596137612Z [2024-02-24 03:33:02,595: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:33:02.725249942Z [2024-02-24 03:33:02,724: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:33:02.737146586Z [2024-02-24 03:33:02,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:33:02.776516328Z [2024-02-24 03:33:02,776: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:33:02.778471029Z [2024-02-24 03:33:02,778: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:33:02.782031331Z [2024-02-24 03:33:02,778: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:33:02.782234595Z [2024-02-24 03:33:02,781: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:33:02.782275782Z [2024-02-24 03:33:02,782: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:33:02.782522103Z [2024-02-24 03:33:02,782: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:33:02.782565649Z [2024-02-24 03:33:02,782: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:33:02.897685984Z [2024-02-24 03:33:02,897: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:33:04.375095485Z [2024-02-24 03:33:04,374: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7ecda74f-e7c1-4186-8975-a90a70143821] succeeded in 3.5382395120013825s: None
2024-02-24T03:33:04.649954177Z [2024-02-24 03:33:04,649: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8c63047b-753b-427e-bb8e-c9f98509124d] succeeded in 3.813821036999798s: None
2024-02-24T03:34:00.767947076Z [2024-02-24 03:34:00,767: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a7d8177-a107-4e95-aacf-e203b4bbbfe6] received
2024-02-24T03:34:00.776854376Z [2024-02-24 03:34:00,776: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b0ae5865-4f82-4669-848f-1236f3414f4a] received
2024-02-24T03:34:00.783196534Z [2024-02-24 03:34:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[18159417-d6e1-4241-a3db-5e740b135e83] received
2024-02-24T03:34:00.785432012Z [2024-02-24 03:34:00,783: INFO/ForkPoolWorker-15] [5a7d8177-a107-4e95-aacf-e203b4bbbfe6] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:34:00.789105463Z [2024-02-24 03:34:00,788: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[369223cc-0e7b-45ad-8055-ab5ec45de018] received
2024-02-24T03:34:00.790674420Z [2024-02-24 03:34:00,790: INFO/ForkPoolWorker-1] [18159417-d6e1-4241-a3db-5e740b135e83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:34:00.799213839Z [2024-02-24 03:34:00,798: INFO/ForkPoolWorker-2] [369223cc-0e7b-45ad-8055-ab5ec45de018] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:34:00.799695759Z [2024-02-24 03:34:00,799: INFO/ForkPoolWorker-16] [b0ae5865-4f82-4669-848f-1236f3414f4a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:34:01.171465146Z [2024-02-24 03:34:01,167: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:34:01.312480436Z [2024-02-24 03:34:01,308: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:34:01.418349014Z [2024-02-24 03:34:01,410: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:34:01.447938730Z [2024-02-24 03:34:01,429: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:34:01.664607467Z [2024-02-24 03:34:01,664: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:34:01.673428423Z [2024-02-24 03:34:01,672: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:34:01.707623612Z [2024-02-24 03:34:01,707: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:34:01.709081756Z [2024-02-24 03:34:01,708: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:34:01.709683010Z [2024-02-24 03:34:01,709: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:34:01.710240195Z [2024-02-24 03:34:01,710: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:34:01.710860313Z [2024-02-24 03:34:01,710: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:34:01.891374128Z [2024-02-24 03:34:01,891: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:34:01.894540458Z [2024-02-24 03:34:01,894: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:34:02.737889618Z [2024-02-24 03:34:02,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5a7d8177-a107-4e95-aacf-e203b4bbbfe6] succeeded in 1.9655237970000599s: None
2024-02-24T03:34:02.850872332Z [2024-02-24 03:34:02,850: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[369223cc-0e7b-45ad-8055-ab5ec45de018] succeeded in 2.0601384040000994s: None
2024-02-24T03:34:03.015894392Z [2024-02-24 03:34:03,015: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:34:03.019292289Z [2024-02-24 03:34:03,018: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:34:03.041718682Z [2024-02-24 03:34:03,041: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:34:03.043103389Z [2024-02-24 03:34:03,042: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:34:03.043175716Z [2024-02-24 03:34:03,043: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:34:03.043298493Z [2024-02-24 03:34:03,043: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:34:03.043389141Z [2024-02-24 03:34:03,043: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:34:03.043723459Z [2024-02-24 03:34:03,043: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:34:03.043819666Z [2024-02-24 03:34:03,043: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:34:03.165801149Z [2024-02-24 03:34:03,165: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:34:03.495599206Z [2024-02-24 03:34:03,495: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:34:03.499402807Z [2024-02-24 03:34:03,498: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:34:03.517278605Z [2024-02-24 03:34:03,517: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:34:03.519585164Z [2024-02-24 03:34:03,518: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:34:03.519614072Z [2024-02-24 03:34:03,518: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:34:03.519618624Z [2024-02-24 03:34:03,518: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:34:03.519622554Z [2024-02-24 03:34:03,519: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:34:03.519625631Z [2024-02-24 03:34:03,519: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:34:03.519633840Z [2024-02-24 03:34:03,519: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:34:03.620323456Z [2024-02-24 03:34:03,620: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:34:05.023625690Z [2024-02-24 03:34:05,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[18159417-d6e1-4241-a3db-5e740b135e83] succeeded in 4.2391126429993164s: None
2024-02-24T03:34:05.772047250Z [2024-02-24 03:34:05,771: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b0ae5865-4f82-4669-848f-1236f3414f4a] succeeded in 4.992944211999202s: None
2024-02-24T03:35:00.899441745Z [2024-02-24 03:35:00,898: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9c6fe0c9-1990-49cb-980a-4b35721d05f5] received
2024-02-24T03:35:00.903231284Z [2024-02-24 03:35:00,902: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff4f8b69-2e64-447a-b8fa-706e7e8c8d2d] received
2024-02-24T03:35:00.905870327Z [2024-02-24 03:35:00,905: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdcadf0f-79a3-4040-9aa2-288cab120ced] received
2024-02-24T03:35:00.909044922Z [2024-02-24 03:35:00,908: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bea9d75f-9577-46ec-b321-cb867a6fcc9d] received
2024-02-24T03:35:00.909346360Z [2024-02-24 03:35:00,909: INFO/ForkPoolWorker-15] [9c6fe0c9-1990-49cb-980a-4b35721d05f5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:35:00.916047770Z [2024-02-24 03:35:00,915: INFO/ForkPoolWorker-2] [bea9d75f-9577-46ec-b321-cb867a6fcc9d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:35:00.920974080Z [2024-02-24 03:35:00,920: INFO/ForkPoolWorker-1] [fdcadf0f-79a3-4040-9aa2-288cab120ced] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:35:00.921406847Z [2024-02-24 03:35:00,921: INFO/ForkPoolWorker-16] [ff4f8b69-2e64-447a-b8fa-706e7e8c8d2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:35:01.313952924Z [2024-02-24 03:35:01,306: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:35:01.346833350Z [2024-02-24 03:35:01,342: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:35:01.415492780Z [2024-02-24 03:35:01,412: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:35:01.430669478Z [2024-02-24 03:35:01,427: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:35:01.605026949Z [2024-02-24 03:35:01,604: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:35:01.609203137Z [2024-02-24 03:35:01,608: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:01.656613955Z [2024-02-24 03:35:01,656: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:35:01.657853206Z [2024-02-24 03:35:01,657: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:35:01.657996641Z [2024-02-24 03:35:01,657: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:35:01.658096201Z [2024-02-24 03:35:01,657: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:35:01.658334348Z [2024-02-24 03:35:01,658: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:35:01.742625250Z [2024-02-24 03:35:01,742: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:02.558461640Z [2024-02-24 03:35:02,558: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fdcadf0f-79a3-4040-9aa2-288cab120ced] succeeded in 1.6487562010006513s: None
2024-02-24T03:35:02.845877705Z [2024-02-24 03:35:02,845: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:35:02.849436732Z [2024-02-24 03:35:02,849: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:02.908786673Z [2024-02-24 03:35:02,908: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:35:02.916167497Z [2024-02-24 03:35:02,915: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:02.916443210Z [2024-02-24 03:35:02,916: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:02.916720187Z [2024-02-24 03:35:02,916: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:02.917053356Z [2024-02-24 03:35:02,916: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:35:02.917521046Z [2024-02-24 03:35:02,917: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:35:02.917730492Z [2024-02-24 03:35:02,917: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:03.010688298Z [2024-02-24 03:35:03,010: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:03.063103026Z [2024-02-24 03:35:03,062: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:35:03.066853843Z [2024-02-24 03:35:03,066: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:03.094288733Z [2024-02-24 03:35:03,094: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:35:03.095617647Z [2024-02-24 03:35:03,095: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:03.095638031Z [2024-02-24 03:35:03,095: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:03.095899457Z [2024-02-24 03:35:03,095: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:03.095954496Z [2024-02-24 03:35:03,095: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:35:03.096171547Z [2024-02-24 03:35:03,096: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:35:03.096223304Z [2024-02-24 03:35:03,096: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:03.105899463Z [2024-02-24 03:35:03,105: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:35:03.111238174Z [2024-02-24 03:35:03,110: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:03.159820344Z [2024-02-24 03:35:03,159: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:35:03.161694920Z [2024-02-24 03:35:03,161: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:03.161901688Z [2024-02-24 03:35:03,161: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:03.162091834Z [2024-02-24 03:35:03,161: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:03.162188971Z [2024-02-24 03:35:03,162: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:35:03.162504426Z [2024-02-24 03:35:03,162: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:35:03.162609287Z [2024-02-24 03:35:03,162: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:03.189997371Z [2024-02-24 03:35:03,189: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:03.277568959Z [2024-02-24 03:35:03,277: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:03.661185113Z [2024-02-24 03:35:03,660: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b1333be-341f-4676-8f80-26c4242c30bd] received
2024-02-24T03:35:03.673290650Z [2024-02-24 03:35:03,673: INFO/ForkPoolWorker-1] [9b1333be-341f-4676-8f80-26c4242c30bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:35:03.730607480Z [2024-02-24 03:35:03,730: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9c6fe0c9-1990-49cb-980a-4b35721d05f5] succeeded in 2.82871631099988s: None
2024-02-24T03:35:04.065471197Z [2024-02-24 03:35:04,062: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:35:05.191295178Z [2024-02-24 03:35:05,190: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:35:05.194734759Z [2024-02-24 03:35:05,194: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:05.232900292Z [2024-02-24 03:35:05,232: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:35:05.237094356Z [2024-02-24 03:35:05,236: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:05.237110004Z [2024-02-24 03:35:05,236: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:05.237289221Z [2024-02-24 03:35:05,236: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:05.237294316Z [2024-02-24 03:35:05,237: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:35:05.237990829Z [2024-02-24 03:35:05,237: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:35:05.238015758Z [2024-02-24 03:35:05,237: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:05.243151018Z [2024-02-24 03:35:05,242: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bea9d75f-9577-46ec-b321-cb867a6fcc9d] succeeded in 4.332380544999978s: None
2024-02-24T03:35:05.326117036Z [2024-02-24 03:35:05,325: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:05.347108004Z [2024-02-24 03:35:05,346: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ff4f8b69-2e64-447a-b8fa-706e7e8c8d2d] succeeded in 4.440036298999985s: None
2024-02-24T03:35:05.933935270Z [2024-02-24 03:35:05,933: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6cc042a9-23bb-49dd-8c96-a5cf7c3038fa] received
2024-02-24T03:35:05.944799456Z [2024-02-24 03:35:05,944: INFO/ForkPoolWorker-15] [6cc042a9-23bb-49dd-8c96-a5cf7c3038fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:35:06.010468565Z [2024-02-24 03:35:06,010: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9b1333be-341f-4676-8f80-26c4242c30bd] succeeded in 2.346852136999587s: None
2024-02-24T03:35:06.232098865Z [2024-02-24 03:35:06,229: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:35:07.374024952Z [2024-02-24 03:35:07,372: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:35:07.377179634Z [2024-02-24 03:35:07,376: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:07.399671826Z [2024-02-24 03:35:07,399: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:35:07.401129177Z [2024-02-24 03:35:07,400: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:07.401270026Z [2024-02-24 03:35:07,401: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:07.401451936Z [2024-02-24 03:35:07,401: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:07.401553584Z [2024-02-24 03:35:07,401: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:35:07.401891695Z [2024-02-24 03:35:07,401: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:35:07.401996235Z [2024-02-24 03:35:07,401: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:07.489823234Z [2024-02-24 03:35:07,489: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:09.199201061Z [2024-02-24 03:35:09,198: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6cc042a9-23bb-49dd-8c96-a5cf7c3038fa] succeeded in 3.2622005329994863s: None
2024-02-24T03:35:09.395921911Z [2024-02-24 03:35:09,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e77fb49a-bf37-4efe-a846-34d73862f0c2] received
2024-02-24T03:35:09.408737478Z [2024-02-24 03:35:09,408: INFO/ForkPoolWorker-15] [e77fb49a-bf37-4efe-a846-34d73862f0c2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:35:09.682690054Z [2024-02-24 03:35:09,679: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:35:10.806087373Z [2024-02-24 03:35:10,805: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:35:10.809201297Z [2024-02-24 03:35:10,808: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:35:10.833400248Z [2024-02-24 03:35:10,833: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:35:10.835499472Z [2024-02-24 03:35:10,834: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:35:10.835517204Z [2024-02-24 03:35:10,835: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:35:10.835648920Z [2024-02-24 03:35:10,835: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:35:10.835852381Z [2024-02-24 03:35:10,835: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:35:10.836368276Z [2024-02-24 03:35:10,836: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:35:10.836576016Z [2024-02-24 03:35:10,836: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:35:10.934021569Z [2024-02-24 03:35:10,933: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:35:11.562247776Z [2024-02-24 03:35:11,561: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e77fb49a-bf37-4efe-a846-34d73862f0c2] succeeded in 2.163041878999138s: None
2024-02-24T03:36:00.683157495Z [2024-02-24 03:36:00,682: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ab6f8d75-da70-45a2-b3cf-3787db134e41] received
2024-02-24T03:36:00.685273526Z [2024-02-24 03:36:00,684: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b17b6156-f8fc-4c30-8212-d321492d0ede] received
2024-02-24T03:36:00.695814834Z [2024-02-24 03:36:00,694: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d1f0986a-6df1-4868-bda5-0d619281057c] received
2024-02-24T03:36:00.696157645Z [2024-02-24 03:36:00,695: INFO/ForkPoolWorker-15] [ab6f8d75-da70-45a2-b3cf-3787db134e41] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:36:00.700351700Z [2024-02-24 03:36:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05c091aa-5629-4c2b-a34e-d20925c3ba15] received
2024-02-24T03:36:00.701076094Z [2024-02-24 03:36:00,700: INFO/ForkPoolWorker-16] [b17b6156-f8fc-4c30-8212-d321492d0ede] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:36:00.703837616Z [2024-02-24 03:36:00,703: INFO/ForkPoolWorker-1] [d1f0986a-6df1-4868-bda5-0d619281057c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:36:00.709946524Z [2024-02-24 03:36:00,709: INFO/ForkPoolWorker-2] [05c091aa-5629-4c2b-a34e-d20925c3ba15] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:36:01.042215438Z [2024-02-24 03:36:01,038: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:36:01.056322410Z [2024-02-24 03:36:01,053: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:36:01.128789771Z [2024-02-24 03:36:01,125: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:36:01.249900342Z [2024-02-24 03:36:01,235: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:36:01.457607060Z [2024-02-24 03:36:01,457: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:36:01.463380037Z [2024-02-24 03:36:01,462: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:36:01.490055405Z [2024-02-24 03:36:01,489: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:36:01.491108468Z [2024-02-24 03:36:01,490: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:36:01.491199474Z [2024-02-24 03:36:01,491: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:36:01.491305963Z [2024-02-24 03:36:01,491: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:36:01.491539609Z [2024-02-24 03:36:01,491: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:36:01.517718048Z [2024-02-24 03:36:01,517: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:36:01.637848433Z [2024-02-24 03:36:01,636: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:36:02.177958313Z [2024-02-24 03:36:02,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ab6f8d75-da70-45a2-b3cf-3787db134e41] succeeded in 1.4911249779997888s: None
2024-02-24T03:36:02.324565315Z [2024-02-24 03:36:02,324: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[05c091aa-5629-4c2b-a34e-d20925c3ba15] succeeded in 1.6213334950007265s: None
2024-02-24T03:36:02.645423501Z [2024-02-24 03:36:02,645: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:36:02.648979568Z [2024-02-24 03:36:02,648: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:36:02.681226261Z [2024-02-24 03:36:02,680: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:36:02.684411443Z [2024-02-24 03:36:02,683: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:36:02.714272953Z [2024-02-24 03:36:02,713: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:36:02.717926618Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:36:02.717950784Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:36:02.717957187Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:36:02.717963079Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:36:02.717967980Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:36:02.717973061Z [2024-02-24 03:36:02,715: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:36:02.741851187Z [2024-02-24 03:36:02,738: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:36:02.787245347Z [2024-02-24 03:36:02,774: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:36:02.787267367Z [2024-02-24 03:36:02,774: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:36:02.787274559Z [2024-02-24 03:36:02,774: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:36:02.787299973Z [2024-02-24 03:36:02,774: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:36:02.787304818Z [2024-02-24 03:36:02,775: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:36:02.787308141Z [2024-02-24 03:36:02,775: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:36:02.869203293Z [2024-02-24 03:36:02,868: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:36:02.907285360Z [2024-02-24 03:36:02,906: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:36:05.048923905Z [2024-02-24 03:36:05,048: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d1f0986a-6df1-4868-bda5-0d619281057c] succeeded in 4.351355500999489s: None
2024-02-24T03:36:05.723679479Z [2024-02-24 03:36:05,723: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b17b6156-f8fc-4c30-8212-d321492d0ede] succeeded in 5.03444780800055s: None
2024-02-24T03:37:00.934454694Z [2024-02-24 03:37:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7919cfda-89e2-4dc2-bfd7-ef70afdb67bd] received
2024-02-24T03:37:00.947456328Z [2024-02-24 03:37:00,947: INFO/ForkPoolWorker-15] [7919cfda-89e2-4dc2-bfd7-ef70afdb67bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:37:00.949692394Z [2024-02-24 03:37:00,949: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5b6600c5-89f0-4103-9248-04c14457c0dc] received
2024-02-24T03:37:00.959003573Z [2024-02-24 03:37:00,958: INFO/ForkPoolWorker-16] [5b6600c5-89f0-4103-9248-04c14457c0dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:37:00.978884515Z [2024-02-24 03:37:00,978: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a01dd09-6e9c-4ae4-8267-0333a43d999d] received
2024-02-24T03:37:00.996023009Z [2024-02-24 03:37:00,995: INFO/ForkPoolWorker-1] [4a01dd09-6e9c-4ae4-8267-0333a43d999d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:37:01.484173277Z [2024-02-24 03:37:01,480: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:37:01.492189352Z [2024-02-24 03:37:01,489: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:37:01.502664949Z [2024-02-24 03:37:01,499: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:37:01.662772398Z [2024-02-24 03:37:01,662: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:37:01.667918067Z [2024-02-24 03:37:01,667: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:37:01.711568299Z [2024-02-24 03:37:01,711: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:37:01.722183638Z [2024-02-24 03:37:01,721: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:37:01.726106471Z [2024-02-24 03:37:01,722: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:37:01.726202585Z [2024-02-24 03:37:01,726: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:37:01.726535895Z [2024-02-24 03:37:01,726: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:37:01.861937934Z [2024-02-24 03:37:01,861: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:37:02.597594922Z [2024-02-24 03:37:02,596: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4a01dd09-6e9c-4ae4-8267-0333a43d999d] succeeded in 1.6157769949986687s: None
2024-02-24T03:37:02.687334824Z [2024-02-24 03:37:02,686: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:37:02.696641150Z [2024-02-24 03:37:02,694: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:37:02.810420580Z [2024-02-24 03:37:02,810: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:37:02.814589731Z [2024-02-24 03:37:02,814: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:37:02.815264300Z [2024-02-24 03:37:02,814: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:37:02.815708842Z [2024-02-24 03:37:02,815: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:37:02.815927193Z [2024-02-24 03:37:02,815: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:37:02.816369424Z [2024-02-24 03:37:02,816: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:37:02.816384462Z [2024-02-24 03:37:02,816: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:37:02.908923482Z [2024-02-24 03:37:02,908: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:37:02.912971556Z [2024-02-24 03:37:02,911: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:37:02.924884861Z [2024-02-24 03:37:02,924: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:37:02.935095454Z [2024-02-24 03:37:02,934: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:37:02.937591284Z [2024-02-24 03:37:02,937: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:37:02.937692844Z [2024-02-24 03:37:02,937: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:37:02.937942697Z [2024-02-24 03:37:02,937: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:37:02.938041709Z [2024-02-24 03:37:02,937: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:37:02.938502929Z [2024-02-24 03:37:02,938: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:37:02.938513890Z [2024-02-24 03:37:02,938: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:37:03.022052829Z [2024-02-24 03:37:03,021: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:37:05.385031507Z [2024-02-24 03:37:05,384: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7919cfda-89e2-4dc2-bfd7-ef70afdb67bd] succeeded in 4.446766726001442s: None
2024-02-24T03:37:05.826653498Z [2024-02-24 03:37:05,826: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5b6600c5-89f0-4103-9248-04c14457c0dc] succeeded in 4.874829251000847s: None
2024-02-24T03:38:01.175600860Z [2024-02-24 03:38:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3a8524fe-b5aa-4789-8116-094488714ee8] received
2024-02-24T03:38:01.178571137Z [2024-02-24 03:38:01,178: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4dd5c0d1-85f6-458c-a290-68bccaaa78d5] received
2024-02-24T03:38:01.189068430Z [2024-02-24 03:38:01,188: INFO/ForkPoolWorker-16] [4dd5c0d1-85f6-458c-a290-68bccaaa78d5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:38:01.191258099Z [2024-02-24 03:38:01,190: INFO/ForkPoolWorker-15] [3a8524fe-b5aa-4789-8116-094488714ee8] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:38:01.201880823Z [2024-02-24 03:38:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99031330-8075-44c8-92e6-62cb3c57a4ee] received
2024-02-24T03:38:01.203131428Z [2024-02-24 03:38:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[06535899-b890-42b0-ad12-3ee551f2b10e] received
2024-02-24T03:38:01.220270577Z [2024-02-24 03:38:01,219: INFO/ForkPoolWorker-1] [99031330-8075-44c8-92e6-62cb3c57a4ee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:38:01.222795048Z [2024-02-24 03:38:01,220: INFO/ForkPoolWorker-2] [06535899-b890-42b0-ad12-3ee551f2b10e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:38:01.535475951Z [2024-02-24 03:38:01,532: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:38:01.615717046Z [2024-02-24 03:38:01,609: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:38:01.620025141Z [2024-02-24 03:38:01,616: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:38:01.685837585Z [2024-02-24 03:38:01,682: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:38:01.802881104Z [2024-02-24 03:38:01,802: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:38:01.806983775Z [2024-02-24 03:38:01,806: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:38:01.839122009Z [2024-02-24 03:38:01,838: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:38:01.840607582Z [2024-02-24 03:38:01,840: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:38:01.841863904Z [2024-02-24 03:38:01,841: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:38:01.842098343Z [2024-02-24 03:38:01,841: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:38:01.842765510Z [2024-02-24 03:38:01,842: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:38:01.950011393Z [2024-02-24 03:38:01,949: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:38:02.043871202Z [2024-02-24 03:38:02,043: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:38:02.658076029Z [2024-02-24 03:38:02,656: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3a8524fe-b5aa-4789-8116-094488714ee8] succeeded in 1.474781406999682s: None
2024-02-24T03:38:02.673853037Z [2024-02-24 03:38:02,671: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[06535899-b890-42b0-ad12-3ee551f2b10e] succeeded in 1.4675511259993073s: None
2024-02-24T03:38:02.887003879Z [2024-02-24 03:38:02,886: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:38:02.890662701Z [2024-02-24 03:38:02,890: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:38:02.920189256Z [2024-02-24 03:38:02,919: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:38:02.922801265Z [2024-02-24 03:38:02,922: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:38:02.923101924Z [2024-02-24 03:38:02,922: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:38:02.923509093Z [2024-02-24 03:38:02,923: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:38:02.923730648Z [2024-02-24 03:38:02,923: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:38:02.924357823Z [2024-02-24 03:38:02,924: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:38:02.926217958Z [2024-02-24 03:38:02,924: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:38:03.014288800Z [2024-02-24 03:38:03,013: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:38:03.017887302Z [2024-02-24 03:38:03,017: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:38:03.031832782Z [2024-02-24 03:38:03,031: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:38:03.055119846Z [2024-02-24 03:38:03,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:38:03.057024321Z [2024-02-24 03:38:03,056: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:38:03.057077177Z [2024-02-24 03:38:03,056: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:38:03.057142885Z [2024-02-24 03:38:03,056: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:38:03.057210977Z [2024-02-24 03:38:03,057: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:38:03.057430183Z [2024-02-24 03:38:03,057: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:38:03.057503731Z [2024-02-24 03:38:03,057: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:38:03.143211918Z [2024-02-24 03:38:03,142: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:38:05.642653810Z [2024-02-24 03:38:05,642: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99031330-8075-44c8-92e6-62cb3c57a4ee] succeeded in 4.4380363970012695s: None
2024-02-24T03:38:06.503519265Z [2024-02-24 03:38:06,502: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4dd5c0d1-85f6-458c-a290-68bccaaa78d5] succeeded in 5.322151399001086s: None
2024-02-24T03:39:00.286558773Z [2024-02-24 03:39:00,286: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c0b26d8e-03ca-4a0d-84f6-c9d790bd7d76] received
2024-02-24T03:39:00.295209615Z [2024-02-24 03:39:00,294: INFO/ForkPoolWorker-15] [c0b26d8e-03ca-4a0d-84f6-c9d790bd7d76] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:39:00.314363226Z [2024-02-24 03:39:00,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ee87221-e979-46cc-bd7b-c8a3b864ae85] received
2024-02-24T03:39:00.323469615Z [2024-02-24 03:39:00,323: INFO/ForkPoolWorker-16] [4ee87221-e979-46cc-bd7b-c8a3b864ae85] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:39:00.328295242Z [2024-02-24 03:39:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8bd500bd-3d7d-430a-9e45-c9b83e5d7c18] received
2024-02-24T03:39:00.359111963Z [2024-02-24 03:39:00,358: INFO/ForkPoolWorker-1] [8bd500bd-3d7d-430a-9e45-c9b83e5d7c18] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:39:00.641729290Z [2024-02-24 03:39:00,638: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:39:00.708599451Z [2024-02-24 03:39:00,705: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:39:00.811350437Z [2024-02-24 03:39:00,806: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:39:00.993634082Z [2024-02-24 03:39:00,993: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:39:00.997872335Z [2024-02-24 03:39:00,997: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:39:01.035121663Z [2024-02-24 03:39:01,034: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:39:01.038622341Z [2024-02-24 03:39:01,038: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:39:01.039006990Z [2024-02-24 03:39:01,038: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:39:01.039185892Z [2024-02-24 03:39:01,039: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:39:01.039615059Z [2024-02-24 03:39:01,039: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:39:01.146896331Z [2024-02-24 03:39:01,146: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:39:01.766350964Z [2024-02-24 03:39:01,765: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8bd500bd-3d7d-430a-9e45-c9b83e5d7c18] succeeded in 1.4355291690008016s: None
2024-02-24T03:39:01.842852447Z [2024-02-24 03:39:01,842: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:39:01.846082573Z [2024-02-24 03:39:01,845: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:39:01.874894671Z [2024-02-24 03:39:01,874: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:39:01.879262347Z [2024-02-24 03:39:01,878: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:39:01.879572905Z [2024-02-24 03:39:01,879: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:39:01.879941044Z [2024-02-24 03:39:01,879: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:39:01.880171814Z [2024-02-24 03:39:01,879: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:39:01.880675053Z [2024-02-24 03:39:01,880: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:39:01.880930439Z [2024-02-24 03:39:01,880: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:39:01.964694186Z [2024-02-24 03:39:01,964: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:39:01.970529711Z [2024-02-24 03:39:01,970: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:39:01.973750721Z [2024-02-24 03:39:01,973: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:39:01.995527371Z [2024-02-24 03:39:01,995: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:39:01.996816394Z [2024-02-24 03:39:01,996: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:39:01.996967014Z [2024-02-24 03:39:01,996: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:39:01.997153706Z [2024-02-24 03:39:01,996: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:39:01.997167429Z [2024-02-24 03:39:01,997: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:39:01.997645327Z [2024-02-24 03:39:01,997: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:39:01.997819390Z [2024-02-24 03:39:01,997: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:39:02.094295970Z [2024-02-24 03:39:02,094: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:39:03.665240636Z [2024-02-24 03:39:03,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4ee87221-e979-46cc-bd7b-c8a3b864ae85] succeeded in 3.3479556610000145s: None
2024-02-24T03:39:04.088551496Z [2024-02-24 03:39:04,087: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c0b26d8e-03ca-4a0d-84f6-c9d790bd7d76] succeeded in 3.7973030749999452s: None
2024-02-24T03:40:01.194508729Z [2024-02-24 03:40:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2c08e3f3-3e5b-4b51-8a7a-91909f748160] received
2024-02-24T03:40:01.196672399Z [2024-02-24 03:40:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[60488bb0-8836-48b6-a02e-55114f78105b] received
2024-02-24T03:40:01.202131569Z [2024-02-24 03:40:01,201: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5e66d481-3f83-4f1f-a985-939e54a4b6d4] received
2024-02-24T03:40:01.205699951Z [2024-02-24 03:40:01,205: INFO/ForkPoolWorker-16] [60488bb0-8836-48b6-a02e-55114f78105b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:40:01.205720809Z [2024-02-24 03:40:01,205: INFO/ForkPoolWorker-15] [2c08e3f3-3e5b-4b51-8a7a-91909f748160] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:40:01.218196558Z [2024-02-24 03:40:01,217: INFO/ForkPoolWorker-1] [5e66d481-3f83-4f1f-a985-939e54a4b6d4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:40:01.224806003Z [2024-02-24 03:40:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7cdb3173-a0b1-4f4a-aecb-ae798d445221] received
2024-02-24T03:40:01.232783360Z [2024-02-24 03:40:01,232: INFO/ForkPoolWorker-2] [7cdb3173-a0b1-4f4a-aecb-ae798d445221] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:40:01.237722920Z [2024-02-24 03:40:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99662b40-db61-4116-8092-a41ba720920a] received
2024-02-24T03:40:01.265925708Z [2024-02-24 03:40:01,262: INFO/ForkPoolWorker-3] [99662b40-db61-4116-8092-a41ba720920a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:40:01.827778538Z [2024-02-24 03:40:01,821: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:40:01.840176088Z [2024-02-24 03:40:01,836: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:40:01.904301731Z [2024-02-24 03:40:01,898: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:40:01.953114035Z [2024-02-24 03:40:01,948: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:40:01.956366065Z [2024-02-24 03:40:01,941: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:40:02.017897485Z [2024-02-24 03:40:02,017: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:40:02.022665144Z [2024-02-24 03:40:02,021: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:02.061473085Z [2024-02-24 03:40:02,061: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:40:02.064494044Z [2024-02-24 03:40:02,064: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:40:02.065398150Z [2024-02-24 03:40:02,064: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:40:02.065419813Z [2024-02-24 03:40:02,064: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:40:02.065426124Z [2024-02-24 03:40:02,065: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:40:02.292276083Z [2024-02-24 03:40:02,291: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:02.426250655Z [2024-02-24 03:40:02,423: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:03.512113929Z [2024-02-24 03:40:03,511: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7cdb3173-a0b1-4f4a-aecb-ae798d445221] succeeded in 2.285364503999517s: None
2024-02-24T03:40:03.670474454Z [2024-02-24 03:40:03,669: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[60488bb0-8836-48b6-a02e-55114f78105b] succeeded in 2.4720305030004965s: None
2024-02-24T03:40:04.099814798Z [2024-02-24 03:40:04,099: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:40:04.103421307Z [2024-02-24 03:40:04,102: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:04.116128291Z [2024-02-24 03:40:04,115: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T03:40:04.125801441Z [2024-02-24 03:40:04,125: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:04.143169230Z [2024-02-24 03:40:04,142: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:40:04.144478541Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:04.144495199Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:04.144608709Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:04.144672510Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:40:04.144871480Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:40:04.144902543Z [2024-02-24 03:40:04,144: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:04.176791259Z [2024-02-24 03:40:04,176: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T03:40:04.183234077Z [2024-02-24 03:40:04,182: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:04.183426566Z [2024-02-24 03:40:04,183: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:04.183649946Z [2024-02-24 03:40:04,183: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:04.183780359Z [2024-02-24 03:40:04,183: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T03:40:04.184105623Z [2024-02-24 03:40:04,183: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:40:04.184339353Z [2024-02-24 03:40:04,184: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:04.232128667Z [2024-02-24 03:40:04,231: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:04.339480160Z [2024-02-24 03:40:04,339: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:04.771864244Z [2024-02-24 03:40:04,771: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:40:04.775337350Z [2024-02-24 03:40:04,774: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:04.826569490Z [2024-02-24 03:40:04,826: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:40:04.831174032Z [2024-02-24 03:40:04,830: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:04.831233012Z [2024-02-24 03:40:04,831: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:04.831266109Z [2024-02-24 03:40:04,831: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:04.831271571Z [2024-02-24 03:40:04,831: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:40:04.831583567Z [2024-02-24 03:40:04,831: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:40:04.831594347Z [2024-02-24 03:40:04,831: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:05.044946087Z [2024-02-24 03:40:05,044: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:05.046642272Z [2024-02-24 03:40:05,046: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2c08e3f3-3e5b-4b51-8a7a-91909f748160] succeeded in 3.8482125749997067s: None
2024-02-24T03:40:06.110286632Z [2024-02-24 03:40:06,110: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff8fb016-0aa0-44ba-9264-caa6e33ba70a] received
2024-02-24T03:40:06.118526685Z [2024-02-24 03:40:06,118: INFO/ForkPoolWorker-15] [ff8fb016-0aa0-44ba-9264-caa6e33ba70a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:40:06.424617583Z [2024-02-24 03:40:06,421: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:40:06.721303172Z [2024-02-24 03:40:06,720: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[99662b40-db61-4116-8092-a41ba720920a] succeeded in 5.475083163999443s: None
2024-02-24T03:40:07.517246302Z [2024-02-24 03:40:07,516: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5e66d481-3f83-4f1f-a985-939e54a4b6d4] succeeded in 6.3124522939997405s: None
2024-02-24T03:40:07.664263753Z [2024-02-24 03:40:07,663: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:40:07.668621211Z [2024-02-24 03:40:07,668: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:07.693995987Z [2024-02-24 03:40:07,693: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:40:07.695837256Z [2024-02-24 03:40:07,695: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:07.695883395Z [2024-02-24 03:40:07,695: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:07.696103337Z [2024-02-24 03:40:07,695: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:07.696172713Z [2024-02-24 03:40:07,696: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:40:07.696555689Z [2024-02-24 03:40:07,696: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:40:07.696627512Z [2024-02-24 03:40:07,696: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:07.806165965Z [2024-02-24 03:40:07,805: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:08.478289881Z [2024-02-24 03:40:08,477: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff8fb016-0aa0-44ba-9264-caa6e33ba70a] succeeded in 2.3660255479990155s: None
2024-02-24T03:40:08.588750317Z [2024-02-24 03:40:08,588: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5000034-a4bc-4327-9ca5-a9bff6d7f47c] received
2024-02-24T03:40:08.609911534Z [2024-02-24 03:40:08,609: INFO/ForkPoolWorker-15] [b5000034-a4bc-4327-9ca5-a9bff6d7f47c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:40:08.890715758Z [2024-02-24 03:40:08,887: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:40:09.955111802Z [2024-02-24 03:40:09,954: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:40:09.958232127Z [2024-02-24 03:40:09,957: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:09.982441666Z [2024-02-24 03:40:09,982: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:40:09.983577600Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:09.983592881Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:09.983725047Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:09.983740025Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:40:09.983939786Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:40:09.983957450Z [2024-02-24 03:40:09,983: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:10.057180852Z [2024-02-24 03:40:10,056: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:11.568264122Z [2024-02-24 03:40:11,567: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b5000034-a4bc-4327-9ca5-a9bff6d7f47c] succeeded in 2.9766854219997185s: None
2024-02-24T03:40:12.396962365Z [2024-02-24 03:40:12,394: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[091fc724-54c6-4015-ac48-cc4de4d41a05] received
2024-02-24T03:40:12.410467010Z [2024-02-24 03:40:12,410: INFO/ForkPoolWorker-15] [091fc724-54c6-4015-ac48-cc4de4d41a05] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:40:12.765842112Z [2024-02-24 03:40:12,762: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:40:13.925079996Z [2024-02-24 03:40:13,924: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:40:13.928369721Z [2024-02-24 03:40:13,927: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:40:13.944236993Z [2024-02-24 03:40:13,944: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:40:13.945594097Z [2024-02-24 03:40:13,945: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:40:13.945667315Z [2024-02-24 03:40:13,945: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:40:13.945728327Z [2024-02-24 03:40:13,945: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:40:13.945809379Z [2024-02-24 03:40:13,945: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:40:13.946064170Z [2024-02-24 03:40:13,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:40:13.946112711Z [2024-02-24 03:40:13,946: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:40:14.029922406Z [2024-02-24 03:40:14,029: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:40:14.637935090Z [2024-02-24 03:40:14,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[091fc724-54c6-4015-ac48-cc4de4d41a05] succeeded in 2.2404213859990705s: None
2024-02-24T03:41:00.835656723Z [2024-02-24 03:41:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b864a77a-2b3f-4173-965c-e3ca5c1cd8be] received
2024-02-24T03:41:00.847155470Z [2024-02-24 03:41:00,846: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1683dbb0-8020-4c60-b099-4f3c1862a5d1] received
2024-02-24T03:41:00.851763651Z [2024-02-24 03:41:00,851: INFO/ForkPoolWorker-15] [b864a77a-2b3f-4173-965c-e3ca5c1cd8be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:41:00.854877492Z [2024-02-24 03:41:00,854: INFO/ForkPoolWorker-16] [1683dbb0-8020-4c60-b099-4f3c1862a5d1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:41:00.861975612Z [2024-02-24 03:41:00,854: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4126eb30-0fb4-45fd-af0b-c0df3777ddb9] received
2024-02-24T03:41:00.871246465Z [2024-02-24 03:41:00,870: INFO/ForkPoolWorker-1] [4126eb30-0fb4-45fd-af0b-c0df3777ddb9] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:41:01.154657136Z [2024-02-24 03:41:01,151: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:41:01.245589734Z [2024-02-24 03:41:01,235: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:41:01.273905110Z [2024-02-24 03:41:01,264: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:41:01.473440454Z [2024-02-24 03:41:01,472: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:41:01.478607463Z [2024-02-24 03:41:01,478: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:41:01.502175985Z [2024-02-24 03:41:01,501: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:41:01.503390541Z [2024-02-24 03:41:01,503: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:41:01.503555844Z [2024-02-24 03:41:01,503: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:41:01.503672881Z [2024-02-24 03:41:01,503: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:41:01.504004541Z [2024-02-24 03:41:01,503: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:41:01.601487393Z [2024-02-24 03:41:01,601: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:41:02.237818262Z [2024-02-24 03:41:02,237: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4126eb30-0fb4-45fd-af0b-c0df3777ddb9] succeeded in 1.3737501539999357s: None
2024-02-24T03:41:02.386502501Z [2024-02-24 03:41:02,383: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:41:02.390057357Z [2024-02-24 03:41:02,386: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:41:02.419243612Z [2024-02-24 03:41:02,418: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:41:02.421077479Z [2024-02-24 03:41:02,420: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:41:02.421165832Z [2024-02-24 03:41:02,421: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:41:02.421358054Z [2024-02-24 03:41:02,421: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:41:02.421459754Z [2024-02-24 03:41:02,421: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:41:02.422311595Z [2024-02-24 03:41:02,422: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:41:02.422402076Z [2024-02-24 03:41:02,422: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:41:02.473236102Z [2024-02-24 03:41:02,472: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:41:02.476510513Z [2024-02-24 03:41:02,476: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:41:02.499978471Z [2024-02-24 03:41:02,499: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:41:02.501271458Z [2024-02-24 03:41:02,501: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:41:02.501495206Z [2024-02-24 03:41:02,501: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:41:02.501698249Z [2024-02-24 03:41:02,501: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:41:02.501851786Z [2024-02-24 03:41:02,501: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:41:02.502619509Z [2024-02-24 03:41:02,502: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:41:02.502767443Z [2024-02-24 03:41:02,502: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:41:02.518102362Z [2024-02-24 03:41:02,517: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:41:02.602282431Z [2024-02-24 03:41:02,601: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:41:04.278376452Z [2024-02-24 03:41:04,277: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1683dbb0-8020-4c60-b099-4f3c1862a5d1] succeeded in 3.4297992710016842s: None
2024-02-24T03:41:04.844261369Z [2024-02-24 03:41:04,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b864a77a-2b3f-4173-965c-e3ca5c1cd8be] succeeded in 4.006583968000996s: None
2024-02-24T03:42:01.323556889Z [2024-02-24 03:42:01,323: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1a5b1411-df6f-4fc0-8d5c-ec5fccb8b7a8] received
2024-02-24T03:42:01.327834133Z [2024-02-24 03:42:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[683aaa9b-91fd-4ce4-a9c0-864b7689a437] received
2024-02-24T03:42:01.334924812Z [2024-02-24 03:42:01,334: INFO/ForkPoolWorker-15] [1a5b1411-df6f-4fc0-8d5c-ec5fccb8b7a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:42:01.335636392Z [2024-02-24 03:42:01,335: INFO/ForkPoolWorker-16] [683aaa9b-91fd-4ce4-a9c0-864b7689a437] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:42:01.341267072Z [2024-02-24 03:42:01,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[58a78d4e-7b56-4f97-aa40-a065320efbce] received
2024-02-24T03:42:01.343782813Z [2024-02-24 03:42:01,343: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f28102bb-9c60-4f5c-91e7-795935e199e3] received
2024-02-24T03:42:01.353374663Z [2024-02-24 03:42:01,353: INFO/ForkPoolWorker-1] [58a78d4e-7b56-4f97-aa40-a065320efbce] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:42:01.364064047Z [2024-02-24 03:42:01,363: INFO/ForkPoolWorker-2] [f28102bb-9c60-4f5c-91e7-795935e199e3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:42:01.646576691Z [2024-02-24 03:42:01,641: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:42:01.682986183Z [2024-02-24 03:42:01,678: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:42:01.683416376Z [2024-02-24 03:42:01,679: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:42:01.811016232Z [2024-02-24 03:42:01,807: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:42:01.863198331Z [2024-02-24 03:42:01,862: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:42:01.867678669Z [2024-02-24 03:42:01,867: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:42:01.897954313Z [2024-02-24 03:42:01,897: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:42:01.899169094Z [2024-02-24 03:42:01,898: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:42:01.899277030Z [2024-02-24 03:42:01,899: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:42:01.899388238Z [2024-02-24 03:42:01,899: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:42:01.899731552Z [2024-02-24 03:42:01,899: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:42:02.011182117Z [2024-02-24 03:42:02,010: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:42:02.122486097Z [2024-02-24 03:42:02,122: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:42:02.789830427Z [2024-02-24 03:42:02,789: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[58a78d4e-7b56-4f97-aa40-a065320efbce] succeeded in 1.4429200049999054s: None
2024-02-24T03:42:02.882806963Z [2024-02-24 03:42:02,882: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[683aaa9b-91fd-4ce4-a9c0-864b7689a437] succeeded in 1.552678478999951s: None
2024-02-24T03:42:03.269110238Z [2024-02-24 03:42:03,268: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:42:03.272689515Z [2024-02-24 03:42:03,271: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:42:03.310313975Z [2024-02-24 03:42:03,309: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:42:03.311797980Z [2024-02-24 03:42:03,311: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:42:03.311810406Z [2024-02-24 03:42:03,311: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:42:03.312021323Z [2024-02-24 03:42:03,311: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:42:03.312108983Z [2024-02-24 03:42:03,311: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:42:03.312431652Z [2024-02-24 03:42:03,312: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:42:03.312935018Z [2024-02-24 03:42:03,312: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:42:03.351877442Z [2024-02-24 03:42:03,351: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:42:03.360824213Z [2024-02-24 03:42:03,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:42:03.395789221Z [2024-02-24 03:42:03,395: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:42:03.397514493Z [2024-02-24 03:42:03,397: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:42:03.397543181Z [2024-02-24 03:42:03,397: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:42:03.397753700Z [2024-02-24 03:42:03,397: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:42:03.397903910Z [2024-02-24 03:42:03,397: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:42:03.398289243Z [2024-02-24 03:42:03,398: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:42:03.398446187Z [2024-02-24 03:42:03,398: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:42:03.412304175Z [2024-02-24 03:42:03,412: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:42:03.498618134Z [2024-02-24 03:42:03,498: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:42:05.598254333Z [2024-02-24 03:42:05,597: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f28102bb-9c60-4f5c-91e7-795935e199e3] succeeded in 4.248286415000621s: None
2024-02-24T03:42:05.615457379Z [2024-02-24 03:42:05,614: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1a5b1411-df6f-4fc0-8d5c-ec5fccb8b7a8] succeeded in 4.2860711610010185s: None
2024-02-24T03:43:00.322441928Z [2024-02-24 03:43:00,322: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[036b498c-d6ba-41a5-a7d9-060d550cf51c] received
2024-02-24T03:43:00.328537430Z [2024-02-24 03:43:00,328: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6a93b156-47fd-49a1-9feb-e5d5b2224c27] received
2024-02-24T03:43:00.330259450Z [2024-02-24 03:43:00,330: INFO/ForkPoolWorker-15] [036b498c-d6ba-41a5-a7d9-060d550cf51c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:43:00.331579767Z [2024-02-24 03:43:00,331: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[49714ba0-bca0-4086-ab95-ef701066efd6] received
2024-02-24T03:43:00.338264346Z [2024-02-24 03:43:00,337: INFO/ForkPoolWorker-16] [6a93b156-47fd-49a1-9feb-e5d5b2224c27] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:43:00.343435942Z [2024-02-24 03:43:00,343: INFO/ForkPoolWorker-1] [49714ba0-bca0-4086-ab95-ef701066efd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:43:00.644091495Z [2024-02-24 03:43:00,640: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:43:00.658994390Z [2024-02-24 03:43:00,655: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:43:00.680957310Z [2024-02-24 03:43:00,677: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:43:00.792981664Z [2024-02-24 03:43:00,792: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:43:00.796828723Z [2024-02-24 03:43:00,796: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:43:00.820417487Z [2024-02-24 03:43:00,820: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:43:00.822047486Z [2024-02-24 03:43:00,821: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:43:00.822264046Z [2024-02-24 03:43:00,822: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:43:00.822410429Z [2024-02-24 03:43:00,822: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:43:00.822692048Z [2024-02-24 03:43:00,822: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:43:00.925555562Z [2024-02-24 03:43:00,925: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:43:01.569021203Z [2024-02-24 03:43:01,568: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6a93b156-47fd-49a1-9feb-e5d5b2224c27] succeeded in 1.2385157430016989s: None
2024-02-24T03:43:01.793650008Z [2024-02-24 03:43:01,793: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:43:01.796975263Z [2024-02-24 03:43:01,796: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:43:01.822214338Z [2024-02-24 03:43:01,821: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:43:01.824243771Z [2024-02-24 03:43:01,823: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:43:01.824271042Z [2024-02-24 03:43:01,824: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:43:01.824487751Z [2024-02-24 03:43:01,824: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:43:01.824588784Z [2024-02-24 03:43:01,824: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:43:01.824975814Z [2024-02-24 03:43:01,824: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:43:01.825000961Z [2024-02-24 03:43:01,824: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:43:01.912228095Z [2024-02-24 03:43:01,911: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:43:01.961913506Z [2024-02-24 03:43:01,961: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:43:01.965285060Z [2024-02-24 03:43:01,964: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:43:01.989922355Z [2024-02-24 03:43:01,989: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:43:01.991212722Z [2024-02-24 03:43:01,990: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:43:01.991232722Z [2024-02-24 03:43:01,991: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:43:01.991340176Z [2024-02-24 03:43:01,991: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:43:01.991353865Z [2024-02-24 03:43:01,991: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:43:01.991569404Z [2024-02-24 03:43:01,991: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:43:01.991583519Z [2024-02-24 03:43:01,991: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:43:02.069469172Z [2024-02-24 03:43:02,069: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:43:03.543207547Z [2024-02-24 03:43:03,542: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[49714ba0-bca0-4086-ab95-ef701066efd6] succeeded in 3.2097772029992484s: None
2024-02-24T03:43:04.121647250Z [2024-02-24 03:43:04,120: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[036b498c-d6ba-41a5-a7d9-060d550cf51c] succeeded in 3.7968447580005886s: None
2024-02-24T03:44:00.444544386Z [2024-02-24 03:44:00,444: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20f9a3db-1ba2-4a29-89fa-9283be4eca2d] received
2024-02-24T03:44:00.447613801Z [2024-02-24 03:44:00,447: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[895dd860-318f-4b81-8a83-0363d52a16ff] received
2024-02-24T03:44:00.450245656Z [2024-02-24 03:44:00,449: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[23610d01-b41f-446f-ac19-3878ae8c31fb] received
2024-02-24T03:44:00.454382331Z [2024-02-24 03:44:00,454: INFO/ForkPoolWorker-16] [895dd860-318f-4b81-8a83-0363d52a16ff] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:44:00.455009736Z [2024-02-24 03:44:00,454: INFO/ForkPoolWorker-15] [20f9a3db-1ba2-4a29-89fa-9283be4eca2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:44:00.458390052Z [2024-02-24 03:44:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[872bdafd-4444-4f1f-80cf-3e6f4ae13017] received
2024-02-24T03:44:00.463352833Z [2024-02-24 03:44:00,463: INFO/ForkPoolWorker-1] [23610d01-b41f-446f-ac19-3878ae8c31fb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:44:00.466910039Z [2024-02-24 03:44:00,466: INFO/ForkPoolWorker-2] [872bdafd-4444-4f1f-80cf-3e6f4ae13017] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:44:00.772116372Z [2024-02-24 03:44:00,767: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:44:00.806241159Z [2024-02-24 03:44:00,801: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:44:00.853021607Z [2024-02-24 03:44:00,848: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:44:00.864555116Z [2024-02-24 03:44:00,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:44:01.022921019Z [2024-02-24 03:44:01,022: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:44:01.100578340Z [2024-02-24 03:44:01,100: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:44:01.105364352Z [2024-02-24 03:44:01,104: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:44:01.148471027Z [2024-02-24 03:44:01,148: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:44:01.149520600Z [2024-02-24 03:44:01,149: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:44:01.149991771Z [2024-02-24 03:44:01,149: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:44:01.150173373Z [2024-02-24 03:44:01,150: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:44:01.150589391Z [2024-02-24 03:44:01,150: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:44:01.370523134Z [2024-02-24 03:44:01,370: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:44:01.768965050Z [2024-02-24 03:44:01,768: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[895dd860-318f-4b81-8a83-0363d52a16ff] succeeded in 1.3200072959989484s: None
2024-02-24T03:44:02.028918836Z [2024-02-24 03:44:02,028: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:44:02.032839544Z [2024-02-24 03:44:02,032: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:44:02.067532380Z [2024-02-24 03:44:02,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:44:02.069299734Z [2024-02-24 03:44:02,069: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:44:02.070268575Z [2024-02-24 03:44:02,070: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:44:02.070444821Z [2024-02-24 03:44:02,070: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:44:02.070529614Z [2024-02-24 03:44:02,070: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:44:02.070886991Z [2024-02-24 03:44:02,070: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:44:02.070983289Z [2024-02-24 03:44:02,070: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:44:02.092840693Z [2024-02-24 03:44:02,092: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[23610d01-b41f-446f-ac19-3878ae8c31fb] succeeded in 1.6394720999996935s: None
2024-02-24T03:44:02.196953423Z [2024-02-24 03:44:02,196: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:44:02.273158782Z [2024-02-24 03:44:02,272: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:44:02.276591335Z [2024-02-24 03:44:02,276: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:44:02.311855026Z [2024-02-24 03:44:02,311: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:44:02.315538716Z [2024-02-24 03:44:02,315: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:44:02.316164947Z [2024-02-24 03:44:02,315: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:44:02.316568806Z [2024-02-24 03:44:02,316: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:44:02.316831671Z [2024-02-24 03:44:02,316: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:44:02.317871968Z [2024-02-24 03:44:02,317: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:44:02.318144300Z [2024-02-24 03:44:02,317: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:44:02.466225635Z [2024-02-24 03:44:02,465: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:44:04.187821994Z [2024-02-24 03:44:04,187: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20f9a3db-1ba2-4a29-89fa-9283be4eca2d] succeeded in 3.7378064660006203s: None
2024-02-24T03:44:05.474260687Z [2024-02-24 03:44:05,473: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[872bdafd-4444-4f1f-80cf-3e6f4ae13017] succeeded in 5.0135977449990605s: None
2024-02-24T03:45:00.324601626Z [2024-02-24 03:45:00,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[872fdd5f-fe2f-428e-9a9f-150626dfc284] received
2024-02-24T03:45:00.336225815Z [2024-02-24 03:45:00,335: INFO/ForkPoolWorker-15] [872fdd5f-fe2f-428e-9a9f-150626dfc284] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:45:00.340285140Z [2024-02-24 03:45:00,335: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ad2f4879-1838-4578-9375-51add94815d8] received
2024-02-24T03:45:00.347776618Z [2024-02-24 03:45:00,347: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f79454cd-5b03-4c38-bda1-16052fc3b4d8] received
2024-02-24T03:45:00.349149522Z [2024-02-24 03:45:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7f2ef7fb-a1c5-440e-83e0-e1473874adbd] received
2024-02-24T03:45:00.358808715Z [2024-02-24 03:45:00,358: INFO/ForkPoolWorker-16] [ad2f4879-1838-4578-9375-51add94815d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:45:00.359188441Z [2024-02-24 03:45:00,359: INFO/ForkPoolWorker-1] [f79454cd-5b03-4c38-bda1-16052fc3b4d8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:45:00.362346522Z [2024-02-24 03:45:00,362: INFO/ForkPoolWorker-2] [7f2ef7fb-a1c5-440e-83e0-e1473874adbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:45:00.704728077Z [2024-02-24 03:45:00,699: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:45:00.723928512Z [2024-02-24 03:45:00,720: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:45:00.759241372Z [2024-02-24 03:45:00,755: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:45:00.850504560Z [2024-02-24 03:45:00,847: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:45:00.923667397Z [2024-02-24 03:45:00,923: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:45:00.927717481Z [2024-02-24 03:45:00,927: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:00.961723039Z [2024-02-24 03:45:00,961: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:45:00.970038659Z [2024-02-24 03:45:00,969: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:45:00.970380643Z [2024-02-24 03:45:00,970: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:45:00.970735383Z [2024-02-24 03:45:00,970: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:45:00.971088536Z [2024-02-24 03:45:00,970: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:45:01.070106002Z [2024-02-24 03:45:01,069: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:01.866033896Z [2024-02-24 03:45:01,865: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f79454cd-5b03-4c38-bda1-16052fc3b4d8] succeeded in 1.5166857090007397s: None
2024-02-24T03:45:02.162221880Z [2024-02-24 03:45:02,161: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:45:02.165443342Z [2024-02-24 03:45:02,164: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:02.186179418Z [2024-02-24 03:45:02,185: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:45:02.187966952Z [2024-02-24 03:45:02,187: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:02.187986455Z [2024-02-24 03:45:02,187: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:02.188157242Z [2024-02-24 03:45:02,187: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:02.188246272Z [2024-02-24 03:45:02,188: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:45:02.188666882Z [2024-02-24 03:45:02,188: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:45:02.188758592Z [2024-02-24 03:45:02,188: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:02.285511006Z [2024-02-24 03:45:02,285: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:02.424007908Z [2024-02-24 03:45:02,423: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:45:02.427571515Z [2024-02-24 03:45:02,427: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:02.460779528Z [2024-02-24 03:45:02,460: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:45:02.462263191Z [2024-02-24 03:45:02,461: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:02.462321762Z [2024-02-24 03:45:02,462: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:02.462537931Z [2024-02-24 03:45:02,462: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:02.462613951Z [2024-02-24 03:45:02,462: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:45:02.462986506Z [2024-02-24 03:45:02,462: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:45:02.463109575Z [2024-02-24 03:45:02,462: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:02.606674655Z [2024-02-24 03:45:02,606: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:02.786900669Z [2024-02-24 03:45:02,786: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:45:02.790483794Z [2024-02-24 03:45:02,790: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:02.844478721Z [2024-02-24 03:45:02,844: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:45:02.846042063Z [2024-02-24 03:45:02,845: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:02.846186769Z [2024-02-24 03:45:02,845: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:02.846407711Z [2024-02-24 03:45:02,846: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:02.846532147Z [2024-02-24 03:45:02,846: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:45:02.847313938Z [2024-02-24 03:45:02,847: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:45:02.847441060Z [2024-02-24 03:45:02,847: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:02.938297517Z [2024-02-24 03:45:02,938: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:03.450447099Z [2024-02-24 03:45:03,449: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[872fdd5f-fe2f-428e-9a9f-150626dfc284] succeeded in 3.12363587100117s: None
2024-02-24T03:45:03.822517135Z [2024-02-24 03:45:03,822: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cb0f55cd-5fd8-4fd8-bd90-ea08ac50180d] received
2024-02-24T03:45:03.831189227Z [2024-02-24 03:45:03,830: INFO/ForkPoolWorker-15] [cb0f55cd-5fd8-4fd8-bd90-ea08ac50180d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:45:03.996280954Z [2024-02-24 03:45:03,995: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ad2f4879-1838-4578-9375-51add94815d8] succeeded in 3.644960240999353s: None
2024-02-24T03:45:04.187543139Z [2024-02-24 03:45:04,184: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:45:04.780057648Z [2024-02-24 03:45:04,779: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[7f2ef7fb-a1c5-440e-83e0-e1473874adbd] succeeded in 4.42908513400107s: None
2024-02-24T03:45:05.389657619Z [2024-02-24 03:45:05,389: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:45:05.392774839Z [2024-02-24 03:45:05,392: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:05.409168148Z [2024-02-24 03:45:05,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:45:05.410366213Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:05.410435323Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:05.410598852Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:05.410665899Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:45:05.411018353Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:45:05.411100171Z [2024-02-24 03:45:05,410: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:05.486480148Z [2024-02-24 03:45:05,486: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:06.116235205Z [2024-02-24 03:45:06,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cb0f55cd-5fd8-4fd8-bd90-ea08ac50180d] succeeded in 2.291548541001248s: None
2024-02-24T03:45:06.818082296Z [2024-02-24 03:45:06,815: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[de9a91dc-3036-4dfa-bfa0-31b8f1d1e387] received
2024-02-24T03:45:06.825867445Z [2024-02-24 03:45:06,825: INFO/ForkPoolWorker-15] [de9a91dc-3036-4dfa-bfa0-31b8f1d1e387] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:45:07.099030761Z [2024-02-24 03:45:07,095: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:45:08.228303602Z [2024-02-24 03:45:08,227: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:45:08.231929067Z [2024-02-24 03:45:08,231: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:08.252748674Z [2024-02-24 03:45:08,252: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:45:08.254745060Z [2024-02-24 03:45:08,254: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:08.254965114Z [2024-02-24 03:45:08,254: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:08.255287113Z [2024-02-24 03:45:08,254: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:08.255516675Z [2024-02-24 03:45:08,255: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:45:08.256118586Z [2024-02-24 03:45:08,255: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:45:08.256264011Z [2024-02-24 03:45:08,256: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:08.340745315Z [2024-02-24 03:45:08,340: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:09.790282966Z [2024-02-24 03:45:09,789: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[de9a91dc-3036-4dfa-bfa0-31b8f1d1e387] succeeded in 2.9701044220000767s: None
2024-02-24T03:45:10.214229672Z [2024-02-24 03:45:10,213: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94f84f53-6fb3-4d8d-a66f-ab27afe48198] received
2024-02-24T03:45:10.224499038Z [2024-02-24 03:45:10,224: INFO/ForkPoolWorker-15] [94f84f53-6fb3-4d8d-a66f-ab27afe48198] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:45:10.560180614Z [2024-02-24 03:45:10,556: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:45:11.706568313Z [2024-02-24 03:45:11,706: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:45:11.709668580Z [2024-02-24 03:45:11,709: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:45:11.734088716Z [2024-02-24 03:45:11,733: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:45:11.735621908Z [2024-02-24 03:45:11,735: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:45:11.735650025Z [2024-02-24 03:45:11,735: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:45:11.735787159Z [2024-02-24 03:45:11,735: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:45:11.735811111Z [2024-02-24 03:45:11,735: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:45:11.736278605Z [2024-02-24 03:45:11,735: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:45:11.736297366Z [2024-02-24 03:45:11,736: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:45:11.851025213Z [2024-02-24 03:45:11,850: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:45:12.449369978Z [2024-02-24 03:45:12,448: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[94f84f53-6fb3-4d8d-a66f-ab27afe48198] succeeded in 2.2313205509999534s: None
2024-02-24T03:46:00.787639064Z [2024-02-24 03:46:00,787: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e77996ef-9530-4993-92ba-8f55348243cb] received
2024-02-24T03:46:00.790098041Z [2024-02-24 03:46:00,789: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[305e75e7-fb5f-4b8a-bf2e-d659c443c647] received
2024-02-24T03:46:00.795774376Z [2024-02-24 03:46:00,795: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bedfd341-e6fa-4f9a-bb9b-b66381c517f9] received
2024-02-24T03:46:00.797422613Z [2024-02-24 03:46:00,797: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e7e1dc7-9158-474f-b33b-e90ca715ad5b] received
2024-02-24T03:46:00.799827954Z [2024-02-24 03:46:00,799: INFO/ForkPoolWorker-16] [305e75e7-fb5f-4b8a-bf2e-d659c443c647] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:46:00.806328053Z [2024-02-24 03:46:00,802: INFO/ForkPoolWorker-15] [e77996ef-9530-4993-92ba-8f55348243cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:46:00.810136519Z [2024-02-24 03:46:00,809: INFO/ForkPoolWorker-2] [2e7e1dc7-9158-474f-b33b-e90ca715ad5b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:46:00.811444444Z [2024-02-24 03:46:00,811: INFO/ForkPoolWorker-1] [bedfd341-e6fa-4f9a-bb9b-b66381c517f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:46:01.137570608Z [2024-02-24 03:46:01,131: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:46:01.282605569Z [2024-02-24 03:46:01,271: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:46:01.431454175Z [2024-02-24 03:46:01,427: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:46:01.444370689Z [2024-02-24 03:46:01,440: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:46:01.634508820Z [2024-02-24 03:46:01,629: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:46:01.644511460Z [2024-02-24 03:46:01,643: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:46:01.700102510Z [2024-02-24 03:46:01,699: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:46:01.701939779Z [2024-02-24 03:46:01,701: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:46:01.702356307Z [2024-02-24 03:46:01,702: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:46:01.702524783Z [2024-02-24 03:46:01,702: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:46:01.703438084Z [2024-02-24 03:46:01,703: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:46:01.832778559Z [2024-02-24 03:46:01,832: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:46:02.064226926Z [2024-02-24 03:46:02,063: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:46:02.483107742Z [2024-02-24 03:46:02,482: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2e7e1dc7-9158-474f-b33b-e90ca715ad5b] succeeded in 1.6837726710000425s: None
2024-02-24T03:46:02.928609674Z [2024-02-24 03:46:02,925: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e77996ef-9530-4993-92ba-8f55348243cb] succeeded in 2.1367659009993076s: None
2024-02-24T03:46:03.204044690Z [2024-02-24 03:46:03,203: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:46:03.207603340Z [2024-02-24 03:46:03,207: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:46:03.246991609Z [2024-02-24 03:46:03,246: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:46:03.250057747Z [2024-02-24 03:46:03,249: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:46:03.250295243Z [2024-02-24 03:46:03,250: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:46:03.250460592Z [2024-02-24 03:46:03,250: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:46:03.250580888Z [2024-02-24 03:46:03,250: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:46:03.251205217Z [2024-02-24 03:46:03,250: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:46:03.251420076Z [2024-02-24 03:46:03,251: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:46:03.340930178Z [2024-02-24 03:46:03,340: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:46:03.419958386Z [2024-02-24 03:46:03,419: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:46:03.423474592Z [2024-02-24 03:46:03,423: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:46:03.443938151Z [2024-02-24 03:46:03,443: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:46:03.445336400Z [2024-02-24 03:46:03,445: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:46:03.445467270Z [2024-02-24 03:46:03,445: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:46:03.445707038Z [2024-02-24 03:46:03,445: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:46:03.445899522Z [2024-02-24 03:46:03,445: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:46:03.446465482Z [2024-02-24 03:46:03,446: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:46:03.446814676Z [2024-02-24 03:46:03,446: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:46:03.534781510Z [2024-02-24 03:46:03,534: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:46:05.118624431Z [2024-02-24 03:46:05,118: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bedfd341-e6fa-4f9a-bb9b-b66381c517f9] succeeded in 4.321347555000102s: None
2024-02-24T03:46:06.098635891Z [2024-02-24 03:46:06,098: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[305e75e7-fb5f-4b8a-bf2e-d659c443c647] succeeded in 5.307042364998779s: None
2024-02-24T03:47:00.380328437Z [2024-02-24 03:47:00,379: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[def38017-28d8-4a3d-9437-17efeb24298d] received
2024-02-24T03:47:00.383166720Z [2024-02-24 03:47:00,382: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b992cca1-b8dd-4e8f-8b84-f2812d9b5aac] received
2024-02-24T03:47:00.385968627Z [2024-02-24 03:47:00,385: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[257e0682-2ed8-4e21-a9b8-f30b02a89f42] received
2024-02-24T03:47:00.393182055Z [2024-02-24 03:47:00,392: INFO/ForkPoolWorker-16] [b992cca1-b8dd-4e8f-8b84-f2812d9b5aac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:47:00.393744565Z [2024-02-24 03:47:00,393: INFO/ForkPoolWorker-15] [def38017-28d8-4a3d-9437-17efeb24298d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:47:00.395930417Z [2024-02-24 03:47:00,395: INFO/ForkPoolWorker-1] [257e0682-2ed8-4e21-a9b8-f30b02a89f42] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:47:00.683872064Z [2024-02-24 03:47:00,680: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:47:00.685176466Z [2024-02-24 03:47:00,682: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:47:00.706933090Z [2024-02-24 03:47:00,703: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:47:00.862169279Z [2024-02-24 03:47:00,861: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:47:00.866219575Z [2024-02-24 03:47:00,865: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:47:00.888744540Z [2024-02-24 03:47:00,888: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:47:00.890474521Z [2024-02-24 03:47:00,890: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:47:00.890795500Z [2024-02-24 03:47:00,890: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:47:00.891028787Z [2024-02-24 03:47:00,890: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:47:00.891573576Z [2024-02-24 03:47:00,891: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:47:01.016046878Z [2024-02-24 03:47:01,015: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:47:01.756580191Z [2024-02-24 03:47:01,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[257e0682-2ed8-4e21-a9b8-f30b02a89f42] succeeded in 1.3686583350008732s: None
2024-02-24T03:47:01.919755698Z [2024-02-24 03:47:01,919: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:47:01.925159564Z [2024-02-24 03:47:01,924: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:47:01.964613512Z [2024-02-24 03:47:01,964: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:47:01.966034552Z [2024-02-24 03:47:01,965: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:47:01.966062595Z [2024-02-24 03:47:01,965: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:47:01.966197682Z [2024-02-24 03:47:01,966: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:47:01.966207131Z [2024-02-24 03:47:01,966: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:47:01.966550916Z [2024-02-24 03:47:01,966: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:47:01.966565788Z [2024-02-24 03:47:01,966: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:47:01.988650597Z [2024-02-24 03:47:01,988: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:47:01.992237020Z [2024-02-24 03:47:01,991: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:47:02.018624697Z [2024-02-24 03:47:02,018: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:47:02.020147945Z [2024-02-24 03:47:02,019: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:47:02.020318032Z [2024-02-24 03:47:02,020: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:47:02.020514329Z [2024-02-24 03:47:02,020: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:47:02.020668348Z [2024-02-24 03:47:02,020: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:47:02.021036481Z [2024-02-24 03:47:02,020: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:47:02.021194095Z [2024-02-24 03:47:02,021: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:47:02.058031510Z [2024-02-24 03:47:02,057: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:47:02.119939992Z [2024-02-24 03:47:02,119: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:47:03.681574682Z [2024-02-24 03:47:03,681: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[def38017-28d8-4a3d-9437-17efeb24298d] succeeded in 3.299482546000945s: None
2024-02-24T03:47:04.418070757Z [2024-02-24 03:47:04,417: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b992cca1-b8dd-4e8f-8b84-f2812d9b5aac] succeeded in 4.033087976999013s: None
2024-02-24T03:48:00.299374175Z [2024-02-24 03:48:00,298: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ebb2b735-487a-474f-bb9d-aa10c61be097] received
2024-02-24T03:48:00.308032644Z [2024-02-24 03:48:00,307: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8e1d6af4-81f9-45df-9bd4-1161a959a34f] received
2024-02-24T03:48:00.309911840Z [2024-02-24 03:48:00,309: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d95af5f8-ab31-42b0-9a57-882abd1c1480] received
2024-02-24T03:48:00.318263224Z [2024-02-24 03:48:00,318: INFO/ForkPoolWorker-1] [d95af5f8-ab31-42b0-9a57-882abd1c1480] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:48:00.325304010Z [2024-02-24 03:48:00,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1435dea5-6e69-41ca-843d-e09caaa729f0] received
2024-02-24T03:48:00.327566916Z [2024-02-24 03:48:00,326: INFO/ForkPoolWorker-16] [8e1d6af4-81f9-45df-9bd4-1161a959a34f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:48:00.331039598Z [2024-02-24 03:48:00,330: INFO/ForkPoolWorker-15] [ebb2b735-487a-474f-bb9d-aa10c61be097] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:48:00.337883435Z [2024-02-24 03:48:00,337: INFO/ForkPoolWorker-2] [1435dea5-6e69-41ca-843d-e09caaa729f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:48:00.784731703Z [2024-02-24 03:48:00,780: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:48:00.864127836Z [2024-02-24 03:48:00,861: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:48:00.961486512Z [2024-02-24 03:48:00,961: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:48:00.965318502Z [2024-02-24 03:48:00,964: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:48:00.997123400Z [2024-02-24 03:48:00,996: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:48:00.998537367Z [2024-02-24 03:48:00,998: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:48:00.998609528Z [2024-02-24 03:48:00,998: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:48:00.998685555Z [2024-02-24 03:48:00,998: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:48:00.999536705Z [2024-02-24 03:48:00,998: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:48:01.099391577Z [2024-02-24 03:48:01,099: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:48:01.171382758Z [2024-02-24 03:48:01,164: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:48:01.328487286Z [2024-02-24 03:48:01,316: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:48:01.810851034Z [2024-02-24 03:48:01,810: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:48:01.965686364Z [2024-02-24 03:48:01,965: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1435dea5-6e69-41ca-843d-e09caaa729f0] succeeded in 1.637580134000018s: None
2024-02-24T03:48:02.652031674Z [2024-02-24 03:48:02,651: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ebb2b735-487a-474f-bb9d-aa10c61be097] succeeded in 2.3498371230016346s: None
2024-02-24T03:48:02.928853270Z [2024-02-24 03:48:02,928: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:48:02.935696296Z [2024-02-24 03:48:02,931: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:48:02.963144744Z [2024-02-24 03:48:02,962: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:48:02.965503413Z [2024-02-24 03:48:02,965: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:48:02.965738491Z [2024-02-24 03:48:02,965: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:48:02.966260790Z [2024-02-24 03:48:02,966: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:48:02.966432254Z [2024-02-24 03:48:02,966: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:48:02.966958985Z [2024-02-24 03:48:02,966: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:48:02.967175287Z [2024-02-24 03:48:02,967: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:48:03.092525239Z [2024-02-24 03:48:03,092: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:48:03.389251000Z [2024-02-24 03:48:03,388: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:48:03.393640728Z [2024-02-24 03:48:03,393: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:48:03.422563710Z [2024-02-24 03:48:03,422: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:48:03.428276183Z [2024-02-24 03:48:03,427: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:48:03.428496916Z [2024-02-24 03:48:03,428: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:48:03.428725640Z [2024-02-24 03:48:03,428: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:48:03.428956925Z [2024-02-24 03:48:03,428: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:48:03.429329827Z [2024-02-24 03:48:03,429: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:48:03.429892920Z [2024-02-24 03:48:03,429: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:48:03.578217101Z [2024-02-24 03:48:03,577: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:48:05.222361354Z [2024-02-24 03:48:05,221: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8e1d6af4-81f9-45df-9bd4-1161a959a34f] succeeded in 4.910861629999999s: None
2024-02-24T03:48:05.562829055Z [2024-02-24 03:48:05,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[d95af5f8-ab31-42b0-9a57-882abd1c1480] succeeded in 5.25092877499992s: None
2024-02-24T03:49:00.230091327Z [2024-02-24 03:49:00,229: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ff6853b7-ea09-4356-9fa4-e4ec937d4dc1] received
2024-02-24T03:49:00.233837042Z [2024-02-24 03:49:00,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f3737c51-7546-47e4-89a8-14cf44593f11] received
2024-02-24T03:49:00.239043878Z [2024-02-24 03:49:00,238: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[649d8d4f-8a94-46f1-b9c5-869ebd293867] received
2024-02-24T03:49:00.243186860Z [2024-02-24 03:49:00,242: INFO/ForkPoolWorker-15] [ff6853b7-ea09-4356-9fa4-e4ec937d4dc1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:49:00.246541612Z [2024-02-24 03:49:00,246: INFO/ForkPoolWorker-16] [f3737c51-7546-47e4-89a8-14cf44593f11] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:49:00.248420144Z [2024-02-24 03:49:00,248: INFO/ForkPoolWorker-1] [649d8d4f-8a94-46f1-b9c5-869ebd293867] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:49:00.529261472Z [2024-02-24 03:49:00,525: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:49:00.546288610Z [2024-02-24 03:49:00,542: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:49:00.580205980Z [2024-02-24 03:49:00,576: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:49:00.761235780Z [2024-02-24 03:49:00,760: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:49:00.765826203Z [2024-02-24 03:49:00,764: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:49:00.788360671Z [2024-02-24 03:49:00,788: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:49:00.789372201Z [2024-02-24 03:49:00,789: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:49:00.789495155Z [2024-02-24 03:49:00,789: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:49:00.789564842Z [2024-02-24 03:49:00,789: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:49:00.789867106Z [2024-02-24 03:49:00,789: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:49:00.888445612Z [2024-02-24 03:49:00,888: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:49:01.561767724Z [2024-02-24 03:49:01,561: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[649d8d4f-8a94-46f1-b9c5-869ebd293867] succeeded in 1.3209347829997569s: None
2024-02-24T03:49:01.727703903Z [2024-02-24 03:49:01,727: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:49:01.730969241Z [2024-02-24 03:49:01,730: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:49:01.748677539Z [2024-02-24 03:49:01,748: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:49:01.750112097Z [2024-02-24 03:49:01,749: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:49:01.750132244Z [2024-02-24 03:49:01,750: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:49:01.750239698Z [2024-02-24 03:49:01,750: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:49:01.750253403Z [2024-02-24 03:49:01,750: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:49:01.750610076Z [2024-02-24 03:49:01,750: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:49:01.750623985Z [2024-02-24 03:49:01,750: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:49:01.800804728Z [2024-02-24 03:49:01,800: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:49:01.804154573Z [2024-02-24 03:49:01,803: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:49:01.829486198Z [2024-02-24 03:49:01,829: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:49:01.830992411Z [2024-02-24 03:49:01,830: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:49:01.831191758Z [2024-02-24 03:49:01,830: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:49:01.831436693Z [2024-02-24 03:49:01,831: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:49:01.831595624Z [2024-02-24 03:49:01,831: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:49:01.832115386Z [2024-02-24 03:49:01,831: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:49:01.832199783Z [2024-02-24 03:49:01,832: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:49:01.849585358Z [2024-02-24 03:49:01,849: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:49:01.918981563Z [2024-02-24 03:49:01,918: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:49:03.477274424Z [2024-02-24 03:49:03,476: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f3737c51-7546-47e4-89a8-14cf44593f11] succeeded in 3.241441713000313s: None
2024-02-24T03:49:03.827682986Z [2024-02-24 03:49:03,827: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ff6853b7-ea09-4356-9fa4-e4ec937d4dc1] succeeded in 3.5951521280003362s: None
2024-02-24T03:50:01.318106046Z [2024-02-24 03:50:01,317: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5618471a-27a5-414e-8a72-1dba4ff7696a] received
2024-02-24T03:50:01.321305698Z [2024-02-24 03:50:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7ffc5f60-a234-4a52-9fd9-2f6655bf68a8] received
2024-02-24T03:50:01.324445639Z [2024-02-24 03:50:01,324: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0a9097fa-b148-4494-b553-4ac3c32422bb] received
2024-02-24T03:50:01.325569398Z [2024-02-24 03:50:01,325: INFO/ForkPoolWorker-15] [5618471a-27a5-414e-8a72-1dba4ff7696a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:50:01.327514077Z [2024-02-24 03:50:01,327: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a51a5ef-0b99-4dcb-948e-efb792027fb5] received
2024-02-24T03:50:01.330576921Z [2024-02-24 03:50:01,330: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ae09a9e-6a7c-40db-a5b5-b9e057b7b235] received
2024-02-24T03:50:01.336782024Z [2024-02-24 03:50:01,336: INFO/ForkPoolWorker-16] [7ffc5f60-a234-4a52-9fd9-2f6655bf68a8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:50:01.346110470Z [2024-02-24 03:50:01,345: INFO/ForkPoolWorker-1] [0a9097fa-b148-4494-b553-4ac3c32422bb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:50:01.349989532Z [2024-02-24 03:50:01,349: INFO/ForkPoolWorker-3] [9ae09a9e-6a7c-40db-a5b5-b9e057b7b235] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:50:01.368514210Z [2024-02-24 03:50:01,368: INFO/ForkPoolWorker-2] [2a51a5ef-0b99-4dcb-948e-efb792027fb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:50:01.676933907Z [2024-02-24 03:50:01,667: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:50:01.804962446Z [2024-02-24 03:50:01,801: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:50:01.845377646Z [2024-02-24 03:50:01,841: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:50:01.847208651Z [2024-02-24 03:50:01,846: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:50:01.851084127Z [2024-02-24 03:50:01,850: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:01.893112693Z [2024-02-24 03:50:01,878: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:50:01.914868185Z [2024-02-24 03:50:01,914: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:50:01.920819833Z [2024-02-24 03:50:01,920: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:50:01.920988045Z [2024-02-24 03:50:01,920: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:50:01.921350489Z [2024-02-24 03:50:01,921: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:50:01.921597629Z [2024-02-24 03:50:01,921: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:50:01.975626778Z [2024-02-24 03:50:01,964: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:50:02.055342298Z [2024-02-24 03:50:02,055: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:02.287099977Z [2024-02-24 03:50:02,286: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:02.878756594Z [2024-02-24 03:50:02,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5618471a-27a5-414e-8a72-1dba4ff7696a] succeeded in 1.559241564000331s: None
2024-02-24T03:50:03.183782634Z [2024-02-24 03:50:03,183: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[9ae09a9e-6a7c-40db-a5b5-b9e057b7b235] succeeded in 1.850086875998386s: None
2024-02-24T03:50:03.467524123Z [2024-02-24 03:50:03,467: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:50:03.473279704Z [2024-02-24 03:50:03,472: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:03.495987504Z [2024-02-24 03:50:03,495: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:50:03.498804680Z [2024-02-24 03:50:03,498: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:50:03.499598740Z [2024-02-24 03:50:03,499: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:03.502682144Z [2024-02-24 03:50:03,502: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:03.503219314Z [2024-02-24 03:50:03,502: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:03.503517089Z [2024-02-24 03:50:03,503: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:03.503862424Z [2024-02-24 03:50:03,503: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:50:03.504222603Z [2024-02-24 03:50:03,504: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:50:03.505010867Z [2024-02-24 03:50:03,504: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:03.524600985Z [2024-02-24 03:50:03,524: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:50:03.528805715Z [2024-02-24 03:50:03,528: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:03.544297139Z [2024-02-24 03:50:03,544: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:50:03.545561418Z [2024-02-24 03:50:03,545: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:03.545624239Z [2024-02-24 03:50:03,545: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:03.545722127Z [2024-02-24 03:50:03,545: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:03.545790077Z [2024-02-24 03:50:03,545: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:50:03.546094237Z [2024-02-24 03:50:03,545: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:50:03.546135226Z [2024-02-24 03:50:03,546: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:03.559778620Z [2024-02-24 03:50:03,559: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:50:03.562555291Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:03.562635842Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:03.562669771Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:03.562729293Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:50:03.562955648Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:50:03.562976679Z [2024-02-24 03:50:03,562: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:03.663695526Z [2024-02-24 03:50:03,663: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:03.679425481Z [2024-02-24 03:50:03,679: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:03.679451346Z [2024-02-24 03:50:03,679: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:04.394001192Z [2024-02-24 03:50:04,393: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2a51a5ef-0b99-4dcb-948e-efb792027fb5] succeeded in 3.0598948169990763s: None
2024-02-24T03:50:04.710908466Z [2024-02-24 03:50:04,710: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fcf8b356-d9da-416d-97e3-2577fe83beef] received
2024-02-24T03:50:04.717554426Z [2024-02-24 03:50:04,717: INFO/ForkPoolWorker-15] [fcf8b356-d9da-416d-97e3-2577fe83beef] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:50:05.045106641Z [2024-02-24 03:50:05,041: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:50:05.578107273Z [2024-02-24 03:50:05,577: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0a9097fa-b148-4494-b553-4ac3c32422bb] succeeded in 4.250909708000108s: None
2024-02-24T03:50:05.757131422Z [2024-02-24 03:50:05,756: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[7ffc5f60-a234-4a52-9fd9-2f6655bf68a8] succeeded in 4.433452670999031s: None
2024-02-24T03:50:06.147855177Z [2024-02-24 03:50:06,147: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:50:06.151042802Z [2024-02-24 03:50:06,150: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:06.175170393Z [2024-02-24 03:50:06,174: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:50:06.178697651Z [2024-02-24 03:50:06,178: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:06.178740082Z [2024-02-24 03:50:06,178: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:06.179803799Z [2024-02-24 03:50:06,178: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:06.180063163Z [2024-02-24 03:50:06,179: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:50:06.180488320Z [2024-02-24 03:50:06,180: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:50:06.180738167Z [2024-02-24 03:50:06,180: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:06.258041806Z [2024-02-24 03:50:06,257: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:06.902638905Z [2024-02-24 03:50:06,901: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fcf8b356-d9da-416d-97e3-2577fe83beef] succeeded in 2.1895466080004553s: None
2024-02-24T03:50:07.558863145Z [2024-02-24 03:50:07,558: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[342dd8ee-5bb1-4c39-b014-bdeda9c1a580] received
2024-02-24T03:50:07.567322143Z [2024-02-24 03:50:07,566: INFO/ForkPoolWorker-15] [342dd8ee-5bb1-4c39-b014-bdeda9c1a580] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:50:07.844891733Z [2024-02-24 03:50:07,841: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:50:08.891306971Z [2024-02-24 03:50:08,890: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:50:08.894465866Z [2024-02-24 03:50:08,894: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:08.919090504Z [2024-02-24 03:50:08,918: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:50:08.919697559Z [2024-02-24 03:50:08,919: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:08.919885479Z [2024-02-24 03:50:08,919: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:08.920115848Z [2024-02-24 03:50:08,919: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:08.920281445Z [2024-02-24 03:50:08,920: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:50:08.920761870Z [2024-02-24 03:50:08,920: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:50:08.920920361Z [2024-02-24 03:50:08,920: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:09.076535444Z [2024-02-24 03:50:09,076: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:10.567469847Z [2024-02-24 03:50:10,566: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[342dd8ee-5bb1-4c39-b014-bdeda9c1a580] succeeded in 3.0065600790003373s: None
2024-02-24T03:50:11.335355686Z [2024-02-24 03:50:11,332: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89bf9568-a390-4b20-a25c-d53af23fec09] received
2024-02-24T03:50:11.344853463Z [2024-02-24 03:50:11,344: INFO/ForkPoolWorker-15] [89bf9568-a390-4b20-a25c-d53af23fec09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:50:11.625946912Z [2024-02-24 03:50:11,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:50:12.750529293Z [2024-02-24 03:50:12,750: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:50:12.754188830Z [2024-02-24 03:50:12,753: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:50:12.783406510Z [2024-02-24 03:50:12,783: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:50:12.785092104Z [2024-02-24 03:50:12,784: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:50:12.785389008Z [2024-02-24 03:50:12,785: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:50:12.786019505Z [2024-02-24 03:50:12,785: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:50:12.789613145Z [2024-02-24 03:50:12,786: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:50:12.790815112Z [2024-02-24 03:50:12,790: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:50:12.793915343Z [2024-02-24 03:50:12,793: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:50:12.904106252Z [2024-02-24 03:50:12,903: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:50:13.559592823Z [2024-02-24 03:50:13,558: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89bf9568-a390-4b20-a25c-d53af23fec09] succeeded in 2.2214841610002622s: None
2024-02-24T03:51:00.459922928Z [2024-02-24 03:51:00,459: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be2c0fcd-067b-490d-8402-154a54a65224] received
2024-02-24T03:51:00.465006855Z [2024-02-24 03:51:00,464: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[15e2a8d8-c392-46a7-a9c1-653eb3676a09] received
2024-02-24T03:51:00.465870918Z [2024-02-24 03:51:00,465: INFO/ForkPoolWorker-15] [be2c0fcd-067b-490d-8402-154a54a65224] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:51:00.479581565Z [2024-02-24 03:51:00,479: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1874a01a-37a2-42dd-a556-2ac2e0d10ac6] received
2024-02-24T03:51:00.482846906Z [2024-02-24 03:51:00,482: INFO/ForkPoolWorker-16] [15e2a8d8-c392-46a7-a9c1-653eb3676a09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:51:00.485546367Z [2024-02-24 03:51:00,485: INFO/ForkPoolWorker-1] [1874a01a-37a2-42dd-a556-2ac2e0d10ac6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:51:00.795103000Z [2024-02-24 03:51:00,787: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:51:00.815830360Z [2024-02-24 03:51:00,812: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:51:00.824941833Z [2024-02-24 03:51:00,821: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:51:00.947667559Z [2024-02-24 03:51:00,947: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T03:51:00.953645182Z [2024-02-24 03:51:00,953: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:51:00.994064637Z [2024-02-24 03:51:00,993: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:51:00.995489147Z [2024-02-24 03:51:00,995: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:51:00.995700220Z [2024-02-24 03:51:00,995: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:51:00.995816682Z [2024-02-24 03:51:00,995: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T03:51:00.996247800Z [2024-02-24 03:51:00,995: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:51:01.106539872Z [2024-02-24 03:51:01,106: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:51:01.858631991Z [2024-02-24 03:51:01,857: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[be2c0fcd-067b-490d-8402-154a54a65224] succeeded in 1.3962269830008154s: None
2024-02-24T03:51:02.222088491Z [2024-02-24 03:51:02,221: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:51:02.225684313Z [2024-02-24 03:51:02,225: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:51:02.240005869Z [2024-02-24 03:51:02,239: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:51:02.243460708Z [2024-02-24 03:51:02,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:51:02.247932722Z [2024-02-24 03:51:02,247: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:51:02.249237483Z [2024-02-24 03:51:02,248: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:51:02.249825620Z [2024-02-24 03:51:02,249: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:51:02.250333181Z [2024-02-24 03:51:02,250: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:51:02.250408904Z [2024-02-24 03:51:02,250: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:51:02.250754073Z [2024-02-24 03:51:02,250: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:51:02.251500006Z [2024-02-24 03:51:02,250: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:51:02.266420029Z [2024-02-24 03:51:02,266: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:51:02.268999768Z [2024-02-24 03:51:02,268: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:51:02.269526299Z [2024-02-24 03:51:02,268: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:51:02.269735914Z [2024-02-24 03:51:02,269: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:51:02.269926000Z [2024-02-24 03:51:02,269: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:51:02.270276423Z [2024-02-24 03:51:02,270: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:51:02.270365734Z [2024-02-24 03:51:02,270: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:51:02.368297500Z [2024-02-24 03:51:02,367: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:51:02.407809899Z [2024-02-24 03:51:02,407: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:51:03.995326108Z [2024-02-24 03:51:03,994: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1874a01a-37a2-42dd-a556-2ac2e0d10ac6] succeeded in 3.5141625060005026s: None
2024-02-24T03:51:04.799979939Z [2024-02-24 03:51:04,799: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[15e2a8d8-c392-46a7-a9c1-653eb3676a09] succeeded in 4.32733511600054s: None
2024-02-24T03:51:58.206660971Z [2024-02-24 03:51:58,206: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77181044-6bfa-4590-9242-33bee5796090] received
2024-02-24T03:51:58.220869925Z [2024-02-24 03:51:58,220: INFO/ForkPoolWorker-15] [77181044-6bfa-4590-9242-33bee5796090] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240224035156_391051', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py']
2024-02-24T03:51:58.486083477Z [2024-02-24 03:51:58,482: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py
2024-02-24T03:51:58.785183081Z [2024-02-24 03:51:58,784: INFO/ForkPoolWorker-15] Running <TaskInstance: scaleout_vdu.main_task scaleout_vdu_20240224035156_391051 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:51:59.403209108Z [2024-02-24 03:51:59,402: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[77181044-6bfa-4590-9242-33bee5796090] succeeded in 1.191819124000176s: None
2024-02-24T03:52:00.678026461Z [2024-02-24 03:52:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[048a9ef0-68ef-4fa6-9254-85bf3f73ac76] received
2024-02-24T03:52:00.683896518Z [2024-02-24 03:52:00,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d79a2b65-66bd-4f6e-804c-bab77f337768] received
2024-02-24T03:52:00.684564880Z [2024-02-24 03:52:00,684: INFO/ForkPoolWorker-15] [048a9ef0-68ef-4fa6-9254-85bf3f73ac76] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:52:00.690825027Z [2024-02-24 03:52:00,690: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac037af4-f201-439a-9d5d-82144e632f44] received
2024-02-24T03:52:00.696493685Z [2024-02-24 03:52:00,696: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99a8d524-c350-44bf-b1c1-7a254831e5de] received
2024-02-24T03:52:00.697437873Z [2024-02-24 03:52:00,697: INFO/ForkPoolWorker-16] [d79a2b65-66bd-4f6e-804c-bab77f337768] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:52:00.708894622Z [2024-02-24 03:52:00,708: INFO/ForkPoolWorker-2] [99a8d524-c350-44bf-b1c1-7a254831e5de] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:52:00.712077471Z [2024-02-24 03:52:00,711: INFO/ForkPoolWorker-1] [ac037af4-f201-439a-9d5d-82144e632f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:52:01.008939281Z [2024-02-24 03:52:01,005: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:52:01.074480696Z [2024-02-24 03:52:01,063: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:52:01.115405686Z [2024-02-24 03:52:01,111: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:52:01.232257076Z [2024-02-24 03:52:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:52:01.321875148Z [2024-02-24 03:52:01,319: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:52:01.333677715Z [2024-02-24 03:52:01,333: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:52:01.337530269Z [2024-02-24 03:52:01,337: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:52:01.382725684Z [2024-02-24 03:52:01,382: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:52:01.386903172Z [2024-02-24 03:52:01,386: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:52:01.387130167Z [2024-02-24 03:52:01,386: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:52:01.387336889Z [2024-02-24 03:52:01,387: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:52:01.387597684Z [2024-02-24 03:52:01,387: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:52:01.505404445Z [2024-02-24 03:52:01,505: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:52:02.079942122Z [2024-02-24 03:52:02,079: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[99a8d524-c350-44bf-b1c1-7a254831e5de] succeeded in 1.3770852960005868s: None
2024-02-24T03:52:02.086263310Z [2024-02-24 03:52:02,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[048a9ef0-68ef-4fa6-9254-85bf3f73ac76] succeeded in 1.4060815190005087s: None
2024-02-24T03:52:02.382145233Z [2024-02-24 03:52:02,381: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:52:02.389893878Z [2024-02-24 03:52:02,384: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:52:02.412730421Z [2024-02-24 03:52:02,412: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:52:02.414508935Z [2024-02-24 03:52:02,414: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:52:02.414574906Z [2024-02-24 03:52:02,414: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:52:02.414837711Z [2024-02-24 03:52:02,414: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:52:02.414973717Z [2024-02-24 03:52:02,414: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:52:02.415327522Z [2024-02-24 03:52:02,415: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:52:02.415413590Z [2024-02-24 03:52:02,415: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:52:02.523933835Z [2024-02-24 03:52:02,523: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:52:02.527355237Z [2024-02-24 03:52:02,526: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:52:02.532598215Z [2024-02-24 03:52:02,532: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:52:02.545901073Z [2024-02-24 03:52:02,545: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:52:02.547283996Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:52:02.547433902Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:52:02.547605527Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:52:02.547654678Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:52:02.547929827Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:52:02.548035963Z [2024-02-24 03:52:02,547: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:52:02.677907442Z [2024-02-24 03:52:02,677: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:52:04.623169241Z [2024-02-24 03:52:04,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ac037af4-f201-439a-9d5d-82144e632f44] succeeded in 3.925390125999911s: None
2024-02-24T03:52:04.761100937Z [2024-02-24 03:52:04,760: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d79a2b65-66bd-4f6e-804c-bab77f337768] succeeded in 4.074605911000617s: None
2024-02-24T03:53:00.408348831Z [2024-02-24 03:53:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b11be9e8-c5ef-494c-a50d-5826a2b4473d] received
2024-02-24T03:53:00.418778091Z [2024-02-24 03:53:00,418: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2109a490-caa1-44c0-a4fd-d521a33799b3] received
2024-02-24T03:53:00.421009226Z [2024-02-24 03:53:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[04eb47b0-91a6-40f7-bafa-c266e5f92516] received
2024-02-24T03:53:00.425211939Z [2024-02-24 03:53:00,424: INFO/ForkPoolWorker-16] [2109a490-caa1-44c0-a4fd-d521a33799b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:53:00.428995682Z [2024-02-24 03:53:00,428: INFO/ForkPoolWorker-15] [b11be9e8-c5ef-494c-a50d-5826a2b4473d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:53:00.430133336Z [2024-02-24 03:53:00,429: INFO/ForkPoolWorker-1] [04eb47b0-91a6-40f7-bafa-c266e5f92516] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:53:00.716786075Z [2024-02-24 03:53:00,713: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:53:00.732411685Z [2024-02-24 03:53:00,729: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:53:00.774959021Z [2024-02-24 03:53:00,771: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:53:00.888054702Z [2024-02-24 03:53:00,887: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:53:00.892135131Z [2024-02-24 03:53:00,891: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:53:00.930935692Z [2024-02-24 03:53:00,930: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:53:00.935455645Z [2024-02-24 03:53:00,935: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:53:00.935726945Z [2024-02-24 03:53:00,935: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:53:00.935904075Z [2024-02-24 03:53:00,935: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:53:00.936325338Z [2024-02-24 03:53:00,936: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:53:01.069454546Z [2024-02-24 03:53:01,069: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:53:01.718556790Z [2024-02-24 03:53:01,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[04eb47b0-91a6-40f7-bafa-c266e5f92516] succeeded in 1.2958531399999629s: None
2024-02-24T03:53:01.969266454Z [2024-02-24 03:53:01,968: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:53:01.972398566Z [2024-02-24 03:53:01,971: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:53:01.997667129Z [2024-02-24 03:53:01,997: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:53:01.998840597Z [2024-02-24 03:53:01,998: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:53:01.999185221Z [2024-02-24 03:53:01,998: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:53:01.999220257Z [2024-02-24 03:53:01,999: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:53:01.999347202Z [2024-02-24 03:53:01,999: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:53:01.999391457Z [2024-02-24 03:53:01,999: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:53:01.999726991Z [2024-02-24 03:53:01,999: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:53:01.999881800Z [2024-02-24 03:53:01,999: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:53:02.002505097Z [2024-02-24 03:53:02,002: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:53:02.027410935Z [2024-02-24 03:53:02,027: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:53:02.028798819Z [2024-02-24 03:53:02,028: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:53:02.029035491Z [2024-02-24 03:53:02,028: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:53:02.029263955Z [2024-02-24 03:53:02,028: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:53:02.029402441Z [2024-02-24 03:53:02,029: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:53:02.029747663Z [2024-02-24 03:53:02,029: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:53:02.029901426Z [2024-02-24 03:53:02,029: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:53:02.105824075Z [2024-02-24 03:53:02,105: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:53:02.110740035Z [2024-02-24 03:53:02,110: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:53:03.741492214Z [2024-02-24 03:53:03,740: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2109a490-caa1-44c0-a4fd-d521a33799b3] succeeded in 3.3205340140011685s: None
2024-02-24T03:53:04.080552917Z [2024-02-24 03:53:04,080: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b11be9e8-c5ef-494c-a50d-5826a2b4473d] succeeded in 3.6693657220002933s: None
2024-02-24T03:54:00.467449909Z [2024-02-24 03:54:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9d524ca-111f-4479-89c4-bda9af907638] received
2024-02-24T03:54:00.469885202Z [2024-02-24 03:54:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fbb139f-ff85-4f3b-9b20-dd8a61c7861c] received
2024-02-24T03:54:00.474791265Z [2024-02-24 03:54:00,474: INFO/ForkPoolWorker-15] [d9d524ca-111f-4479-89c4-bda9af907638] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:54:00.483752516Z [2024-02-24 03:54:00,483: INFO/ForkPoolWorker-16] [8fbb139f-ff85-4f3b-9b20-dd8a61c7861c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:54:00.488215568Z [2024-02-24 03:54:00,487: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ce03a23-3765-4f06-950d-f3b3724f96a9] received
2024-02-24T03:54:00.492774657Z [2024-02-24 03:54:00,492: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4206303a-a509-4bae-87b5-99e0af646587] received
2024-02-24T03:54:00.504628356Z [2024-02-24 03:54:00,504: INFO/ForkPoolWorker-1] [4ce03a23-3765-4f06-950d-f3b3724f96a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:54:00.506755665Z [2024-02-24 03:54:00,506: INFO/ForkPoolWorker-2] [4206303a-a509-4bae-87b5-99e0af646587] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:54:00.784538016Z [2024-02-24 03:54:00,781: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:54:00.850271096Z [2024-02-24 03:54:00,847: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:54:00.901548620Z [2024-02-24 03:54:00,898: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:54:00.928802697Z [2024-02-24 03:54:00,925: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:54:01.118403455Z [2024-02-24 03:54:01,118: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:54:01.122961044Z [2024-02-24 03:54:01,122: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:54:01.150683126Z [2024-02-24 03:54:01,150: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:54:01.177747647Z [2024-02-24 03:54:01,176: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:54:01.182981531Z [2024-02-24 03:54:01,182: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:54:01.183516608Z [2024-02-24 03:54:01,182: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:54:01.183925788Z [2024-02-24 03:54:01,183: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:54:01.184587528Z [2024-02-24 03:54:01,184: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:54:01.342611341Z [2024-02-24 03:54:01,342: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:54:01.736533957Z [2024-02-24 03:54:01,736: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d9d524ca-111f-4479-89c4-bda9af907638] succeeded in 1.267268391999096s: None
2024-02-24T03:54:01.955088025Z [2024-02-24 03:54:01,954: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4206303a-a509-4bae-87b5-99e0af646587] succeeded in 1.458734457999526s: None
2024-02-24T03:54:02.125877481Z [2024-02-24 03:54:02,125: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:54:02.129389857Z [2024-02-24 03:54:02,128: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:54:02.152315860Z [2024-02-24 03:54:02,152: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:54:02.153905055Z [2024-02-24 03:54:02,153: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:54:02.154047467Z [2024-02-24 03:54:02,153: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:54:02.154339665Z [2024-02-24 03:54:02,154: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:54:02.154378171Z [2024-02-24 03:54:02,154: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:54:02.154626472Z [2024-02-24 03:54:02,154: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:54:02.154839665Z [2024-02-24 03:54:02,154: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:54:02.231486742Z [2024-02-24 03:54:02,230: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:54:02.234737262Z [2024-02-24 03:54:02,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:54:02.255375809Z [2024-02-24 03:54:02,255: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:54:02.256664764Z [2024-02-24 03:54:02,256: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:54:02.258536457Z [2024-02-24 03:54:02,258: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:54:02.258623491Z [2024-02-24 03:54:02,258: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:54:02.258852677Z [2024-02-24 03:54:02,258: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:54:02.258947477Z [2024-02-24 03:54:02,258: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:54:02.259463328Z [2024-02-24 03:54:02,259: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:54:02.259560487Z [2024-02-24 03:54:02,259: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:54:02.356320792Z [2024-02-24 03:54:02,356: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:54:03.956792628Z [2024-02-24 03:54:03,956: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4ce03a23-3765-4f06-950d-f3b3724f96a9] succeeded in 3.4663254209990555s: None
2024-02-24T03:54:04.264563470Z [2024-02-24 03:54:04,264: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fbb139f-ff85-4f3b-9b20-dd8a61c7861c] succeeded in 3.7916409669996938s: None
2024-02-24T03:55:00.268725876Z [2024-02-24 03:55:00,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8066a001-8032-4a77-9d20-a872ee767597] received
2024-02-24T03:55:00.274583226Z [2024-02-24 03:55:00,274: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70895133-a4fc-485c-9622-fa068c178168] received
2024-02-24T03:55:00.282048163Z [2024-02-24 03:55:00,281: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27bb5194-205b-40ed-8118-220f6ff8a62d] received
2024-02-24T03:55:00.285460112Z [2024-02-24 03:55:00,285: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac1b1838-7b32-4b03-95b4-24bab31b2147] received
2024-02-24T03:55:00.286696426Z [2024-02-24 03:55:00,286: INFO/ForkPoolWorker-16] [70895133-a4fc-485c-9622-fa068c178168] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:55:00.291557569Z [2024-02-24 03:55:00,291: INFO/ForkPoolWorker-15] [8066a001-8032-4a77-9d20-a872ee767597] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:55:00.292398093Z [2024-02-24 03:55:00,292: INFO/ForkPoolWorker-2] [ac1b1838-7b32-4b03-95b4-24bab31b2147] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:55:00.292878789Z [2024-02-24 03:55:00,292: INFO/ForkPoolWorker-1] [27bb5194-205b-40ed-8118-220f6ff8a62d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:55:00.581842651Z [2024-02-24 03:55:00,578: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:55:00.604422977Z [2024-02-24 03:55:00,601: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:55:00.612215225Z [2024-02-24 03:55:00,609: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:55:00.751468965Z [2024-02-24 03:55:00,748: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:55:00.956297057Z [2024-02-24 03:55:00,955: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:55:00.960641578Z [2024-02-24 03:55:00,960: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:00.983973948Z [2024-02-24 03:55:00,983: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:55:00.984895123Z [2024-02-24 03:55:00,984: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:55:00.984982161Z [2024-02-24 03:55:00,984: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:55:00.985083296Z [2024-02-24 03:55:00,984: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:55:00.985302141Z [2024-02-24 03:55:00,985: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:55:01.083276166Z [2024-02-24 03:55:01,083: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:01.827859436Z [2024-02-24 03:55:01,827: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:55:01.836115880Z [2024-02-24 03:55:01,835: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:01.857721030Z [2024-02-24 03:55:01,857: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:55:01.859659733Z [2024-02-24 03:55:01,858: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:01.859677253Z [2024-02-24 03:55:01,859: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:01.859693722Z [2024-02-24 03:55:01,859: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:01.859698018Z [2024-02-24 03:55:01,859: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:55:01.859701607Z [2024-02-24 03:55:01,859: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:55:01.859704789Z [2024-02-24 03:55:01,859: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:01.873892790Z [2024-02-24 03:55:01,873: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ac1b1838-7b32-4b03-95b4-24bab31b2147] succeeded in 1.585632173999329s: None
2024-02-24T03:55:01.931255088Z [2024-02-24 03:55:01,929: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:55:01.933223533Z [2024-02-24 03:55:01,932: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:01.961596042Z [2024-02-24 03:55:01,961: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:55:01.963243816Z [2024-02-24 03:55:01,962: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:01.963262852Z [2024-02-24 03:55:01,963: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:01.963403890Z [2024-02-24 03:55:01,963: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:01.963414696Z [2024-02-24 03:55:01,963: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:55:01.963645467Z [2024-02-24 03:55:01,963: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:55:01.963673120Z [2024-02-24 03:55:01,963: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:01.969884743Z [2024-02-24 03:55:01,969: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:02.055050881Z [2024-02-24 03:55:02,054: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:02.076068286Z [2024-02-24 03:55:02,075: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:55:02.079416551Z [2024-02-24 03:55:02,078: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:02.115671423Z [2024-02-24 03:55:02,115: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:55:02.117097401Z [2024-02-24 03:55:02,116: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:02.117231387Z [2024-02-24 03:55:02,117: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:02.117417777Z [2024-02-24 03:55:02,117: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:02.117497384Z [2024-02-24 03:55:02,117: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:55:02.117851914Z [2024-02-24 03:55:02,117: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:55:02.118010633Z [2024-02-24 03:55:02,117: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:02.217598103Z [2024-02-24 03:55:02,217: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:02.996960993Z [2024-02-24 03:55:02,996: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[efdfd8df-9cc0-4328-8845-22b1c640c7cf] received
2024-02-24T03:55:03.007216746Z [2024-02-24 03:55:03,006: INFO/ForkPoolWorker-2] [efdfd8df-9cc0-4328-8845-22b1c640c7cf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:55:03.083133103Z [2024-02-24 03:55:03,082: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8066a001-8032-4a77-9d20-a872ee767597] succeeded in 2.8101481730009255s: None
2024-02-24T03:55:03.356680027Z [2024-02-24 03:55:03,351: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:55:03.807648467Z [2024-02-24 03:55:03,807: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70895133-a4fc-485c-9622-fa068c178168] succeeded in 3.5302327329991385s: None
2024-02-24T03:55:04.521076175Z [2024-02-24 03:55:04,520: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27bb5194-205b-40ed-8118-220f6ff8a62d] succeeded in 4.236794299999019s: None
2024-02-24T03:55:04.892679602Z [2024-02-24 03:55:04,892: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T03:55:04.896227290Z [2024-02-24 03:55:04,895: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:04.924128317Z [2024-02-24 03:55:04,923: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:55:04.925895402Z [2024-02-24 03:55:04,925: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:04.925916573Z [2024-02-24 03:55:04,925: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:04.925998493Z [2024-02-24 03:55:04,925: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:04.926034010Z [2024-02-24 03:55:04,925: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T03:55:04.926321910Z [2024-02-24 03:55:04,926: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:55:04.926374837Z [2024-02-24 03:55:04,926: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:05.048416008Z [2024-02-24 03:55:05,047: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:05.686498051Z [2024-02-24 03:55:05,686: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[802a397a-ab5e-47ea-8b9c-bb0384b89afc] received
2024-02-24T03:55:05.698396658Z [2024-02-24 03:55:05,698: INFO/ForkPoolWorker-15] [802a397a-ab5e-47ea-8b9c-bb0384b89afc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T03:55:05.752631306Z [2024-02-24 03:55:05,752: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[efdfd8df-9cc0-4328-8845-22b1c640c7cf] succeeded in 2.7537337169997045s: None
2024-02-24T03:55:06.184973939Z [2024-02-24 03:55:06,181: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:55:07.345036255Z [2024-02-24 03:55:07,344: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:55:07.348356227Z [2024-02-24 03:55:07,347: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:07.368868522Z [2024-02-24 03:55:07,368: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:55:07.370307288Z [2024-02-24 03:55:07,369: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:07.370480835Z [2024-02-24 03:55:07,370: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:07.370600616Z [2024-02-24 03:55:07,370: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:07.370621131Z [2024-02-24 03:55:07,370: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:55:07.371002040Z [2024-02-24 03:55:07,370: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:55:07.371450116Z [2024-02-24 03:55:07,370: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:07.465338539Z [2024-02-24 03:55:07,465: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:09.311155566Z [2024-02-24 03:55:09,310: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[802a397a-ab5e-47ea-8b9c-bb0384b89afc] succeeded in 3.622495474999596s: None
2024-02-24T03:55:10.268645138Z [2024-02-24 03:55:10,268: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[af4d4c80-6ac3-4291-8d60-d998ef989e2c] received
2024-02-24T03:55:10.278275713Z [2024-02-24 03:55:10,277: INFO/ForkPoolWorker-15] [af4d4c80-6ac3-4291-8d60-d998ef989e2c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T03:55:10.600054014Z [2024-02-24 03:55:10,596: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T03:55:11.681897958Z [2024-02-24 03:55:11,681: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:55:11.685044649Z [2024-02-24 03:55:11,684: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:55:11.714407205Z [2024-02-24 03:55:11,714: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:55:11.716407802Z [2024-02-24 03:55:11,716: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:55:11.717045048Z [2024-02-24 03:55:11,716: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:55:11.717256060Z [2024-02-24 03:55:11,716: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:55:11.717383344Z [2024-02-24 03:55:11,717: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:55:11.717845855Z [2024-02-24 03:55:11,717: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T03:55:11.717854245Z [2024-02-24 03:55:11,717: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:55:11.822418332Z [2024-02-24 03:55:11,822: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:12.463298768Z [2024-02-24 03:55:12,462: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[af4d4c80-6ac3-4291-8d60-d998ef989e2c] succeeded in 2.1911444569996092s: None
2024-02-24T03:55:57.565390504Z [2024-02-24 03:55:57,565: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f02ef422-c146-4168-9cd0-1e3ca5bfd3d3] received
2024-02-24T03:55:57.594676600Z [2024-02-24 03:55:57,594: INFO/ForkPoolWorker-15] [f02ef422-c146-4168-9cd0-1e3ca5bfd3d3] Executing command in Celery: ['airflow', 'tasks', 'run', 'scaleout_vdu', 'main_task', 'scaleout_vdu_20240224035556_380417', '--local', '--subdir', 'DAGS_FOLDER/dags/scaleout_vdu.py']
2024-02-24T03:55:57.869780511Z [2024-02-24 03:55:57,867: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/scaleout_vdu.py
2024-02-24T03:55:58.165347172Z [2024-02-24 03:55:58,164: INFO/ForkPoolWorker-15] Running <TaskInstance: scaleout_vdu.main_task scaleout_vdu_20240224035556_380417 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:55:58.812589117Z [2024-02-24 03:55:58,812: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f02ef422-c146-4168-9cd0-1e3ca5bfd3d3] succeeded in 1.244823050001287s: None
2024-02-24T03:56:01.220791174Z [2024-02-24 03:56:01,218: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[16bb72d9-63e1-4dbc-9133-7c83ac13d1d2] received
2024-02-24T03:56:01.221160681Z [2024-02-24 03:56:01,220: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[92eb3246-f87c-428e-ae44-25682c66fcc7] received
2024-02-24T03:56:01.230230804Z [2024-02-24 03:56:01,229: INFO/ForkPoolWorker-15] [16bb72d9-63e1-4dbc-9133-7c83ac13d1d2] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:56:01.245964042Z [2024-02-24 03:56:01,243: INFO/ForkPoolWorker-16] [92eb3246-f87c-428e-ae44-25682c66fcc7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:56:01.256142659Z [2024-02-24 03:56:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dee01c2b-f66a-4dda-a9d1-66d97da83d52] received
2024-02-24T03:56:01.256178636Z [2024-02-24 03:56:01,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3baa2cb6-0dae-4721-a80e-5b6cd4d13064] received
2024-02-24T03:56:01.269892767Z [2024-02-24 03:56:01,267: INFO/ForkPoolWorker-1] [dee01c2b-f66a-4dda-a9d1-66d97da83d52] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:56:01.287184122Z [2024-02-24 03:56:01,286: INFO/ForkPoolWorker-2] [3baa2cb6-0dae-4721-a80e-5b6cd4d13064] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:56:01.569499232Z [2024-02-24 03:56:01,566: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:56:01.608964497Z [2024-02-24 03:56:01,603: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:56:01.657400958Z [2024-02-24 03:56:01,654: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:56:01.765833253Z [2024-02-24 03:56:01,762: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:56:01.795554278Z [2024-02-24 03:56:01,795: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:56:01.800357646Z [2024-02-24 03:56:01,799: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:56:01.839978445Z [2024-02-24 03:56:01,839: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:56:01.842249034Z [2024-02-24 03:56:01,841: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:56:01.842657714Z [2024-02-24 03:56:01,842: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:56:01.842978943Z [2024-02-24 03:56:01,842: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:56:01.843748879Z [2024-02-24 03:56:01,843: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:56:01.932389053Z [2024-02-24 03:56:01,932: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:56:01.978668219Z [2024-02-24 03:56:01,978: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:56:02.454298843Z [2024-02-24 03:56:02,453: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[16bb72d9-63e1-4dbc-9133-7c83ac13d1d2] succeeded in 1.2316191749996506s: None
2024-02-24T03:56:02.816829229Z [2024-02-24 03:56:02,816: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3baa2cb6-0dae-4721-a80e-5b6cd4d13064] succeeded in 1.5599261570023373s: None
2024-02-24T03:56:03.121406071Z [2024-02-24 03:56:03,121: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:56:03.124607804Z [2024-02-24 03:56:03,124: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:56:03.151946568Z [2024-02-24 03:56:03,151: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:56:03.153995101Z [2024-02-24 03:56:03,153: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:56:03.154130607Z [2024-02-24 03:56:03,153: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:56:03.154205484Z [2024-02-24 03:56:03,153: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:56:03.154226197Z [2024-02-24 03:56:03,153: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:56:03.154638961Z [2024-02-24 03:56:03,154: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:56:03.154683103Z [2024-02-24 03:56:03,154: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:56:03.160176514Z [2024-02-24 03:56:03,159: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:56:03.163897600Z [2024-02-24 03:56:03,163: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:56:03.195586551Z [2024-02-24 03:56:03,195: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:56:03.196987739Z [2024-02-24 03:56:03,196: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:56:03.196997947Z [2024-02-24 03:56:03,196: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:56:03.197091654Z [2024-02-24 03:56:03,196: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:56:03.197098967Z [2024-02-24 03:56:03,197: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:56:03.197391977Z [2024-02-24 03:56:03,197: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:56:03.197400391Z [2024-02-24 03:56:03,197: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:56:03.264289404Z [2024-02-24 03:56:03,263: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:56:03.287637282Z [2024-02-24 03:56:03,287: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:56:05.728324694Z [2024-02-24 03:56:05,727: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dee01c2b-f66a-4dda-a9d1-66d97da83d52] succeeded in 4.468449261999922s: None
2024-02-24T03:56:06.072040196Z [2024-02-24 03:56:06,071: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[92eb3246-f87c-428e-ae44-25682c66fcc7] succeeded in 4.8492354700028955s: None
2024-02-24T03:57:00.828842537Z [2024-02-24 03:57:00,827: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da8fa6a3-40b7-4716-8d13-8349cf45ac88] received
2024-02-24T03:57:00.832621454Z [2024-02-24 03:57:00,831: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3f9c7323-349b-4a85-b082-d98ff33b2e6b] received
2024-02-24T03:57:00.839514080Z [2024-02-24 03:57:00,839: INFO/ForkPoolWorker-15] [da8fa6a3-40b7-4716-8d13-8349cf45ac88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:57:00.843307509Z [2024-02-24 03:57:00,843: INFO/ForkPoolWorker-16] [3f9c7323-349b-4a85-b082-d98ff33b2e6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:57:00.851262165Z [2024-02-24 03:57:00,851: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32351c1f-7f9a-4ad2-9eca-6f1dee795d6e] received
2024-02-24T03:57:00.859864451Z [2024-02-24 03:57:00,859: INFO/ForkPoolWorker-1] [32351c1f-7f9a-4ad2-9eca-6f1dee795d6e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:57:01.123990360Z [2024-02-24 03:57:01,120: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:57:01.245279462Z [2024-02-24 03:57:01,242: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:57:01.320844332Z [2024-02-24 03:57:01,320: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T03:57:01.327519179Z [2024-02-24 03:57:01,327: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:57:01.370773574Z [2024-02-24 03:57:01,370: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:57:01.374814718Z [2024-02-24 03:57:01,374: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:57:01.375119416Z [2024-02-24 03:57:01,374: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:57:01.375383987Z [2024-02-24 03:57:01,375: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T03:57:01.375693233Z [2024-02-24 03:57:01,375: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:57:01.453508411Z [2024-02-24 03:57:01,447: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:57:01.483792286Z [2024-02-24 03:57:01,483: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:57:02.108480660Z [2024-02-24 03:57:02,108: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[3f9c7323-349b-4a85-b082-d98ff33b2e6b] succeeded in 1.2714484360003553s: None
2024-02-24T03:57:02.515431897Z [2024-02-24 03:57:02,515: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:57:02.521969736Z [2024-02-24 03:57:02,518: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:57:02.556553216Z [2024-02-24 03:57:02,556: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:57:02.559617021Z [2024-02-24 03:57:02,559: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:57:02.559832056Z [2024-02-24 03:57:02,559: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:57:02.560116209Z [2024-02-24 03:57:02,559: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:57:02.560299467Z [2024-02-24 03:57:02,560: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:57:02.560758240Z [2024-02-24 03:57:02,560: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:57:02.561452538Z [2024-02-24 03:57:02,561: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:57:02.677196428Z [2024-02-24 03:57:02,673: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:57:02.723330975Z [2024-02-24 03:57:02,722: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:57:02.732242521Z [2024-02-24 03:57:02,731: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:57:02.750490973Z [2024-02-24 03:57:02,750: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:57:02.755291159Z [2024-02-24 03:57:02,754: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:57:02.755318731Z [2024-02-24 03:57:02,755: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:57:02.755357060Z [2024-02-24 03:57:02,755: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:57:02.755423371Z [2024-02-24 03:57:02,755: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:57:02.755669035Z [2024-02-24 03:57:02,755: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:57:02.755687045Z [2024-02-24 03:57:02,755: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:57:02.867588333Z [2024-02-24 03:57:02,867: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:57:05.008263243Z [2024-02-24 03:57:05,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da8fa6a3-40b7-4716-8d13-8349cf45ac88] succeeded in 4.17836218299999s: None
2024-02-24T03:57:05.369902824Z [2024-02-24 03:57:05,369: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[32351c1f-7f9a-4ad2-9eca-6f1dee795d6e] succeeded in 4.517014561002725s: None
2024-02-24T03:58:00.755455839Z [2024-02-24 03:58:00,755: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f769e66e-6807-4d58-b965-64b99a29dd83] received
2024-02-24T03:58:00.757301809Z [2024-02-24 03:58:00,757: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24e203f8-998d-4a57-992b-cf705416e1e9] received
2024-02-24T03:58:00.759251981Z [2024-02-24 03:58:00,759: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4361d535-4099-475a-83d1-833649113fec] received
2024-02-24T03:58:00.761399719Z [2024-02-24 03:58:00,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c979162f-eafe-4193-ba9d-eb2ae4243bf2] received
2024-02-24T03:58:00.761613283Z [2024-02-24 03:58:00,761: INFO/ForkPoolWorker-15] [f769e66e-6807-4d58-b965-64b99a29dd83] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:56:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T03:58:00.769366812Z [2024-02-24 03:58:00,769: INFO/ForkPoolWorker-16] [24e203f8-998d-4a57-992b-cf705416e1e9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:58:00.775177479Z [2024-02-24 03:58:00,774: INFO/ForkPoolWorker-1] [4361d535-4099-475a-83d1-833649113fec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:58:00.775728520Z [2024-02-24 03:58:00,775: INFO/ForkPoolWorker-2] [c979162f-eafe-4193-ba9d-eb2ae4243bf2] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:57:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:58:01.076141875Z [2024-02-24 03:58:01,072: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:58:01.163563539Z [2024-02-24 03:58:01,159: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:58:01.311898872Z [2024-02-24 03:58:01,293: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T03:58:01.316765809Z [2024-02-24 03:58:01,316: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T03:58:01.323826273Z [2024-02-24 03:58:01,323: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:58:01.373836775Z [2024-02-24 03:58:01,373: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T03:58:01.378101375Z [2024-02-24 03:58:01,377: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:58:01.378910455Z [2024-02-24 03:58:01,378: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:58:01.379118938Z [2024-02-24 03:58:01,378: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T03:58:01.379391738Z [2024-02-24 03:58:01,379: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:58:01.446673962Z [2024-02-24 03:58:01,443: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:58:01.536323960Z [2024-02-24 03:58:01,536: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:58:01.805582388Z [2024-02-24 03:58:01,805: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:56:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:58:02.180871106Z [2024-02-24 03:58:02,180: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c979162f-eafe-4193-ba9d-eb2ae4243bf2] succeeded in 1.416771008996875s: None
2024-02-24T03:58:02.317352904Z [2024-02-24 03:58:02,316: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f769e66e-6807-4d58-b965-64b99a29dd83] succeeded in 1.5599255449997145s: None
2024-02-24T03:58:02.733501882Z [2024-02-24 03:58:02,733: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T03:58:02.736740490Z [2024-02-24 03:58:02,736: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:58:02.737019809Z [2024-02-24 03:58:02,736: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:58:02.743931405Z [2024-02-24 03:58:02,743: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:58:02.765354618Z [2024-02-24 03:58:02,765: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:58:02.770128606Z [2024-02-24 03:58:02,769: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:58:02.770244317Z [2024-02-24 03:58:02,770: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:58:02.770560314Z [2024-02-24 03:58:02,770: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:58:02.770691391Z [2024-02-24 03:58:02,770: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T03:58:02.771064681Z [2024-02-24 03:58:02,770: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:58:02.771166679Z [2024-02-24 03:58:02,771: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:58:02.785492640Z [2024-02-24 03:58:02,785: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:58:02.787974703Z [2024-02-24 03:58:02,787: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:58:02.788187198Z [2024-02-24 03:58:02,787: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:58:02.788465888Z [2024-02-24 03:58:02,788: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:58:02.788756448Z [2024-02-24 03:58:02,788: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:58:02.789156414Z [2024-02-24 03:58:02,788: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:58:02.789337462Z [2024-02-24 03:58:02,789: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:58:02.892822112Z [2024-02-24 03:58:02,892: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:58:02.904638422Z [2024-02-24 03:58:02,904: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:57:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:58:05.414841434Z [2024-02-24 03:58:05,414: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[24e203f8-998d-4a57-992b-cf705416e1e9] succeeded in 4.655510919998051s: None
2024-02-24T03:58:05.929734704Z [2024-02-24 03:58:05,929: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4361d535-4099-475a-83d1-833649113fec] succeeded in 5.167233971002133s: None
2024-02-24T03:59:00.644546924Z [2024-02-24 03:59:00,644: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fd33e4a-f373-4d72-9313-2f3309b075a9] received
2024-02-24T03:59:00.654432669Z [2024-02-24 03:59:00,654: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdbc12a4-43d2-412e-8b5d-df37b6fbdab6] received
2024-02-24T03:59:00.655270698Z [2024-02-24 03:59:00,655: INFO/ForkPoolWorker-15] [9fd33e4a-f373-4d72-9313-2f3309b075a9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T03:59:00.670472314Z [2024-02-24 03:59:00,670: INFO/ForkPoolWorker-16] [fdbc12a4-43d2-412e-8b5d-df37b6fbdab6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T03:59:00.678111093Z [2024-02-24 03:59:00,677: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8e825cf-b6a9-4831-a719-0b35110c2303] received
2024-02-24T03:59:00.709964141Z [2024-02-24 03:59:00,709: INFO/ForkPoolWorker-1] [f8e825cf-b6a9-4831-a719-0b35110c2303] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T03:59:01.017264899Z [2024-02-24 03:59:01,011: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T03:59:01.118528018Z [2024-02-24 03:59:01,115: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T03:59:01.188403963Z [2024-02-24 03:59:01,185: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T03:59:01.385192958Z [2024-02-24 03:59:01,384: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T03:59:01.391815989Z [2024-02-24 03:59:01,391: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:59:01.424104369Z [2024-02-24 03:59:01,423: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T03:59:01.425436973Z [2024-02-24 03:59:01,425: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T03:59:01.425635646Z [2024-02-24 03:59:01,425: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T03:59:01.425719179Z [2024-02-24 03:59:01,425: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T03:59:01.426260786Z [2024-02-24 03:59:01,425: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T03:59:01.537889741Z [2024-02-24 03:59:01,537: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:59:02.274120188Z [2024-02-24 03:59:02,273: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[f8e825cf-b6a9-4831-a719-0b35110c2303] succeeded in 1.594137000000046s: None
2024-02-24T03:59:02.357141177Z [2024-02-24 03:59:02,356: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T03:59:02.360066638Z [2024-02-24 03:59:02,359: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:59:02.409936259Z [2024-02-24 03:59:02,408: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T03:59:02.413929580Z [2024-02-24 03:59:02,413: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T03:59:02.415138299Z [2024-02-24 03:59:02,414: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:59:02.415222896Z [2024-02-24 03:59:02,415: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:59:02.415360925Z [2024-02-24 03:59:02,415: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:59:02.415408829Z [2024-02-24 03:59:02,415: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T03:59:02.415777001Z [2024-02-24 03:59:02,415: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T03:59:02.415938444Z [2024-02-24 03:59:02,415: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:59:02.417979203Z [2024-02-24 03:59:02,417: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T03:59:02.440649144Z [2024-02-24 03:59:02,440: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T03:59:02.442134595Z [2024-02-24 03:59:02,441: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T03:59:02.442303188Z [2024-02-24 03:59:02,442: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T03:59:02.442475457Z [2024-02-24 03:59:02,442: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T03:59:02.442510415Z [2024-02-24 03:59:02,442: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T03:59:02.443078651Z [2024-02-24 03:59:02,442: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T03:59:02.443103761Z [2024-02-24 03:59:02,442: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T03:59:02.509452137Z [2024-02-24 03:59:02,509: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:59:02.547992624Z [2024-02-24 03:59:02,547: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T03:59:05.008005499Z [2024-02-24 03:59:05,007: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fd33e4a-f373-4d72-9313-2f3309b075a9] succeeded in 4.360863304002123s: None
2024-02-24T03:59:05.038445218Z [2024-02-24 03:59:05,038: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fdbc12a4-43d2-412e-8b5d-df37b6fbdab6] succeeded in 4.382633982997504s: None
2024-02-24T04:00:00.573431606Z [2024-02-24 04:00:00,573: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c5457ed0-2163-473c-97ca-cd398b189e35] received
2024-02-24T04:00:00.574667259Z [2024-02-24 04:00:00,574: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e01c7fc-6dfb-42f3-9d68-af083f56414c] received
2024-02-24T04:00:00.589622859Z [2024-02-24 04:00:00,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc83a934-6364-4785-b14c-a35a683d641f] received
2024-02-24T04:00:00.592575671Z [2024-02-24 04:00:00,591: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1dba4a59-ae17-459f-8eda-b1857bfa09dc] received
2024-02-24T04:00:00.594928296Z [2024-02-24 04:00:00,594: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77a522e0-71d4-4949-a118-f3b7d8870393] received
2024-02-24T04:00:00.600904703Z [2024-02-24 04:00:00,600: INFO/ForkPoolWorker-1] [fc83a934-6364-4785-b14c-a35a683d641f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T03:58:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:00:00.605281620Z [2024-02-24 04:00:00,605: INFO/ForkPoolWorker-16] [1e01c7fc-6dfb-42f3-9d68-af083f56414c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:00:00.610562647Z [2024-02-24 04:00:00,610: INFO/ForkPoolWorker-2] [1dba4a59-ae17-459f-8eda-b1857bfa09dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:00:00.614467106Z [2024-02-24 04:00:00,614: INFO/ForkPoolWorker-15] [c5457ed0-2163-473c-97ca-cd398b189e35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:00:00.618227628Z [2024-02-24 04:00:00,617: INFO/ForkPoolWorker-3] [77a522e0-71d4-4949-a118-f3b7d8870393] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T03:59:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:00:00.929981054Z [2024-02-24 04:00:00,925: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:00:00.964300525Z [2024-02-24 04:00:00,961: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:00:00.969111044Z [2024-02-24 04:00:00,966: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:00:01.338388036Z [2024-02-24 04:00:01,323: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:00:01.341433764Z [2024-02-24 04:00:01,336: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:00:01.374434973Z [2024-02-24 04:00:01,374: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T03:58:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:01.641261536Z [2024-02-24 04:00:01,640: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:00:01.645165772Z [2024-02-24 04:00:01,644: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:01.665949572Z [2024-02-24 04:00:01,665: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:00:01.666979732Z [2024-02-24 04:00:01,666: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:00:01.667167514Z [2024-02-24 04:00:01,666: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:00:01.667309726Z [2024-02-24 04:00:01,667: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:00:01.667882666Z [2024-02-24 04:00:01,667: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:00:01.847972536Z [2024-02-24 04:00:01,847: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T03:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:02.133597034Z [2024-02-24 04:00:02,129: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc83a934-6364-4785-b14c-a35a683d641f] succeeded in 1.5376582889985002s: None
2024-02-24T04:00:02.965897878Z [2024-02-24 04:00:02,965: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1e01c7fc-6dfb-42f3-9d68-af083f56414c] succeeded in 2.388892359998863s: None
2024-02-24T04:00:03.120938799Z [2024-02-24 04:00:03,120: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T04:00:03.125153030Z [2024-02-24 04:00:03,124: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:03.167721471Z [2024-02-24 04:00:03,166: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:00:03.171599259Z [2024-02-24 04:00:03,171: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:03.172826171Z [2024-02-24 04:00:03,172: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T04:00:03.181632752Z [2024-02-24 04:00:03,181: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:03.182944363Z [2024-02-24 04:00:03,182: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:03.183328090Z [2024-02-24 04:00:03,183: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:03.183538984Z [2024-02-24 04:00:03,183: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T04:00:03.184012487Z [2024-02-24 04:00:03,183: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:00:03.184627651Z [2024-02-24 04:00:03,184: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:03.219968084Z [2024-02-24 04:00:03,219: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:00:03.221485684Z [2024-02-24 04:00:03,221: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:03.221669988Z [2024-02-24 04:00:03,221: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:03.222003970Z [2024-02-24 04:00:03,221: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:03.222138790Z [2024-02-24 04:00:03,221: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:00:03.222559557Z [2024-02-24 04:00:03,222: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:00:03.222697692Z [2024-02-24 04:00:03,222: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:03.247600374Z [2024-02-24 04:00:03,247: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:00:03.251347699Z [2024-02-24 04:00:03,250: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:03.269890287Z [2024-02-24 04:00:03,269: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:00:03.271240045Z [2024-02-24 04:00:03,271: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:03.271286050Z [2024-02-24 04:00:03,271: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:03.271750703Z [2024-02-24 04:00:03,271: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:03.271760579Z [2024-02-24 04:00:03,271: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:00:03.272282595Z [2024-02-24 04:00:03,272: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:00:03.272293762Z [2024-02-24 04:00:03,272: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:03.299365393Z [2024-02-24 04:00:03,299: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T03:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:03.329082034Z [2024-02-24 04:00:03,328: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T03:59:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:03.357021435Z [2024-02-24 04:00:03,356: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:04.011965968Z [2024-02-24 04:00:04,011: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c5457ed0-2163-473c-97ca-cd398b189e35] succeeded in 3.4359354599982908s: None
2024-02-24T04:00:05.029334904Z [2024-02-24 04:00:05,028: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a8f0fb81-ad72-4410-b03e-84957c09ded1] received
2024-02-24T04:00:05.041944193Z [2024-02-24 04:00:05,041: INFO/ForkPoolWorker-15] [a8f0fb81-ad72-4410-b03e-84957c09ded1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:00:05.356941962Z [2024-02-24 04:00:05,353: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:00:05.371219424Z [2024-02-24 04:00:05,370: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[77a522e0-71d4-4949-a118-f3b7d8870393] succeeded in 4.771685858999263s: None
2024-02-24T04:00:05.607208424Z [2024-02-24 04:00:05,606: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1dba4a59-ae17-459f-8eda-b1857bfa09dc] succeeded in 5.011470565001218s: None
2024-02-24T04:00:06.445929503Z [2024-02-24 04:00:06,445: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:00:06.449105842Z [2024-02-24 04:00:06,448: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:06.477592843Z [2024-02-24 04:00:06,477: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:00:06.482082263Z [2024-02-24 04:00:06,481: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:06.482329409Z [2024-02-24 04:00:06,482: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:06.482641446Z [2024-02-24 04:00:06,482: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:06.482859761Z [2024-02-24 04:00:06,482: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:00:06.483458644Z [2024-02-24 04:00:06,483: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:00:06.483610779Z [2024-02-24 04:00:06,483: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:06.601229401Z [2024-02-24 04:00:06,600: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:07.192743428Z [2024-02-24 04:00:07,192: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a8f0fb81-ad72-4410-b03e-84957c09ded1] succeeded in 2.16090847599844s: None
2024-02-24T04:00:07.376068883Z [2024-02-24 04:00:07,375: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[62be5ead-5237-43e5-8453-1b125e59e168] received
2024-02-24T04:00:07.385297200Z [2024-02-24 04:00:07,385: INFO/ForkPoolWorker-15] [62be5ead-5237-43e5-8453-1b125e59e168] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:00:07.750226262Z [2024-02-24 04:00:07,747: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:00:08.847497065Z [2024-02-24 04:00:08,847: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:00:08.850951377Z [2024-02-24 04:00:08,850: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:08.872198967Z [2024-02-24 04:00:08,871: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:00:08.873825380Z [2024-02-24 04:00:08,873: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:08.873910880Z [2024-02-24 04:00:08,873: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:08.874183687Z [2024-02-24 04:00:08,873: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:08.874264840Z [2024-02-24 04:00:08,874: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:00:08.875185751Z [2024-02-24 04:00:08,874: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:00:08.875374279Z [2024-02-24 04:00:08,875: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:08.955430252Z [2024-02-24 04:00:08,955: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T03:55:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:10.276613755Z [2024-02-24 04:00:10,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[62be5ead-5237-43e5-8453-1b125e59e168] succeeded in 2.897968162000325s: None
2024-02-24T04:00:11.256708395Z [2024-02-24 04:00:11,255: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2553b31b-8009-4a0d-859b-beaa4e53ccde] received
2024-02-24T04:00:11.279325549Z [2024-02-24 04:00:11,274: INFO/ForkPoolWorker-15] [2553b31b-8009-4a0d-859b-beaa4e53ccde] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T03:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:00:11.598483387Z [2024-02-24 04:00:11,595: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:00:12.686826807Z [2024-02-24 04:00:12,686: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:00:12.690261884Z [2024-02-24 04:00:12,689: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:00:12.748224643Z [2024-02-24 04:00:12,747: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:00:12.750709058Z [2024-02-24 04:00:12,750: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:00:12.750866429Z [2024-02-24 04:00:12,750: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:00:12.751082874Z [2024-02-24 04:00:12,750: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:00:12.751226143Z [2024-02-24 04:00:12,751: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:00:12.751609247Z [2024-02-24 04:00:12,751: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:00:12.751762179Z [2024-02-24 04:00:12,751: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:00:12.859681639Z [2024-02-24 04:00:12,859: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T03:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:00:13.452318686Z [2024-02-24 04:00:13,451: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2553b31b-8009-4a0d-859b-beaa4e53ccde] succeeded in 2.1928495860011026s: None
2024-02-24T04:01:00.517153168Z [2024-02-24 04:01:00,516: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c622d793-5f2f-4346-a8f6-8adf3607e64c] received
2024-02-24T04:01:00.525239813Z [2024-02-24 04:01:00,524: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d42b580-bd42-4c71-a95a-d39daece8b4e] received
2024-02-24T04:01:00.528453686Z [2024-02-24 04:01:00,528: INFO/ForkPoolWorker-15] [c622d793-5f2f-4346-a8f6-8adf3607e64c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:01:00.533328911Z [2024-02-24 04:01:00,533: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a55dfb6f-3c35-4ce9-aeda-3b0c6362e1d7] received
2024-02-24T04:01:00.534528383Z [2024-02-24 04:01:00,534: INFO/ForkPoolWorker-16] [1d42b580-bd42-4c71-a95a-d39daece8b4e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:01:00.544336308Z [2024-02-24 04:01:00,544: INFO/ForkPoolWorker-1] [a55dfb6f-3c35-4ce9-aeda-3b0c6362e1d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:01:00.862911839Z [2024-02-24 04:01:00,859: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:01:00.884808534Z [2024-02-24 04:01:00,881: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:01:00.979676087Z [2024-02-24 04:01:00,975: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:01:01.028963233Z [2024-02-24 04:01:01,028: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:01:01.033807527Z [2024-02-24 04:01:01,033: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:01:01.055020628Z [2024-02-24 04:01:01,054: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:01:01.056558935Z [2024-02-24 04:01:01,056: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:01:01.056711581Z [2024-02-24 04:01:01,056: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:01:01.056922095Z [2024-02-24 04:01:01,056: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:01:01.057305158Z [2024-02-24 04:01:01,057: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:01:01.148422314Z [2024-02-24 04:01:01,148: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:01:01.790469066Z [2024-02-24 04:01:01,788: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a55dfb6f-3c35-4ce9-aeda-3b0c6362e1d7] succeeded in 1.2501552930007165s: None
2024-02-24T04:01:02.264366111Z [2024-02-24 04:01:02,264: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:01:02.268971977Z [2024-02-24 04:01:02,268: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:01:02.289024347Z [2024-02-24 04:01:02,288: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:01:02.290406206Z [2024-02-24 04:01:02,290: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:01:02.290457680Z [2024-02-24 04:01:02,290: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:01:02.290656360Z [2024-02-24 04:01:02,290: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:01:02.290736118Z [2024-02-24 04:01:02,290: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:01:02.291008284Z [2024-02-24 04:01:02,290: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:01:02.291089651Z [2024-02-24 04:01:02,291: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:01:02.314025404Z [2024-02-24 04:01:02,313: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:01:02.317293111Z [2024-02-24 04:01:02,316: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:01:02.337009610Z [2024-02-24 04:01:02,336: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:01:02.338608948Z [2024-02-24 04:01:02,338: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:01:02.338630600Z [2024-02-24 04:01:02,338: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:01:02.338835697Z [2024-02-24 04:01:02,338: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:01:02.338899374Z [2024-02-24 04:01:02,338: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:01:02.339079616Z [2024-02-24 04:01:02,338: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:01:02.339138393Z [2024-02-24 04:01:02,339: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:01:02.392690542Z [2024-02-24 04:01:02,392: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:01:02.437566991Z [2024-02-24 04:01:02,436: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:01:04.400309003Z [2024-02-24 04:01:04,399: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[1d42b580-bd42-4c71-a95a-d39daece8b4e] succeeded in 3.873387780997291s: None
2024-02-24T04:01:04.742347793Z [2024-02-24 04:01:04,741: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c622d793-5f2f-4346-a8f6-8adf3607e64c] succeeded in 4.220069554001384s: None
2024-02-24T04:02:00.914110771Z [2024-02-24 04:02:00,913: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0cb637db-f25d-4c4f-8e48-34c47fc6923f] received
2024-02-24T04:02:00.917037624Z [2024-02-24 04:02:00,916: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fbc861a8-ad3b-429b-8fe7-ec33e879d6ac] received
2024-02-24T04:02:00.923251161Z [2024-02-24 04:02:00,922: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1567ff3b-30c5-48f4-bcb4-b11ac5c73242] received
2024-02-24T04:02:00.923864104Z [2024-02-24 04:02:00,923: INFO/ForkPoolWorker-16] [fbc861a8-ad3b-429b-8fe7-ec33e879d6ac] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:02:00.926404707Z [2024-02-24 04:02:00,925: INFO/ForkPoolWorker-15] [0cb637db-f25d-4c4f-8e48-34c47fc6923f] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:02:00.934775306Z [2024-02-24 04:02:00,934: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f82167e-22e3-4bc0-aa4e-4e4acc30257b] received
2024-02-24T04:02:00.935879604Z [2024-02-24 04:02:00,935: INFO/ForkPoolWorker-1] [1567ff3b-30c5-48f4-bcb4-b11ac5c73242] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:02:00.959790828Z [2024-02-24 04:02:00,959: INFO/ForkPoolWorker-2] [2f82167e-22e3-4bc0-aa4e-4e4acc30257b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:01:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:02:01.262040149Z [2024-02-24 04:02:01,258: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:02:01.430368779Z [2024-02-24 04:02:01,423: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:02:01.465031788Z [2024-02-24 04:02:01,461: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:02:01.589081564Z [2024-02-24 04:02:01,585: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:02:01.601172868Z [2024-02-24 04:02:01,600: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:02:01.605640823Z [2024-02-24 04:02:01,605: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:02:01.633419592Z [2024-02-24 04:02:01,633: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:02:01.638492926Z [2024-02-24 04:02:01,638: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:02:01.638700618Z [2024-02-24 04:02:01,638: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:02:01.638829338Z [2024-02-24 04:02:01,638: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:02:01.639283067Z [2024-02-24 04:02:01,639: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:02:01.740830536Z [2024-02-24 04:02:01,740: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:02:01.905766261Z [2024-02-24 04:02:01,905: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:02:02.452975500Z [2024-02-24 04:02:02,452: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2f82167e-22e3-4bc0-aa4e-4e4acc30257b] succeeded in 1.506144252998638s: None
2024-02-24T04:02:02.687001280Z [2024-02-24 04:02:02,686: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0cb637db-f25d-4c4f-8e48-34c47fc6923f] succeeded in 1.7703729859968007s: None
2024-02-24T04:02:02.920713572Z [2024-02-24 04:02:02,920: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:02:02.924391455Z [2024-02-24 04:02:02,923: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:02:02.947781856Z [2024-02-24 04:02:02,947: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:02:02.948931595Z [2024-02-24 04:02:02,948: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:02:02.948948007Z [2024-02-24 04:02:02,948: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:02:02.949050359Z [2024-02-24 04:02:02,948: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:02:02.949089546Z [2024-02-24 04:02:02,949: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:02:02.949277460Z [2024-02-24 04:02:02,949: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:02:02.949361850Z [2024-02-24 04:02:02,949: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:02:02.956686711Z [2024-02-24 04:02:02,956: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:02:02.960266957Z [2024-02-24 04:02:02,959: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:02:02.977643492Z [2024-02-24 04:02:02,977: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:02:02.979054591Z [2024-02-24 04:02:02,978: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:02:02.979166813Z [2024-02-24 04:02:02,978: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:02:02.979367778Z [2024-02-24 04:02:02,979: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:02:02.979490849Z [2024-02-24 04:02:02,979: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:02:02.979845255Z [2024-02-24 04:02:02,979: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:02:02.979985998Z [2024-02-24 04:02:02,979: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:02:03.095564697Z [2024-02-24 04:02:03,095: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:02:03.129961583Z [2024-02-24 04:02:03,129: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:01:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:02:05.055699226Z [2024-02-24 04:02:05,055: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[1567ff3b-30c5-48f4-bcb4-b11ac5c73242] succeeded in 4.128197942998668s: None
2024-02-24T04:02:06.044748936Z [2024-02-24 04:02:06,044: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fbc861a8-ad3b-429b-8fe7-ec33e879d6ac] succeeded in 5.126281049000681s: None
2024-02-24T04:03:01.197239591Z [2024-02-24 04:03:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84aa2b1d-c67c-42a8-864a-76a57476dc09] received
2024-02-24T04:03:01.204346257Z [2024-02-24 04:03:01,204: INFO/ForkPoolWorker-15] [84aa2b1d-c67c-42a8-864a-76a57476dc09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:03:01.216158568Z [2024-02-24 04:03:01,215: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d76ca3c4-02ad-45c2-b6d1-269eecb59312] received
2024-02-24T04:03:01.225026208Z [2024-02-24 04:03:01,224: INFO/ForkPoolWorker-16] [d76ca3c4-02ad-45c2-b6d1-269eecb59312] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:03:01.234394210Z [2024-02-24 04:03:01,234: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8cf391c6-8e1b-4b8e-9619-a441e7af08f6] received
2024-02-24T04:03:01.249919992Z [2024-02-24 04:03:01,247: INFO/ForkPoolWorker-1] [8cf391c6-8e1b-4b8e-9619-a441e7af08f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:03:01.518704637Z [2024-02-24 04:03:01,515: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:03:01.571815660Z [2024-02-24 04:03:01,568: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:03:01.676484027Z [2024-02-24 04:03:01,676: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:03:01.677824298Z [2024-02-24 04:03:01,674: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:03:01.680440636Z [2024-02-24 04:03:01,680: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:03:01.701516382Z [2024-02-24 04:03:01,701: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:03:01.703645420Z [2024-02-24 04:03:01,703: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:03:01.703989792Z [2024-02-24 04:03:01,703: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:03:01.704275181Z [2024-02-24 04:03:01,704: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:03:01.704847525Z [2024-02-24 04:03:01,704: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:03:01.825894411Z [2024-02-24 04:03:01,825: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:03:02.477330199Z [2024-02-24 04:03:02,476: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d76ca3c4-02ad-45c2-b6d1-269eecb59312] succeeded in 1.2601211490000424s: None
2024-02-24T04:03:02.825969291Z [2024-02-24 04:03:02,825: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:03:02.829323977Z [2024-02-24 04:03:02,828: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:03:02.851696837Z [2024-02-24 04:03:02,851: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:03:02.853106033Z [2024-02-24 04:03:02,852: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:03:02.853249690Z [2024-02-24 04:03:02,853: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:03:02.853346489Z [2024-02-24 04:03:02,853: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:03:02.853372999Z [2024-02-24 04:03:02,853: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:03:02.853606225Z [2024-02-24 04:03:02,853: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:03:02.853635196Z [2024-02-24 04:03:02,853: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:03:02.956851423Z [2024-02-24 04:03:02,956: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:03:03.021133439Z [2024-02-24 04:03:03,020: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:03:03.024529190Z [2024-02-24 04:03:03,024: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:03:03.050135930Z [2024-02-24 04:03:03,049: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:03:03.052348729Z [2024-02-24 04:03:03,052: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:03:03.052617903Z [2024-02-24 04:03:03,052: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:03:03.052906545Z [2024-02-24 04:03:03,052: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:03:03.053091892Z [2024-02-24 04:03:03,052: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:03:03.053542607Z [2024-02-24 04:03:03,053: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:03:03.054014949Z [2024-02-24 04:03:03,053: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:03:03.155790902Z [2024-02-24 04:03:03,155: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:03:05.589016974Z [2024-02-24 04:03:05,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[84aa2b1d-c67c-42a8-864a-76a57476dc09] succeeded in 4.390101935001439s: None
2024-02-24T04:03:05.759714249Z [2024-02-24 04:03:05,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8cf391c6-8e1b-4b8e-9619-a441e7af08f6] succeeded in 4.523609421998117s: None
2024-02-24T04:04:01.218990448Z [2024-02-24 04:04:01,217: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89e6a948-a152-4956-90cf-8243e6abaaf7] received
2024-02-24T04:04:01.225204582Z [2024-02-24 04:04:01,224: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8993ac78-11b1-4ead-b32f-8e40ed42eb5c] received
2024-02-24T04:04:01.232656953Z [2024-02-24 04:04:01,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6d3d9c6f-7320-449f-b012-5263129f3329] received
2024-02-24T04:04:01.236395809Z [2024-02-24 04:04:01,235: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee662ab7-efbd-4afd-b64e-dfde8f820ca5] received
2024-02-24T04:04:01.239740953Z [2024-02-24 04:04:01,239: INFO/ForkPoolWorker-1] [6d3d9c6f-7320-449f-b012-5263129f3329] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:04:01.245532043Z [2024-02-24 04:04:01,239: INFO/ForkPoolWorker-16] [8993ac78-11b1-4ead-b32f-8e40ed42eb5c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:04:01.246994475Z [2024-02-24 04:04:01,245: INFO/ForkPoolWorker-2] [ee662ab7-efbd-4afd-b64e-dfde8f820ca5] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:03:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:04:01.247014259Z [2024-02-24 04:04:01,245: INFO/ForkPoolWorker-15] [89e6a948-a152-4956-90cf-8243e6abaaf7] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:02:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:04:01.606978376Z [2024-02-24 04:04:01,603: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:04:01.642701850Z [2024-02-24 04:04:01,617: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:04:01.659863560Z [2024-02-24 04:04:01,656: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:04:01.930572149Z [2024-02-24 04:04:01,930: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:02:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:04:02.004126755Z [2024-02-24 04:04:01,997: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:04:02.216274705Z [2024-02-24 04:04:02,215: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:04:02.220279863Z [2024-02-24 04:04:02,219: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:04:02.270764309Z [2024-02-24 04:04:02,270: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:04:02.274797824Z [2024-02-24 04:04:02,274: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:04:02.274971577Z [2024-02-24 04:04:02,274: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:04:02.275093700Z [2024-02-24 04:04:02,274: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:04:02.275404877Z [2024-02-24 04:04:02,275: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:04:02.389944682Z [2024-02-24 04:04:02,387: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:04:02.594437428Z [2024-02-24 04:04:02,594: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[89e6a948-a152-4956-90cf-8243e6abaaf7] succeeded in 1.3670395429981s: None
2024-02-24T04:04:03.191136916Z [2024-02-24 04:04:03,190: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:04:03.194480826Z [2024-02-24 04:04:03,194: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:04:03.216641151Z [2024-02-24 04:04:03,216: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:04:03.220345878Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:04:03.220364769Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:04:03.220437812Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:04:03.220480650Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:04:03.220721929Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:04:03.220733026Z [2024-02-24 04:04:03,220: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:04:03.230717405Z [2024-02-24 04:04:03,230: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ee662ab7-efbd-4afd-b64e-dfde8f820ca5] succeeded in 1.993536857997242s: None
2024-02-24T04:04:03.312949526Z [2024-02-24 04:04:03,312: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:04:03.351982370Z [2024-02-24 04:04:03,351: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:04:03.355484690Z [2024-02-24 04:04:03,355: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:04:03.376209575Z [2024-02-24 04:04:03,375: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:04:03.377513331Z [2024-02-24 04:04:03,377: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:04:03.377525688Z [2024-02-24 04:04:03,377: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:04:03.377815920Z [2024-02-24 04:04:03,377: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:04:03.377954398Z [2024-02-24 04:04:03,377: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:04:03.378369672Z [2024-02-24 04:04:03,378: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:04:03.378467468Z [2024-02-24 04:04:03,378: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:04:03.480703728Z [2024-02-24 04:04:03,480: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:03:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:04:05.884452384Z [2024-02-24 04:04:05,883: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6d3d9c6f-7320-449f-b012-5263129f3329] succeeded in 4.650459905999014s: None
2024-02-24T04:04:05.960389451Z [2024-02-24 04:04:05,959: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8993ac78-11b1-4ead-b32f-8e40ed42eb5c] succeeded in 4.732589937997545s: None
2024-02-24T04:05:00.997495538Z [2024-02-24 04:05:00,997: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fd52b39f-109c-45b7-8027-6b1e6fd531e6] received
2024-02-24T04:05:01.003040898Z [2024-02-24 04:05:01,002: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2f71084d-b419-49e9-b122-a45ddc055c83] received
2024-02-24T04:05:01.007715525Z [2024-02-24 04:05:01,007: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3550bf0c-4cd9-48b1-8551-2bfea755f076] received
2024-02-24T04:05:01.010166716Z [2024-02-24 04:05:01,009: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bef92311-f02c-4297-94dd-a642e5fe0103] received
2024-02-24T04:05:01.018351154Z [2024-02-24 04:05:01,018: INFO/ForkPoolWorker-1] [3550bf0c-4cd9-48b1-8551-2bfea755f076] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:05:01.019856021Z [2024-02-24 04:05:01,019: INFO/ForkPoolWorker-15] [fd52b39f-109c-45b7-8027-6b1e6fd531e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:05:01.029570572Z [2024-02-24 04:05:01,029: INFO/ForkPoolWorker-2] [bef92311-f02c-4297-94dd-a642e5fe0103] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:05:01.035065627Z [2024-02-24 04:05:01,034: INFO/ForkPoolWorker-16] [2f71084d-b419-49e9-b122-a45ddc055c83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:05:01.396160572Z [2024-02-24 04:05:01,392: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:05:01.399093633Z [2024-02-24 04:05:01,395: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:05:01.463073486Z [2024-02-24 04:05:01,459: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:05:01.563881746Z [2024-02-24 04:05:01,560: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:05:01.730883331Z [2024-02-24 04:05:01,730: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:05:01.735042401Z [2024-02-24 04:05:01,734: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:01.768381658Z [2024-02-24 04:05:01,768: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:05:01.770109623Z [2024-02-24 04:05:01,769: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:05:01.770263003Z [2024-02-24 04:05:01,770: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:05:01.770399222Z [2024-02-24 04:05:01,770: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:05:01.770678165Z [2024-02-24 04:05:01,770: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:05:01.917224650Z [2024-02-24 04:05:01,916: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:02.622868918Z [2024-02-24 04:05:02,622: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[3550bf0c-4cd9-48b1-8551-2bfea755f076] succeeded in 1.6122040030022617s: None
2024-02-24T04:05:02.721459362Z [2024-02-24 04:05:02,721: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:05:02.726135590Z [2024-02-24 04:05:02,725: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:02.827968773Z [2024-02-24 04:05:02,827: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:05:02.838667262Z [2024-02-24 04:05:02,838: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:02.838697515Z [2024-02-24 04:05:02,838: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:02.838815920Z [2024-02-24 04:05:02,838: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:02.838852163Z [2024-02-24 04:05:02,838: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:05:02.839102706Z [2024-02-24 04:05:02,838: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:05:02.839117559Z [2024-02-24 04:05:02,839: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:02.937313730Z [2024-02-24 04:05:02,936: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:02.954080715Z [2024-02-24 04:05:02,953: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:05:02.957458453Z [2024-02-24 04:05:02,956: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:02.982546118Z [2024-02-24 04:05:02,982: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:05:02.983784533Z [2024-02-24 04:05:02,983: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:02.983822847Z [2024-02-24 04:05:02,983: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:02.983880701Z [2024-02-24 04:05:02,983: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:02.983899453Z [2024-02-24 04:05:02,983: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:05:02.984142966Z [2024-02-24 04:05:02,984: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:05:02.984159841Z [2024-02-24 04:05:02,984: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:03.036477081Z [2024-02-24 04:05:03,036: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:05:03.039976161Z [2024-02-24 04:05:03,039: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:03.063960921Z [2024-02-24 04:05:03,063: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:05:03.065947639Z [2024-02-24 04:05:03,065: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:03.066158628Z [2024-02-24 04:05:03,065: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:03.066395929Z [2024-02-24 04:05:03,066: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:03.066663730Z [2024-02-24 04:05:03,066: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:05:03.067037313Z [2024-02-24 04:05:03,066: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:05:03.067244919Z [2024-02-24 04:05:03,067: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:03.090961844Z [2024-02-24 04:05:03,090: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:03.190600320Z [2024-02-24 04:05:03,190: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:03.615043379Z [2024-02-24 04:05:03,614: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[2f71084d-b419-49e9-b122-a45ddc055c83] succeeded in 2.6095040410000365s: None
2024-02-24T04:05:03.837324386Z [2024-02-24 04:05:03,837: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[84895396-b25c-40d7-a83e-4052342a1128] received
2024-02-24T04:05:03.844398877Z [2024-02-24 04:05:03,844: INFO/ForkPoolWorker-16] [84895396-b25c-40d7-a83e-4052342a1128] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:05:04.115347430Z [2024-02-24 04:05:04,112: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:05:04.764997086Z [2024-02-24 04:05:04,764: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fd52b39f-109c-45b7-8027-6b1e6fd531e6] succeeded in 3.7649189589974412s: None
2024-02-24T04:05:05.286269725Z [2024-02-24 04:05:05,285: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:05:05.289706787Z [2024-02-24 04:05:05,289: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:05.311988421Z [2024-02-24 04:05:05,311: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:05:05.314531635Z [2024-02-24 04:05:05,314: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:05.314650040Z [2024-02-24 04:05:05,314: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:05.314841904Z [2024-02-24 04:05:05,314: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:05.314954860Z [2024-02-24 04:05:05,314: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:05:05.315287056Z [2024-02-24 04:05:05,315: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:05:05.315362142Z [2024-02-24 04:05:05,315: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:05.405606045Z [2024-02-24 04:05:05,405: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:05.698314529Z [2024-02-24 04:05:05,697: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[bef92311-f02c-4297-94dd-a642e5fe0103] succeeded in 4.685769882999011s: None
2024-02-24T04:05:06.040681992Z [2024-02-24 04:05:06,040: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[84895396-b25c-40d7-a83e-4052342a1128] succeeded in 2.2018976020008267s: None
2024-02-24T04:05:06.296592370Z [2024-02-24 04:05:06,296: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f8fc60dc-2723-4f13-a741-7c886d727e88] received
2024-02-24T04:05:06.310934859Z [2024-02-24 04:05:06,310: INFO/ForkPoolWorker-15] [f8fc60dc-2723-4f13-a741-7c886d727e88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:05:06.595476896Z [2024-02-24 04:05:06,592: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:05:07.712058127Z [2024-02-24 04:05:07,711: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:05:07.715366669Z [2024-02-24 04:05:07,714: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:07.736906877Z [2024-02-24 04:05:07,736: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:05:07.738646420Z [2024-02-24 04:05:07,738: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:07.738849400Z [2024-02-24 04:05:07,738: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:07.739089515Z [2024-02-24 04:05:07,738: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:07.739242441Z [2024-02-24 04:05:07,739: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:05:07.739685046Z [2024-02-24 04:05:07,739: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:05:07.739881207Z [2024-02-24 04:05:07,739: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:07.836673893Z [2024-02-24 04:05:07,836: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:00:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:09.356761157Z [2024-02-24 04:05:09,356: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f8fc60dc-2723-4f13-a741-7c886d727e88] succeeded in 3.058480635001615s: None
2024-02-24T04:05:09.747263355Z [2024-02-24 04:05:09,746: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8feefeb0-95e4-4087-93f7-b8dfb041a77e] received
2024-02-24T04:05:09.757218053Z [2024-02-24 04:05:09,756: INFO/ForkPoolWorker-15] [8feefeb0-95e4-4087-93f7-b8dfb041a77e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:00:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:05:10.070536993Z [2024-02-24 04:05:10,067: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:05:11.187400461Z [2024-02-24 04:05:11,186: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:05:11.190475842Z [2024-02-24 04:05:11,190: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:05:11.211318163Z [2024-02-24 04:05:11,210: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:05:11.212128329Z [2024-02-24 04:05:11,211: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:05:11.212138993Z [2024-02-24 04:05:11,211: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:05:11.212147075Z [2024-02-24 04:05:11,211: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:05:11.212480885Z [2024-02-24 04:05:11,212: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:05:11.212497349Z [2024-02-24 04:05:11,212: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:05:11.212501285Z [2024-02-24 04:05:11,212: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:05:11.320295248Z [2024-02-24 04:05:11,320: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:00:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:05:11.884476709Z [2024-02-24 04:05:11,883: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8feefeb0-95e4-4087-93f7-b8dfb041a77e] succeeded in 2.1345328589995916s: None
2024-02-24T04:06:00.330333967Z [2024-02-24 04:06:00,329: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[035b0f31-af66-4ad1-a54a-3b47f29763c4] received
2024-02-24T04:06:00.336585153Z [2024-02-24 04:06:00,336: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d5a9eaf-f6f3-4922-a453-74193adae411] received
2024-02-24T04:06:00.339361697Z [2024-02-24 04:06:00,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b4430b9a-e36c-4f20-979f-60b8c416edef] received
2024-02-24T04:06:00.340272461Z [2024-02-24 04:06:00,340: INFO/ForkPoolWorker-15] [035b0f31-af66-4ad1-a54a-3b47f29763c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:06:00.345378583Z [2024-02-24 04:06:00,345: INFO/ForkPoolWorker-16] [5d5a9eaf-f6f3-4922-a453-74193adae411] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:04:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:06:00.348746356Z [2024-02-24 04:06:00,348: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39c08fe1-4c95-4b97-a1f1-d1e4df9f1425] received
2024-02-24T04:06:00.357636780Z [2024-02-24 04:06:00,357: INFO/ForkPoolWorker-1] [b4430b9a-e36c-4f20-979f-60b8c416edef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:06:00.366120546Z [2024-02-24 04:06:00,365: INFO/ForkPoolWorker-2] [39c08fe1-4c95-4b97-a1f1-d1e4df9f1425] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:06:00.680948847Z [2024-02-24 04:06:00,678: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:06:00.709202001Z [2024-02-24 04:06:00,706: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:06:00.814788218Z [2024-02-24 04:06:00,807: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:06:00.930386798Z [2024-02-24 04:06:00,925: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:06:01.132607458Z [2024-02-24 04:06:01,132: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:04:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:06:01.173422206Z [2024-02-24 04:06:01,173: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:06:01.178094749Z [2024-02-24 04:06:01,177: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:06:01.224085815Z [2024-02-24 04:06:01,222: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:06:01.227459280Z [2024-02-24 04:06:01,226: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:06:01.227642289Z [2024-02-24 04:06:01,227: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:06:01.227707584Z [2024-02-24 04:06:01,227: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:06:01.227876014Z [2024-02-24 04:06:01,227: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:06:01.368898958Z [2024-02-24 04:06:01,368: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:06:01.895448022Z [2024-02-24 04:06:01,895: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d5a9eaf-f6f3-4922-a453-74193adae411] succeeded in 1.5565537229995243s: None
2024-02-24T04:06:01.989146950Z [2024-02-24 04:06:01,988: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b4430b9a-e36c-4f20-979f-60b8c416edef] succeeded in 1.6380913799985137s: None
2024-02-24T04:06:02.086647205Z [2024-02-24 04:06:02,086: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:06:02.089900705Z [2024-02-24 04:06:02,089: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:06:02.113415329Z [2024-02-24 04:06:02,113: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:06:02.115069081Z [2024-02-24 04:06:02,114: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:06:02.115085687Z [2024-02-24 04:06:02,115: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:06:02.115259744Z [2024-02-24 04:06:02,115: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:06:02.115306339Z [2024-02-24 04:06:02,115: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:06:02.115680776Z [2024-02-24 04:06:02,115: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:06:02.115790802Z [2024-02-24 04:06:02,115: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:06:02.208831216Z [2024-02-24 04:06:02,208: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:06:02.397909778Z [2024-02-24 04:06:02,395: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:06:02.399667808Z [2024-02-24 04:06:02,399: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:06:02.427024454Z [2024-02-24 04:06:02,426: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:06:02.428973353Z [2024-02-24 04:06:02,428: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:06:02.429112085Z [2024-02-24 04:06:02,428: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:06:02.429242026Z [2024-02-24 04:06:02,429: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:06:02.429487167Z [2024-02-24 04:06:02,429: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:06:02.430134443Z [2024-02-24 04:06:02,429: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:06:02.430260351Z [2024-02-24 04:06:02,430: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:06:02.504545225Z [2024-02-24 04:06:02,504: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:06:03.711500421Z [2024-02-24 04:06:03,710: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[035b0f31-af66-4ad1-a54a-3b47f29763c4] succeeded in 3.3784771030004777s: None
2024-02-24T04:06:04.884168776Z [2024-02-24 04:06:04,883: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[39c08fe1-4c95-4b97-a1f1-d1e4df9f1425] succeeded in 4.53073817800032s: None
2024-02-24T04:06:25.063508613Z [2024-02-24 04:06:25,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[eda58de0-91a1-4bcd-ae97-ea7700cc9c84] received
2024-02-24T04:06:25.074290813Z [2024-02-24 04:06:25,074: INFO/ForkPoolWorker-15] [eda58de0-91a1-4bcd-ae97-ea7700cc9c84] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240224040624_635783', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py']
2024-02-24T04:06:25.377098130Z [2024-02-24 04:06:25,374: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py
2024-02-24T04:06:25.620289884Z [2024-02-24 04:06:25,620: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_alarm.main_task vdu_alarm_20240224040624_635783 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:06:26.284484337Z [2024-02-24 04:06:26,283: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[eda58de0-91a1-4bcd-ae97-ea7700cc9c84] succeeded in 1.217647831999784s: None
2024-02-24T04:07:00.372738460Z [2024-02-24 04:07:00,372: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[844170a3-4825-4f2e-bc17-5a224a7bb095] received
2024-02-24T04:07:00.380289528Z [2024-02-24 04:07:00,380: INFO/ForkPoolWorker-15] [844170a3-4825-4f2e-bc17-5a224a7bb095] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:07:00.386563845Z [2024-02-24 04:07:00,386: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6fd08228-b631-4580-b776-b99e61e79c91] received
2024-02-24T04:07:00.392922304Z [2024-02-24 04:07:00,392: INFO/ForkPoolWorker-16] [6fd08228-b631-4580-b776-b99e61e79c91] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:07:00.394649805Z [2024-02-24 04:07:00,392: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cc9bd06e-6554-4592-9dea-0441d13b7729] received
2024-02-24T04:07:00.402129703Z [2024-02-24 04:07:00,401: INFO/ForkPoolWorker-1] [cc9bd06e-6554-4592-9dea-0441d13b7729] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:07:00.681484136Z [2024-02-24 04:07:00,678: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:07:00.705551919Z [2024-02-24 04:07:00,701: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:07:00.721539959Z [2024-02-24 04:07:00,718: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:07:00.888837990Z [2024-02-24 04:07:00,888: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:07:00.892950003Z [2024-02-24 04:07:00,892: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:07:00.925142921Z [2024-02-24 04:07:00,924: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:07:00.926281996Z [2024-02-24 04:07:00,926: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:07:00.926468607Z [2024-02-24 04:07:00,926: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:07:00.926596272Z [2024-02-24 04:07:00,926: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:07:00.926881696Z [2024-02-24 04:07:00,926: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:07:01.052441332Z [2024-02-24 04:07:01,052: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:07:01.745904187Z [2024-02-24 04:07:01,745: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[cc9bd06e-6554-4592-9dea-0441d13b7729] succeeded in 1.3498381419994985s: None
2024-02-24T04:07:01.908387788Z [2024-02-24 04:07:01,907: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:07:01.911779183Z [2024-02-24 04:07:01,911: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:07:01.922979833Z [2024-02-24 04:07:01,922: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:07:01.926523102Z [2024-02-24 04:07:01,926: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:07:01.937470070Z [2024-02-24 04:07:01,937: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:07:01.939072666Z [2024-02-24 04:07:01,938: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:07:01.939141929Z [2024-02-24 04:07:01,938: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:07:01.939626997Z [2024-02-24 04:07:01,939: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:07:01.939716982Z [2024-02-24 04:07:01,939: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:07:01.940125249Z [2024-02-24 04:07:01,939: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:07:01.940169435Z [2024-02-24 04:07:01,940: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:07:01.943925422Z [2024-02-24 04:07:01,943: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:07:01.945034285Z [2024-02-24 04:07:01,944: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:07:01.945049372Z [2024-02-24 04:07:01,944: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:07:01.945244945Z [2024-02-24 04:07:01,944: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:07:01.945256705Z [2024-02-24 04:07:01,945: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:07:01.946330629Z [2024-02-24 04:07:01,945: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:07:01.946346852Z [2024-02-24 04:07:01,945: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:07:02.017687537Z [2024-02-24 04:07:02,017: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:07:02.031601431Z [2024-02-24 04:07:02,031: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:07:03.616056827Z [2024-02-24 04:07:03,615: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6fd08228-b631-4580-b776-b99e61e79c91] succeeded in 3.2279766730025585s: None
2024-02-24T04:07:04.113886353Z [2024-02-24 04:07:04,113: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[844170a3-4825-4f2e-bc17-5a224a7bb095] succeeded in 3.7391063920003944s: None
2024-02-24T04:08:00.285083423Z [2024-02-24 04:08:00,284: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44e606fb-4003-4d51-a750-2f24501ae398] received
2024-02-24T04:08:00.287329201Z [2024-02-24 04:08:00,287: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4a50dfd6-1f53-4a77-8370-7a74925d7200] received
2024-02-24T04:08:00.289144480Z [2024-02-24 04:08:00,288: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[845511aa-3bd3-4e8d-8d00-7c4bb33c4bee] received
2024-02-24T04:08:00.294128134Z [2024-02-24 04:08:00,293: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[01eb2a94-10f4-411c-8ef7-83dfaaa34fb5] received
2024-02-24T04:08:00.303811542Z [2024-02-24 04:08:00,303: INFO/ForkPoolWorker-1] [845511aa-3bd3-4e8d-8d00-7c4bb33c4bee] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:08:00.304011858Z [2024-02-24 04:08:00,303: INFO/ForkPoolWorker-2] [01eb2a94-10f4-411c-8ef7-83dfaaa34fb5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:08:00.304036317Z [2024-02-24 04:08:00,303: INFO/ForkPoolWorker-15] [44e606fb-4003-4d51-a750-2f24501ae398] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:06:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:08:00.314775205Z [2024-02-24 04:08:00,314: INFO/ForkPoolWorker-16] [4a50dfd6-1f53-4a77-8370-7a74925d7200] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:07:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:08:00.669666067Z [2024-02-24 04:08:00,666: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:08:00.756445210Z [2024-02-24 04:08:00,751: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:08:00.793022220Z [2024-02-24 04:08:00,788: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:08:00.820587938Z [2024-02-24 04:08:00,815: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:08:00.943402048Z [2024-02-24 04:08:00,943: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:06:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:08:01.114739992Z [2024-02-24 04:08:01,114: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:08:01.147035327Z [2024-02-24 04:08:01,146: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:08:01.237892358Z [2024-02-24 04:08:01,229: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:08:01.245235727Z [2024-02-24 04:08:01,240: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:08:01.245251935Z [2024-02-24 04:08:01,240: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:08:01.245255904Z [2024-02-24 04:08:01,240: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:08:01.245259150Z [2024-02-24 04:08:01,240: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:08:01.420876411Z [2024-02-24 04:08:01,420: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:08:01.565916593Z [2024-02-24 04:08:01,565: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[44e606fb-4003-4d51-a750-2f24501ae398] succeeded in 1.278847819998191s: None
2024-02-24T04:08:02.024195012Z [2024-02-24 04:08:02,023: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[845511aa-3bd3-4e8d-8d00-7c4bb33c4bee] succeeded in 1.7323369980003918s: None
2024-02-24T04:08:02.233204782Z [2024-02-24 04:08:02,232: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:08:02.236670547Z [2024-02-24 04:08:02,236: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:08:02.258285706Z [2024-02-24 04:08:02,258: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:08:02.260153308Z [2024-02-24 04:08:02,259: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:08:02.260171738Z [2024-02-24 04:08:02,260: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:08:02.260304814Z [2024-02-24 04:08:02,260: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:08:02.260319484Z [2024-02-24 04:08:02,260: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:08:02.260693964Z [2024-02-24 04:08:02,260: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:08:02.260825476Z [2024-02-24 04:08:02,260: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:08:02.335442428Z [2024-02-24 04:08:02,335: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:08:02.336717486Z [2024-02-24 04:08:02,336: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:08:02.340211294Z [2024-02-24 04:08:02,339: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:08:02.376542317Z [2024-02-24 04:08:02,367: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:08:02.376550880Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:08:02.376559048Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:08:02.376562809Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:08:02.376567008Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:08:02.376570133Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:08:02.376573237Z [2024-02-24 04:08:02,369: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:08:02.503150801Z [2024-02-24 04:08:02,502: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:07:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:08:04.664216964Z [2024-02-24 04:08:04,663: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[01eb2a94-10f4-411c-8ef7-83dfaaa34fb5] succeeded in 4.3663764749981056s: None
2024-02-24T04:08:04.910294670Z [2024-02-24 04:08:04,909: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4a50dfd6-1f53-4a77-8370-7a74925d7200] succeeded in 4.6190812999993796s: None
2024-02-24T04:09:01.339976746Z [2024-02-24 04:09:01,339: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91b4f3c1-e646-4fbd-b7ae-21d055936748] received
2024-02-24T04:09:01.349322774Z [2024-02-24 04:09:01,349: INFO/ForkPoolWorker-15] [91b4f3c1-e646-4fbd-b7ae-21d055936748] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:09:01.349907667Z [2024-02-24 04:09:01,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d723ac6-6a7d-4969-b4d0-5f74c672c710] received
2024-02-24T04:09:01.354365156Z [2024-02-24 04:09:01,354: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c0cf931-b343-4ca1-bccd-84fdca8e2a04] received
2024-02-24T04:09:01.358500336Z [2024-02-24 04:09:01,358: INFO/ForkPoolWorker-16] [5d723ac6-6a7d-4969-b4d0-5f74c672c710] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:09:01.362334009Z [2024-02-24 04:09:01,361: INFO/ForkPoolWorker-1] [6c0cf931-b343-4ca1-bccd-84fdca8e2a04] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:09:01.734908881Z [2024-02-24 04:09:01,729: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:09:01.736412115Z [2024-02-24 04:09:01,731: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:09:01.739787672Z [2024-02-24 04:09:01,736: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:09:02.024065174Z [2024-02-24 04:09:02,023: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T04:09:02.028653279Z [2024-02-24 04:09:02,028: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:09:02.069076000Z [2024-02-24 04:09:02,067: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:09:02.070512187Z [2024-02-24 04:09:02,070: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:09:02.070738947Z [2024-02-24 04:09:02,070: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:09:02.070874109Z [2024-02-24 04:09:02,070: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T04:09:02.071279933Z [2024-02-24 04:09:02,071: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:09:02.213561866Z [2024-02-24 04:09:02,213: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:09:03.068627565Z [2024-02-24 04:09:03,068: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91b4f3c1-e646-4fbd-b7ae-21d055936748] succeeded in 1.7253762040018046s: None
2024-02-24T04:09:03.089504330Z [2024-02-24 04:09:03,089: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:09:03.093387125Z [2024-02-24 04:09:03,092: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:09:03.127114903Z [2024-02-24 04:09:03,126: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:09:03.131706129Z [2024-02-24 04:09:03,131: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:09:03.132469182Z [2024-02-24 04:09:03,132: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:09:03.133168613Z [2024-02-24 04:09:03,132: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:09:03.133526942Z [2024-02-24 04:09:03,133: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:09:03.134607752Z [2024-02-24 04:09:03,134: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:09:03.135135940Z [2024-02-24 04:09:03,134: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:09:03.148370577Z [2024-02-24 04:09:03,147: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:09:03.154089577Z [2024-02-24 04:09:03,153: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:09:03.180050367Z [2024-02-24 04:09:03,179: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:09:03.181277645Z [2024-02-24 04:09:03,181: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:09:03.181422734Z [2024-02-24 04:09:03,181: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:09:03.181618103Z [2024-02-24 04:09:03,181: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:09:03.181755632Z [2024-02-24 04:09:03,181: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:09:03.182114099Z [2024-02-24 04:09:03,181: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:09:03.182207980Z [2024-02-24 04:09:03,182: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:09:03.244207268Z [2024-02-24 04:09:03,243: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:09:03.289740391Z [2024-02-24 04:09:03,289: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:09:06.914705462Z [2024-02-24 04:09:06,914: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5d723ac6-6a7d-4969-b4d0-5f74c672c710] succeeded in 5.5626280500000576s: None
2024-02-24T04:09:06.946390358Z [2024-02-24 04:09:06,945: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6c0cf931-b343-4ca1-bccd-84fdca8e2a04] succeeded in 5.590229974000977s: None
2024-02-24T04:10:00.417300765Z [2024-02-24 04:10:00,416: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22b868ee-9a08-4d22-a3f9-b748c3cb7bbd] received
2024-02-24T04:10:00.420051434Z [2024-02-24 04:10:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e6ecd505-da83-49e1-8453-62df42de0b77] received
2024-02-24T04:10:00.423477784Z [2024-02-24 04:10:00,423: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a06fa683-1a0c-4d8f-8658-794b9994d9b3] received
2024-02-24T04:10:00.426835757Z [2024-02-24 04:10:00,426: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[42335116-0470-480d-a242-dcfba39a487a] received
2024-02-24T04:10:00.427685789Z [2024-02-24 04:10:00,427: INFO/ForkPoolWorker-16] [e6ecd505-da83-49e1-8453-62df42de0b77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:10:00.428189096Z [2024-02-24 04:10:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e92cc626-dc7e-4986-9b14-684a482202c8] received
2024-02-24T04:10:00.439540661Z [2024-02-24 04:10:00,439: INFO/ForkPoolWorker-1] [a06fa683-1a0c-4d8f-8658-794b9994d9b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:10:00.446415909Z [2024-02-24 04:10:00,445: INFO/ForkPoolWorker-2] [42335116-0470-480d-a242-dcfba39a487a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:08:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:10:00.446703500Z [2024-02-24 04:10:00,445: INFO/ForkPoolWorker-15] [22b868ee-9a08-4d22-a3f9-b748c3cb7bbd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:10:00.448692199Z [2024-02-24 04:10:00,448: INFO/ForkPoolWorker-3] [e92cc626-dc7e-4986-9b14-684a482202c8] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:09:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:10:00.811060430Z [2024-02-24 04:10:00,807: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:10:00.875939226Z [2024-02-24 04:10:00,872: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:10:00.909627287Z [2024-02-24 04:10:00,906: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:10:00.942898974Z [2024-02-24 04:10:00,932: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:10:01.023953674Z [2024-02-24 04:10:01,020: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:10:01.055778278Z [2024-02-24 04:10:01,055: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T04:10:01.065874975Z [2024-02-24 04:10:01,065: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:01.190588623Z [2024-02-24 04:10:01,190: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T04:10:01.199474933Z [2024-02-24 04:10:01,199: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:10:01.205385917Z [2024-02-24 04:10:01,204: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:10:01.205505442Z [2024-02-24 04:10:01,205: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T04:10:01.207228905Z [2024-02-24 04:10:01,206: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:10:01.441374446Z [2024-02-24 04:10:01,441: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:01.502207405Z [2024-02-24 04:10:01,501: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:08:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:02.328394154Z [2024-02-24 04:10:02,327: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[e92cc626-dc7e-4986-9b14-684a482202c8] succeeded in 1.8959320339999977s: None
2024-02-24T04:10:02.497019680Z [2024-02-24 04:10:02,496: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[42335116-0470-480d-a242-dcfba39a487a] succeeded in 2.0637279889997444s: None
2024-02-24T04:10:02.515342253Z [2024-02-24 04:10:02,514: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:10:02.518838471Z [2024-02-24 04:10:02,518: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:02.549751854Z [2024-02-24 04:10:02,549: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:10:02.551513472Z [2024-02-24 04:10:02,551: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:02.551675200Z [2024-02-24 04:10:02,551: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:02.551855122Z [2024-02-24 04:10:02,551: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:02.551985517Z [2024-02-24 04:10:02,551: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:10:02.552573663Z [2024-02-24 04:10:02,552: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:10:02.552746353Z [2024-02-24 04:10:02,552: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:02.676967121Z [2024-02-24 04:10:02,674: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:10:02.680119842Z [2024-02-24 04:10:02,677: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:02.680143475Z [2024-02-24 04:10:02,677: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:02.728818197Z [2024-02-24 04:10:02,728: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:10:02.754147221Z [2024-02-24 04:10:02,732: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:02.754347487Z [2024-02-24 04:10:02,754: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:02.764360570Z [2024-02-24 04:10:02,763: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:02.764458290Z [2024-02-24 04:10:02,764: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:10:02.764940444Z [2024-02-24 04:10:02,764: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:10:02.765003147Z [2024-02-24 04:10:02,764: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:02.923734353Z [2024-02-24 04:10:02,923: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:03.031118612Z [2024-02-24 04:10:03,030: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:10:03.035349976Z [2024-02-24 04:10:03,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:03.057575091Z [2024-02-24 04:10:03,057: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:10:03.059277417Z [2024-02-24 04:10:03,058: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:03.059308694Z [2024-02-24 04:10:03,059: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:03.059378897Z [2024-02-24 04:10:03,059: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:03.059438363Z [2024-02-24 04:10:03,059: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:10:03.059654878Z [2024-02-24 04:10:03,059: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:10:03.059694339Z [2024-02-24 04:10:03,059: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:03.162910155Z [2024-02-24 04:10:03,162: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:09:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:03.379449347Z [2024-02-24 04:10:03,379: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e6ecd505-da83-49e1-8453-62df42de0b77] succeeded in 2.9573609910003142s: None
2024-02-24T04:10:03.999601007Z [2024-02-24 04:10:03,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[126adc02-4976-4f1a-a9ce-65793e7e73cb] received
2024-02-24T04:10:04.016092276Z [2024-02-24 04:10:04,015: INFO/ForkPoolWorker-16] [126adc02-4976-4f1a-a9ce-65793e7e73cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:10:04.352714463Z [2024-02-24 04:10:04,349: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:10:04.848506007Z [2024-02-24 04:10:04,848: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a06fa683-1a0c-4d8f-8658-794b9994d9b3] succeeded in 4.423597992001305s: None
2024-02-24T04:10:04.879994800Z [2024-02-24 04:10:04,879: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[22b868ee-9a08-4d22-a3f9-b748c3cb7bbd] succeeded in 4.459827348997351s: None
2024-02-24T04:10:05.697119803Z [2024-02-24 04:10:05,696: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:10:05.700530791Z [2024-02-24 04:10:05,699: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:05.720401595Z [2024-02-24 04:10:05,720: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:10:05.722320250Z [2024-02-24 04:10:05,722: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:05.722539631Z [2024-02-24 04:10:05,722: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:05.722812305Z [2024-02-24 04:10:05,722: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:05.723294441Z [2024-02-24 04:10:05,722: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:10:05.723759044Z [2024-02-24 04:10:05,723: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:10:05.723911400Z [2024-02-24 04:10:05,723: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:05.855153545Z [2024-02-24 04:10:05,854: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:06.536628500Z [2024-02-24 04:10:06,536: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[126adc02-4976-4f1a-a9ce-65793e7e73cb] succeeded in 2.5333079129995895s: None
2024-02-24T04:10:07.419963323Z [2024-02-24 04:10:07,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ffdefb23-ccaa-4141-b020-d670268ed73a] received
2024-02-24T04:10:07.429038624Z [2024-02-24 04:10:07,428: INFO/ForkPoolWorker-15] [ffdefb23-ccaa-4141-b020-d670268ed73a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:10:07.731470194Z [2024-02-24 04:10:07,728: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:10:08.857630644Z [2024-02-24 04:10:08,857: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:10:08.860842449Z [2024-02-24 04:10:08,860: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:08.879187161Z [2024-02-24 04:10:08,878: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:10:08.880530025Z [2024-02-24 04:10:08,880: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:08.880689367Z [2024-02-24 04:10:08,880: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:08.880931251Z [2024-02-24 04:10:08,880: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:08.881074323Z [2024-02-24 04:10:08,880: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:10:08.881456063Z [2024-02-24 04:10:08,881: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:10:08.881723864Z [2024-02-24 04:10:08,881: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:08.973546186Z [2024-02-24 04:10:08,973: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:05:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:09.517933595Z [2024-02-24 04:10:09,517: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ffdefb23-ccaa-4141-b020-d670268ed73a] succeeded in 2.09615724899777s: None
2024-02-24T04:10:09.973882424Z [2024-02-24 04:10:09,973: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0454c5ef-4963-417f-b98a-823c88a9c523] received
2024-02-24T04:10:09.985977750Z [2024-02-24 04:10:09,985: INFO/ForkPoolWorker-15] [0454c5ef-4963-417f-b98a-823c88a9c523] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:05:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:10:10.294030306Z [2024-02-24 04:10:10,290: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:10:11.500744916Z [2024-02-24 04:10:11,500: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:10:11.504100417Z [2024-02-24 04:10:11,503: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:10:11.533094627Z [2024-02-24 04:10:11,532: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:10:11.535126629Z [2024-02-24 04:10:11,534: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:10:11.535434977Z [2024-02-24 04:10:11,535: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:10:11.535594901Z [2024-02-24 04:10:11,535: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:10:11.535726482Z [2024-02-24 04:10:11,535: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:10:11.536247975Z [2024-02-24 04:10:11,535: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:10:11.536490543Z [2024-02-24 04:10:11,536: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:10:11.650183761Z [2024-02-24 04:10:11,649: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:05:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:12.254374806Z [2024-02-24 04:10:12,253: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0454c5ef-4963-417f-b98a-823c88a9c523] succeeded in 2.2772729419993993s: None
2024-02-24T04:10:25.042284409Z [2024-02-24 04:10:25,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7e0286cd-9ff5-480f-84d3-8d890673efee] received
2024-02-24T04:10:25.048153087Z [2024-02-24 04:10:25,047: INFO/ForkPoolWorker-15] [7e0286cd-9ff5-480f-84d3-8d890673efee] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_alarm', 'main_task', 'vdu_alarm_20240224041024_824503', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_alarm.py']
2024-02-24T04:10:25.365727544Z [2024-02-24 04:10:25,362: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_alarm.py
2024-02-24T04:10:25.629717758Z [2024-02-24 04:10:25,629: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_alarm.main_task vdu_alarm_20240224041024_824503 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:10:26.240194256Z [2024-02-24 04:10:26,239: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7e0286cd-9ff5-480f-84d3-8d890673efee] succeeded in 1.1962443990014435s: None
2024-02-24T04:11:00.517544012Z [2024-02-24 04:11:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[124aad3e-be85-4894-8bd9-9f1cf5b1a156] received
2024-02-24T04:11:00.519034307Z [2024-02-24 04:11:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e2d542eb-b784-4c02-90c5-b6139a9e5716] received
2024-02-24T04:11:00.525751629Z [2024-02-24 04:11:00,525: INFO/ForkPoolWorker-16] [e2d542eb-b784-4c02-90c5-b6139a9e5716] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:11:00.527166181Z [2024-02-24 04:11:00,526: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[31eba1ca-57ed-42e4-a1ed-ee03f4c5bb51] received
2024-02-24T04:11:00.534366532Z [2024-02-24 04:11:00,533: INFO/ForkPoolWorker-15] [124aad3e-be85-4894-8bd9-9f1cf5b1a156] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:11:00.538305764Z [2024-02-24 04:11:00,538: INFO/ForkPoolWorker-1] [31eba1ca-57ed-42e4-a1ed-ee03f4c5bb51] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:11:00.823262380Z [2024-02-24 04:11:00,819: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:11:00.835294390Z [2024-02-24 04:11:00,831: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:11:00.862919653Z [2024-02-24 04:11:00,859: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:11:00.995273121Z [2024-02-24 04:11:00,994: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:11:00.999352153Z [2024-02-24 04:11:00,998: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:11:01.024501879Z [2024-02-24 04:11:01,024: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:11:01.025521541Z [2024-02-24 04:11:01,025: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:11:01.025689372Z [2024-02-24 04:11:01,025: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:11:01.025708541Z [2024-02-24 04:11:01,025: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:11:01.025966849Z [2024-02-24 04:11:01,025: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:11:01.149755139Z [2024-02-24 04:11:01,149: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:11:01.914266016Z [2024-02-24 04:11:01,913: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[31eba1ca-57ed-42e4-a1ed-ee03f4c5bb51] succeeded in 1.3855793219991028s: None
2024-02-24T04:11:02.032842764Z [2024-02-24 04:11:02,032: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:11:02.036305080Z [2024-02-24 04:11:02,035: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:11:02.066325283Z [2024-02-24 04:11:02,065: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:11:02.068277683Z [2024-02-24 04:11:02,067: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:11:02.068359329Z [2024-02-24 04:11:02,068: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:11:02.068539916Z [2024-02-24 04:11:02,068: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:11:02.068615480Z [2024-02-24 04:11:02,068: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:11:02.068997976Z [2024-02-24 04:11:02,068: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:11:02.069051378Z [2024-02-24 04:11:02,068: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:11:02.146003083Z [2024-02-24 04:11:02,145: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:11:02.149444722Z [2024-02-24 04:11:02,148: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:11:02.171284892Z [2024-02-24 04:11:02,171: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:11:02.172413244Z [2024-02-24 04:11:02,172: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:11:02.172507331Z [2024-02-24 04:11:02,172: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:11:02.172688684Z [2024-02-24 04:11:02,172: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:11:02.172751361Z [2024-02-24 04:11:02,172: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:11:02.173102008Z [2024-02-24 04:11:02,172: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:11:02.173496934Z [2024-02-24 04:11:02,173: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:11:02.200489724Z [2024-02-24 04:11:02,200: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:11:02.282459720Z [2024-02-24 04:11:02,282: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:11:04.607727768Z [2024-02-24 04:11:04,607: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e2d542eb-b784-4c02-90c5-b6139a9e5716] succeeded in 4.087547209001059s: None
2024-02-24T04:11:04.976645182Z [2024-02-24 04:11:04,976: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[124aad3e-be85-4894-8bd9-9f1cf5b1a156] succeeded in 4.453066551002848s: None
2024-02-24T04:12:00.506498184Z [2024-02-24 04:12:00,506: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d7ac3981-98f6-4415-9a62-5a87704b12db] received
2024-02-24T04:12:00.510707114Z [2024-02-24 04:12:00,510: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4559d10d-a0a4-4f1d-bc3c-02de95e93384] received
2024-02-24T04:12:00.517017137Z [2024-02-24 04:12:00,516: INFO/ForkPoolWorker-16] [4559d10d-a0a4-4f1d-bc3c-02de95e93384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:12:00.519103863Z [2024-02-24 04:12:00,518: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc88d6ab-8b6a-4bad-9e12-272879d73785] received
2024-02-24T04:12:00.520291727Z [2024-02-24 04:12:00,519: INFO/ForkPoolWorker-15] [d7ac3981-98f6-4415-9a62-5a87704b12db] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:12:00.527030387Z [2024-02-24 04:12:00,526: INFO/ForkPoolWorker-1] [dc88d6ab-8b6a-4bad-9e12-272879d73785] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:12:00.530498008Z [2024-02-24 04:12:00,530: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[24f65d75-298d-42c0-8dfb-e1e7b81e649c] received
2024-02-24T04:12:00.546611087Z [2024-02-24 04:12:00,546: INFO/ForkPoolWorker-2] [24f65d75-298d-42c0-8dfb-e1e7b81e649c] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:11:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:12:00.828489229Z [2024-02-24 04:12:00,825: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:12:00.845471238Z [2024-02-24 04:12:00,842: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:12:00.896103940Z [2024-02-24 04:12:00,888: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:12:00.947729568Z [2024-02-24 04:12:00,942: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:12:01.150822027Z [2024-02-24 04:12:01,150: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:12:01.154764051Z [2024-02-24 04:12:01,154: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:12:01.193841805Z [2024-02-24 04:12:01,193: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:12:01.198774735Z [2024-02-24 04:12:01,198: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:12:01.202550811Z [2024-02-24 04:12:01,202: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:12:01.202727074Z [2024-02-24 04:12:01,202: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:12:01.202800231Z [2024-02-24 04:12:01,202: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:12:01.203035349Z [2024-02-24 04:12:01,202: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:12:01.347195842Z [2024-02-24 04:12:01,346: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:12:01.903846713Z [2024-02-24 04:12:01,903: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d7ac3981-98f6-4415-9a62-5a87704b12db] succeeded in 1.3952863229969807s: None
2024-02-24T04:12:02.007392852Z [2024-02-24 04:12:02,006: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[24f65d75-298d-42c0-8dfb-e1e7b81e649c] succeeded in 1.4721646930011048s: None
2024-02-24T04:12:02.158274766Z [2024-02-24 04:12:02,157: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:12:02.161530771Z [2024-02-24 04:12:02,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:12:02.188350504Z [2024-02-24 04:12:02,188: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:12:02.190152979Z [2024-02-24 04:12:02,189: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:12:02.190170108Z [2024-02-24 04:12:02,190: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:12:02.190421845Z [2024-02-24 04:12:02,190: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:12:02.190558923Z [2024-02-24 04:12:02,190: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:12:02.190937002Z [2024-02-24 04:12:02,190: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:12:02.190982611Z [2024-02-24 04:12:02,190: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:12:02.276093385Z [2024-02-24 04:12:02,275: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:12:02.436007709Z [2024-02-24 04:12:02,435: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:12:02.439602844Z [2024-02-24 04:12:02,439: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:12:02.463164864Z [2024-02-24 04:12:02,462: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:12:02.464661296Z [2024-02-24 04:12:02,464: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:12:02.464683934Z [2024-02-24 04:12:02,464: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:12:02.464802655Z [2024-02-24 04:12:02,464: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:12:02.464881158Z [2024-02-24 04:12:02,464: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:12:02.465381165Z [2024-02-24 04:12:02,465: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:12:02.465394564Z [2024-02-24 04:12:02,465: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:12:02.589319980Z [2024-02-24 04:12:02,588: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:11:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:12:04.188261449Z [2024-02-24 04:12:04,187: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4559d10d-a0a4-4f1d-bc3c-02de95e93384] succeeded in 3.676035584001511s: None
2024-02-24T04:12:04.248803335Z [2024-02-24 04:12:04,248: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[dc88d6ab-8b6a-4bad-9e12-272879d73785] succeeded in 3.727366423001513s: None
2024-02-24T04:13:00.466678343Z [2024-02-24 04:13:00,466: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[db2e97cf-869a-412e-9432-31ff46fdad74] received
2024-02-24T04:13:00.480338403Z [2024-02-24 04:13:00,480: INFO/ForkPoolWorker-15] [db2e97cf-869a-412e-9432-31ff46fdad74] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:13:00.481690885Z [2024-02-24 04:13:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8f350dd-eaa7-419d-be6e-fde006692ee2] received
2024-02-24T04:13:00.490404014Z [2024-02-24 04:13:00,490: INFO/ForkPoolWorker-16] [e8f350dd-eaa7-419d-be6e-fde006692ee2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:13:00.497968090Z [2024-02-24 04:13:00,497: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[08a540ec-cc11-44c9-a461-73e68613a16f] received
2024-02-24T04:13:00.508756537Z [2024-02-24 04:13:00,508: INFO/ForkPoolWorker-1] [08a540ec-cc11-44c9-a461-73e68613a16f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:13:00.871888780Z [2024-02-24 04:13:00,868: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:13:00.872752475Z [2024-02-24 04:13:00,869: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:13:00.913340590Z [2024-02-24 04:13:00,910: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:13:01.041590588Z [2024-02-24 04:13:01,041: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:13:01.046157308Z [2024-02-24 04:13:01,045: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:13:01.086964567Z [2024-02-24 04:13:01,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:13:01.091010592Z [2024-02-24 04:13:01,090: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:13:01.091400231Z [2024-02-24 04:13:01,090: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:13:01.097689349Z [2024-02-24 04:13:01,094: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:13:01.099288390Z [2024-02-24 04:13:01,099: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:13:01.195559835Z [2024-02-24 04:13:01,195: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:13:01.891878562Z [2024-02-24 04:13:01,891: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[08a540ec-cc11-44c9-a461-73e68613a16f] succeeded in 1.3911037700017914s: None
2024-02-24T04:13:02.189818964Z [2024-02-24 04:13:02,189: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:13:02.193307582Z [2024-02-24 04:13:02,192: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:13:02.218826326Z [2024-02-24 04:13:02,218: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:13:02.221652750Z [2024-02-24 04:13:02,221: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:13:02.221686238Z [2024-02-24 04:13:02,221: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:13:02.221785585Z [2024-02-24 04:13:02,221: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:13:02.221818860Z [2024-02-24 04:13:02,221: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:13:02.222165073Z [2024-02-24 04:13:02,221: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:13:02.222184320Z [2024-02-24 04:13:02,222: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:13:02.231549329Z [2024-02-24 04:13:02,231: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:13:02.235407860Z [2024-02-24 04:13:02,234: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:13:02.255574730Z [2024-02-24 04:13:02,255: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:13:02.257157372Z [2024-02-24 04:13:02,256: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:13:02.257334577Z [2024-02-24 04:13:02,257: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:13:02.257624054Z [2024-02-24 04:13:02,257: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:13:02.257840478Z [2024-02-24 04:13:02,257: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:13:02.258379589Z [2024-02-24 04:13:02,258: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:13:02.258566842Z [2024-02-24 04:13:02,258: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:13:02.327120351Z [2024-02-24 04:13:02,326: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:13:02.361955635Z [2024-02-24 04:13:02,361: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:13:04.511785086Z [2024-02-24 04:13:04,511: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[db2e97cf-869a-412e-9432-31ff46fdad74] succeeded in 4.040880345997721s: None
2024-02-24T04:13:04.852307694Z [2024-02-24 04:13:04,851: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e8f350dd-eaa7-419d-be6e-fde006692ee2] succeeded in 4.367449056000623s: None
2024-02-24T04:14:00.453294985Z [2024-02-24 04:14:00,452: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f18da770-a404-4c31-92d1-9c9461c1f000] received
2024-02-24T04:14:00.458624097Z [2024-02-24 04:14:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc60da37-3bb6-4d11-920a-b9507f674daf] received
2024-02-24T04:14:00.466783123Z [2024-02-24 04:14:00,466: INFO/ForkPoolWorker-15] [f18da770-a404-4c31-92d1-9c9461c1f000] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:12:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:14:00.467655883Z [2024-02-24 04:14:00,467: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4d0ad2fd-b4dd-4c14-883d-b3002ff0e83d] received
2024-02-24T04:14:00.479371437Z [2024-02-24 04:14:00,478: INFO/ForkPoolWorker-1] [4d0ad2fd-b4dd-4c14-883d-b3002ff0e83d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:14:00.481893932Z [2024-02-24 04:14:00,481: INFO/ForkPoolWorker-16] [fc60da37-3bb6-4d11-920a-b9507f674daf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:14:00.484792400Z [2024-02-24 04:14:00,484: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5febdffb-52f0-4ead-a3a5-0043944cf120] received
2024-02-24T04:14:00.496223769Z [2024-02-24 04:14:00,495: INFO/ForkPoolWorker-2] [5febdffb-52f0-4ead-a3a5-0043944cf120] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:13:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:14:00.805614864Z [2024-02-24 04:14:00,799: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:14:00.838221194Z [2024-02-24 04:14:00,834: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:14:00.957206980Z [2024-02-24 04:14:00,954: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:14:01.073304543Z [2024-02-24 04:14:01,067: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:14:01.260576953Z [2024-02-24 04:14:01,259: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:12:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:14:01.307271678Z [2024-02-24 04:14:01,306: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:14:01.312400248Z [2024-02-24 04:14:01,311: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:14:01.336703061Z [2024-02-24 04:14:01,336: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:14:01.338356287Z [2024-02-24 04:14:01,338: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:14:01.338514376Z [2024-02-24 04:14:01,338: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:14:01.338672904Z [2024-02-24 04:14:01,338: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:14:01.338998304Z [2024-02-24 04:14:01,338: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:14:01.438299014Z [2024-02-24 04:14:01,438: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:14:01.878643237Z [2024-02-24 04:14:01,878: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f18da770-a404-4c31-92d1-9c9461c1f000] succeeded in 1.4187011860012717s: None
2024-02-24T04:14:02.092073427Z [2024-02-24 04:14:02,091: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[5febdffb-52f0-4ead-a3a5-0043944cf120] succeeded in 1.603244365000137s: None
2024-02-24T04:14:02.180723419Z [2024-02-24 04:14:02,180: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:14:02.184143868Z [2024-02-24 04:14:02,183: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:14:02.208847215Z [2024-02-24 04:14:02,208: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:14:02.210408784Z [2024-02-24 04:14:02,210: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:14:02.210522847Z [2024-02-24 04:14:02,210: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:14:02.210720862Z [2024-02-24 04:14:02,210: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:14:02.210846799Z [2024-02-24 04:14:02,210: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:14:02.212146586Z [2024-02-24 04:14:02,211: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:14:02.212233919Z [2024-02-24 04:14:02,212: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:14:02.312449609Z [2024-02-24 04:14:02,312: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:14:02.340748608Z [2024-02-24 04:14:02,340: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:14:02.344284222Z [2024-02-24 04:14:02,343: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:14:02.369899520Z [2024-02-24 04:14:02,369: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:14:02.374771034Z [2024-02-24 04:14:02,373: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:14:02.374802886Z [2024-02-24 04:14:02,373: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:14:02.374807150Z [2024-02-24 04:14:02,373: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:14:02.374811677Z [2024-02-24 04:14:02,373: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:14:02.374814947Z [2024-02-24 04:14:02,374: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:14:02.374818013Z [2024-02-24 04:14:02,374: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:14:02.480294559Z [2024-02-24 04:14:02,479: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:13:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:14:03.986179845Z [2024-02-24 04:14:03,985: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[4d0ad2fd-b4dd-4c14-883d-b3002ff0e83d] succeeded in 3.515583033000439s: None
2024-02-24T04:14:04.362040306Z [2024-02-24 04:14:04,361: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[fc60da37-3bb6-4d11-920a-b9507f674daf] succeeded in 3.8992840489991067s: None
2024-02-24T04:15:01.169937213Z [2024-02-24 04:15:01,169: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4ac62395-d3a5-4ce1-b2ee-9b47c5998f6f] received
2024-02-24T04:15:01.175875749Z [2024-02-24 04:15:01,175: INFO/ForkPoolWorker-15] [4ac62395-d3a5-4ce1-b2ee-9b47c5998f6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:15:01.179686240Z [2024-02-24 04:15:01,175: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[147a2705-2449-4680-a52b-70d58a0daa66] received
2024-02-24T04:15:01.186688332Z [2024-02-24 04:15:01,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6063f1dc-0d02-41d4-b7d5-31ef340990ba] received
2024-02-24T04:15:01.188660674Z [2024-02-24 04:15:01,188: INFO/ForkPoolWorker-16] [147a2705-2449-4680-a52b-70d58a0daa66] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:15:01.190521227Z [2024-02-24 04:15:01,190: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1d572dc-2314-43b5-9b67-32f014ad5945] received
2024-02-24T04:15:01.202585375Z [2024-02-24 04:15:01,202: INFO/ForkPoolWorker-2] [f1d572dc-2314-43b5-9b67-32f014ad5945] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:15:01.214354133Z [2024-02-24 04:15:01,208: INFO/ForkPoolWorker-1] [6063f1dc-0d02-41d4-b7d5-31ef340990ba] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:15:01.583614680Z [2024-02-24 04:15:01,580: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:15:01.637078710Z [2024-02-24 04:15:01,626: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:15:01.688263814Z [2024-02-24 04:15:01,684: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:15:01.720719379Z [2024-02-24 04:15:01,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:15:01.862171107Z [2024-02-24 04:15:01,861: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:15:01.866160318Z [2024-02-24 04:15:01,865: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:01.890993542Z [2024-02-24 04:15:01,890: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:15:01.895983085Z [2024-02-24 04:15:01,895: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:15:01.896103320Z [2024-02-24 04:15:01,895: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:15:01.896145385Z [2024-02-24 04:15:01,896: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:15:01.902954195Z [2024-02-24 04:15:01,902: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:15:02.029677246Z [2024-02-24 04:15:02,029: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:02.649923139Z [2024-02-24 04:15:02,647: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1d572dc-2314-43b5-9b67-32f014ad5945] succeeded in 1.4558936979992723s: None
2024-02-24T04:15:03.167022353Z [2024-02-24 04:15:03,166: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:15:03.171298368Z [2024-02-24 04:15:03,170: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:03.198063387Z [2024-02-24 04:15:03,197: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:15:03.200219360Z [2024-02-24 04:15:03,199: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:03.200236331Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:03.200441255Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:03.200603464Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:15:03.200962936Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:15:03.201034158Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:15:03.201186590Z [2024-02-24 04:15:03,200: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:03.207103058Z [2024-02-24 04:15:03,206: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:03.216005193Z [2024-02-24 04:15:03,215: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:15:03.219372175Z [2024-02-24 04:15:03,218: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:03.232912859Z [2024-02-24 04:15:03,232: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:15:03.235737587Z [2024-02-24 04:15:03,235: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:03.235852793Z [2024-02-24 04:15:03,235: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:03.236167432Z [2024-02-24 04:15:03,235: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:03.236277555Z [2024-02-24 04:15:03,236: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:15:03.237076359Z [2024-02-24 04:15:03,236: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:15:03.237342990Z [2024-02-24 04:15:03,237: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:03.248121700Z [2024-02-24 04:15:03,247: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:15:03.250025205Z [2024-02-24 04:15:03,249: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:03.250132977Z [2024-02-24 04:15:03,249: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:03.250143808Z [2024-02-24 04:15:03,249: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:03.250238263Z [2024-02-24 04:15:03,250: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:15:03.250608727Z [2024-02-24 04:15:03,250: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:15:03.250760966Z [2024-02-24 04:15:03,250: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:03.315317254Z [2024-02-24 04:15:03,314: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:03.359309174Z [2024-02-24 04:15:03,358: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:03.371013637Z [2024-02-24 04:15:03,370: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:03.967319691Z [2024-02-24 04:15:03,966: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4ac62395-d3a5-4ce1-b2ee-9b47c5998f6f] succeeded in 2.796048759999394s: None
2024-02-24T04:15:04.164458795Z [2024-02-24 04:15:04,164: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b91edb73-50a3-4317-b754-1419a7877f46] received
2024-02-24T04:15:04.173133526Z [2024-02-24 04:15:04,172: INFO/ForkPoolWorker-15] [b91edb73-50a3-4317-b754-1419a7877f46] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:15:04.455824301Z [2024-02-24 04:15:04,452: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:15:05.519961732Z [2024-02-24 04:15:05,519: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[147a2705-2449-4680-a52b-70d58a0daa66] succeeded in 4.337051562000852s: None
2024-02-24T04:15:05.590365791Z [2024-02-24 04:15:05,589: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:15:05.593655414Z [2024-02-24 04:15:05,593: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:05.611125916Z [2024-02-24 04:15:05,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:15:05.612352284Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:05.612366613Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:05.612488018Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:05.612500584Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:15:05.612747595Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:15:05.612755633Z [2024-02-24 04:15:05,612: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:05.693311072Z [2024-02-24 04:15:05,692: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:05.763244757Z [2024-02-24 04:15:05,762: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6063f1dc-0d02-41d4-b7d5-31ef340990ba] succeeded in 4.574553923001076s: None
2024-02-24T04:15:06.313963092Z [2024-02-24 04:15:06,313: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[b91edb73-50a3-4317-b754-1419a7877f46] succeeded in 2.1476545370023814s: None
2024-02-24T04:15:06.985279425Z [2024-02-24 04:15:06,984: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8065b741-f9df-4f78-8983-948561992c35] received
2024-02-24T04:15:06.992968219Z [2024-02-24 04:15:06,992: INFO/ForkPoolWorker-15] [8065b741-f9df-4f78-8983-948561992c35] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:15:07.272353292Z [2024-02-24 04:15:07,269: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:15:08.449721727Z [2024-02-24 04:15:08,449: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:15:08.452881428Z [2024-02-24 04:15:08,452: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:08.473169106Z [2024-02-24 04:15:08,472: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:15:08.475376446Z [2024-02-24 04:15:08,475: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:08.475521185Z [2024-02-24 04:15:08,475: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:08.475878231Z [2024-02-24 04:15:08,475: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:08.476081078Z [2024-02-24 04:15:08,475: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:15:08.476523384Z [2024-02-24 04:15:08,476: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:15:08.477554912Z [2024-02-24 04:15:08,476: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:08.567066009Z [2024-02-24 04:15:08,566: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:10:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:09.222159953Z [2024-02-24 04:15:09,221: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8065b741-f9df-4f78-8983-948561992c35] succeeded in 2.2337952310008404s: None
2024-02-24T04:15:09.315153638Z [2024-02-24 04:15:09,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f889b291-3fca-4049-980a-c133e23769dc] received
2024-02-24T04:15:09.325027127Z [2024-02-24 04:15:09,324: INFO/ForkPoolWorker-15] [f889b291-3fca-4049-980a-c133e23769dc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:10:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:15:09.634496947Z [2024-02-24 04:15:09,631: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:15:10.778472585Z [2024-02-24 04:15:10,778: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:15:10.781831316Z [2024-02-24 04:15:10,781: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:15:10.799259760Z [2024-02-24 04:15:10,798: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:15:10.800468113Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:15:10.800527480Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:15:10.800645817Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:15:10.800758865Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:15:10.801046580Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:15:10.801209261Z [2024-02-24 04:15:10,800: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:15:10.886107250Z [2024-02-24 04:15:10,885: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:10:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:15:11.507604283Z [2024-02-24 04:15:11,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f889b291-3fca-4049-980a-c133e23769dc] succeeded in 2.1888517289989977s: None
2024-02-24T04:16:01.132739474Z [2024-02-24 04:16:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c528e3ad-637c-498b-9439-a46da0bbe7be] received
2024-02-24T04:16:01.136890078Z [2024-02-24 04:16:01,136: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[22d03ef7-393c-40ef-9988-d1fa8a0030c3] received
2024-02-24T04:16:01.152210903Z [2024-02-24 04:16:01,151: INFO/ForkPoolWorker-15] [c528e3ad-637c-498b-9439-a46da0bbe7be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:16:01.152798844Z [2024-02-24 04:16:01,152: INFO/ForkPoolWorker-16] [22d03ef7-393c-40ef-9988-d1fa8a0030c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:16:01.170875990Z [2024-02-24 04:16:01,170: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5f048e01-18a1-4bd0-a435-e75316923255] received
2024-02-24T04:16:01.187691758Z [2024-02-24 04:16:01,186: INFO/ForkPoolWorker-1] [5f048e01-18a1-4bd0-a435-e75316923255] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:14:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:16:01.202657479Z [2024-02-24 04:16:01,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[02e6614e-5947-4c9a-910d-6c39449e8606] received
2024-02-24T04:16:01.249878408Z [2024-02-24 04:16:01,247: INFO/ForkPoolWorker-2] [02e6614e-5947-4c9a-910d-6c39449e8606] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:16:01.596489375Z [2024-02-24 04:16:01,592: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:16:01.720946983Z [2024-02-24 04:16:01,717: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:16:01.844945715Z [2024-02-24 04:16:01,841: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:16:01.907330918Z [2024-02-24 04:16:01,906: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:16:01.911218119Z [2024-02-24 04:16:01,910: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:16:01.957837508Z [2024-02-24 04:16:01,957: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:16:01.963525680Z [2024-02-24 04:16:01,963: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:16:01.963600139Z [2024-02-24 04:16:01,963: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:16:01.963605572Z [2024-02-24 04:16:01,963: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:16:01.963801329Z [2024-02-24 04:16:01,963: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:16:02.050898941Z [2024-02-24 04:16:02,036: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:16:02.176970621Z [2024-02-24 04:16:02,176: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:16:02.229820338Z [2024-02-24 04:16:02,229: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:14:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:16:03.283084178Z [2024-02-24 04:16:03,282: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[5f048e01-18a1-4bd0-a435-e75316923255] succeeded in 2.1088993509983993s: None
2024-02-24T04:16:03.317083209Z [2024-02-24 04:16:03,316: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[22d03ef7-393c-40ef-9988-d1fa8a0030c3] succeeded in 2.178240407996782s: None
2024-02-24T04:16:03.812774948Z [2024-02-24 04:16:03,812: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:16:03.816293618Z [2024-02-24 04:16:03,815: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:16:03.846796129Z [2024-02-24 04:16:03,846: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:16:03.848782656Z [2024-02-24 04:16:03,848: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:16:03.848796175Z [2024-02-24 04:16:03,848: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:16:03.848891180Z [2024-02-24 04:16:03,848: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:16:03.848932049Z [2024-02-24 04:16:03,848: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:16:03.849182748Z [2024-02-24 04:16:03,849: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:16:03.849189163Z [2024-02-24 04:16:03,849: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:16:03.957403478Z [2024-02-24 04:16:03,956: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:16:04.239082243Z [2024-02-24 04:16:04,238: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:16:04.242607450Z [2024-02-24 04:16:04,241: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:16:04.273687785Z [2024-02-24 04:16:04,273: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:16:04.286562038Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:16:04.286592170Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:16:04.286618162Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:16:04.286683598Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:16:04.286922974Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:16:04.286934242Z [2024-02-24 04:16:04,286: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:16:04.405225643Z [2024-02-24 04:16:04,404: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:16:06.205507601Z [2024-02-24 04:16:06,204: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[02e6614e-5947-4c9a-910d-6c39449e8606] succeeded in 4.994023626000853s: None
2024-02-24T04:16:06.418844081Z [2024-02-24 04:16:06,418: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c528e3ad-637c-498b-9439-a46da0bbe7be] succeeded in 5.28042557200024s: None
2024-02-24T04:17:00.927232561Z [2024-02-24 04:17:00,926: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f26e949c-466a-4c58-a633-6222e5265bed] received
2024-02-24T04:17:00.937200196Z [2024-02-24 04:17:00,936: INFO/ForkPoolWorker-15] [f26e949c-466a-4c58-a633-6222e5265bed] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:17:00.947688974Z [2024-02-24 04:17:00,947: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0c065559-64d4-4564-b889-2615976b7e59] received
2024-02-24T04:17:00.955638515Z [2024-02-24 04:17:00,955: INFO/ForkPoolWorker-16] [0c065559-64d4-4564-b889-2615976b7e59] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:17:00.968809101Z [2024-02-24 04:17:00,968: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b818b115-f3bb-4ec3-9a7a-338397668a87] received
2024-02-24T04:17:00.981287243Z [2024-02-24 04:17:00,978: INFO/ForkPoolWorker-1] [b818b115-f3bb-4ec3-9a7a-338397668a87] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:17:01.347626992Z [2024-02-24 04:17:01,343: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:17:01.373250033Z [2024-02-24 04:17:01,369: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:17:01.480614558Z [2024-02-24 04:17:01,475: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:17:01.554602662Z [2024-02-24 04:17:01,554: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:17:01.566006927Z [2024-02-24 04:17:01,563: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:17:01.604232543Z [2024-02-24 04:17:01,603: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:17:01.605951635Z [2024-02-24 04:17:01,605: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:17:01.606026258Z [2024-02-24 04:17:01,605: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:17:01.606132284Z [2024-02-24 04:17:01,605: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:17:01.606436199Z [2024-02-24 04:17:01,606: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:17:01.720163069Z [2024-02-24 04:17:01,719: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:17:02.286820611Z [2024-02-24 04:17:02,286: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b818b115-f3bb-4ec3-9a7a-338397668a87] succeeded in 1.3155795759994362s: None
2024-02-24T04:17:02.582583100Z [2024-02-24 04:17:02,581: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:17:02.586142739Z [2024-02-24 04:17:02,585: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:17:02.605106897Z [2024-02-24 04:17:02,604: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:17:02.606358607Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:17:02.606379283Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:17:02.606573790Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:17:02.606633220Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:17:02.606918072Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:17:02.607010507Z [2024-02-24 04:17:02,606: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:17:02.714001217Z [2024-02-24 04:17:02,704: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:17:02.896462402Z [2024-02-24 04:17:02,896: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:17:02.900256273Z [2024-02-24 04:17:02,899: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:17:02.925310462Z [2024-02-24 04:17:02,925: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:17:02.926851596Z [2024-02-24 04:17:02,926: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:17:02.927022608Z [2024-02-24 04:17:02,926: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:17:02.927213106Z [2024-02-24 04:17:02,926: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:17:02.927296613Z [2024-02-24 04:17:02,927: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:17:02.927595163Z [2024-02-24 04:17:02,927: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:17:02.927671054Z [2024-02-24 04:17:02,927: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:17:03.015527769Z [2024-02-24 04:17:03,015: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:17:04.528424413Z [2024-02-24 04:17:04,527: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[0c065559-64d4-4564-b889-2615976b7e59] succeeded in 3.5778925829981745s: None
2024-02-24T04:17:04.629325600Z [2024-02-24 04:17:04,628: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f26e949c-466a-4c58-a633-6222e5265bed] succeeded in 3.695712586002628s: None
2024-02-24T04:17:39.150235447Z [2024-02-24 04:17:39,149: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c99a04e4-ccff-4f96-bed1-c5549b55b1bd] received
2024-02-24T04:17:39.155998312Z [2024-02-24 04:17:39,155: INFO/ForkPoolWorker-15] [c99a04e4-ccff-4f96-bed1-c5549b55b1bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224041737_088906', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:17:39.438684324Z [2024-02-24 04:17:39,435: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:17:39.749763500Z [2024-02-24 04:17:39,749: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224041737_088906 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:17:40.373614959Z [2024-02-24 04:17:40,373: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[c99a04e4-ccff-4f96-bed1-c5549b55b1bd] succeeded in 1.2214586049994978s: None
2024-02-24T04:18:00.711843324Z [2024-02-24 04:18:00,711: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[198b5b76-34a6-4047-a7d7-70c52361c75b] received
2024-02-24T04:18:00.717139354Z [2024-02-24 04:18:00,716: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[09626d66-d84d-4ac6-b9b2-c00fb4f90c0c] received
2024-02-24T04:18:00.718824527Z [2024-02-24 04:18:00,718: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1a091a4-16da-46b1-9e72-d9898feba6a6] received
2024-02-24T04:18:00.720504248Z [2024-02-24 04:18:00,720: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfa7eda4-63f5-4b49-ade8-fdb2ba4a3575] received
2024-02-24T04:18:00.722926347Z [2024-02-24 04:18:00,722: INFO/ForkPoolWorker-15] [198b5b76-34a6-4047-a7d7-70c52361c75b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:16:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:18:00.728530311Z [2024-02-24 04:18:00,728: INFO/ForkPoolWorker-1] [b1a091a4-16da-46b1-9e72-d9898feba6a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:18:00.731270171Z [2024-02-24 04:18:00,731: INFO/ForkPoolWorker-16] [09626d66-d84d-4ac6-b9b2-c00fb4f90c0c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:18:00.751457493Z [2024-02-24 04:18:00,751: INFO/ForkPoolWorker-2] [cfa7eda4-63f5-4b49-ade8-fdb2ba4a3575] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:17:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:18:01.082362853Z [2024-02-24 04:18:01,079: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:18:01.088949826Z [2024-02-24 04:18:01,085: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:18:01.118628142Z [2024-02-24 04:18:01,114: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:18:01.123193343Z [2024-02-24 04:18:01,119: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:18:01.372581170Z [2024-02-24 04:18:01,372: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:18:01.378317621Z [2024-02-24 04:18:01,377: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:18:01.407692237Z [2024-02-24 04:18:01,407: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:18:01.408652386Z [2024-02-24 04:18:01,408: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:18:01.408677227Z [2024-02-24 04:18:01,408: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:18:01.408752644Z [2024-02-24 04:18:01,408: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:18:01.408920578Z [2024-02-24 04:18:01,408: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:18:01.425714346Z [2024-02-24 04:18:01,425: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:16:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:18:01.556085215Z [2024-02-24 04:18:01,555: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:18:02.115615239Z [2024-02-24 04:18:02,115: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[198b5b76-34a6-4047-a7d7-70c52361c75b] succeeded in 1.4020683390008344s: None
2024-02-24T04:18:02.290415462Z [2024-02-24 04:18:02,290: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[cfa7eda4-63f5-4b49-ade8-fdb2ba4a3575] succeeded in 1.5661632899973483s: None
2024-02-24T04:18:02.565644359Z [2024-02-24 04:18:02,565: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:18:02.571818099Z [2024-02-24 04:18:02,571: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:18:02.595523982Z [2024-02-24 04:18:02,595: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:18:02.596902415Z [2024-02-24 04:18:02,596: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:18:02.597269418Z [2024-02-24 04:18:02,596: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:18:02.597649906Z [2024-02-24 04:18:02,597: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:18:02.598007483Z [2024-02-24 04:18:02,597: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:18:02.598777095Z [2024-02-24 04:18:02,598: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:18:02.599094086Z [2024-02-24 04:18:02,598: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:18:02.678014808Z [2024-02-24 04:18:02,674: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:18:02.682938397Z [2024-02-24 04:18:02,677: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:18:02.751724829Z [2024-02-24 04:18:02,750: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:18:02.773589071Z [2024-02-24 04:18:02,772: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:18:02.775022210Z [2024-02-24 04:18:02,774: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:18:02.775117744Z [2024-02-24 04:18:02,775: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:18:02.775290034Z [2024-02-24 04:18:02,775: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:18:02.775471058Z [2024-02-24 04:18:02,775: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:18:02.775794584Z [2024-02-24 04:18:02,775: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:18:02.775914309Z [2024-02-24 04:18:02,775: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:18:02.924802758Z [2024-02-24 04:18:02,924: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:17:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:18:04.773359185Z [2024-02-24 04:18:04,771: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1a091a4-16da-46b1-9e72-d9898feba6a6] succeeded in 4.050211584999488s: None
2024-02-24T04:18:05.021341695Z [2024-02-24 04:18:05,020: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[09626d66-d84d-4ac6-b9b2-c00fb4f90c0c] succeeded in 4.301922547001595s: None
2024-02-24T04:19:00.517962339Z [2024-02-24 04:19:00,517: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f29eb6d3-63b9-4f5c-ae0f-af3e93ea50d7] received
2024-02-24T04:19:00.523969036Z [2024-02-24 04:19:00,523: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ef8d6e9e-6913-403f-bc49-df04f2898f50] received
2024-02-24T04:19:00.537312386Z [2024-02-24 04:19:00,536: INFO/ForkPoolWorker-16] [ef8d6e9e-6913-403f-bc49-df04f2898f50] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:19:00.537943286Z [2024-02-24 04:19:00,537: INFO/ForkPoolWorker-15] [f29eb6d3-63b9-4f5c-ae0f-af3e93ea50d7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:19:00.550190331Z [2024-02-24 04:19:00,549: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c25c71b8-df5c-417d-bd4a-53a569d33638] received
2024-02-24T04:19:00.564965096Z [2024-02-24 04:19:00,564: INFO/ForkPoolWorker-1] [c25c71b8-df5c-417d-bd4a-53a569d33638] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:19:00.879164989Z [2024-02-24 04:19:00,874: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:19:00.893956482Z [2024-02-24 04:19:00,889: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:19:00.998194248Z [2024-02-24 04:19:00,994: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:19:01.078862861Z [2024-02-24 04:19:01,078: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:19:01.083170819Z [2024-02-24 04:19:01,082: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:19:01.113696990Z [2024-02-24 04:19:01,113: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:19:01.118743996Z [2024-02-24 04:19:01,118: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:19:01.119024291Z [2024-02-24 04:19:01,118: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:19:01.119205989Z [2024-02-24 04:19:01,119: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:19:01.122278441Z [2024-02-24 04:19:01,121: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:19:01.314596258Z [2024-02-24 04:19:01,314: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:19:02.014861478Z [2024-02-24 04:19:02,014: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c25c71b8-df5c-417d-bd4a-53a569d33638] succeeded in 1.4601814359994023s: None
2024-02-24T04:19:02.182232017Z [2024-02-24 04:19:02,181: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:19:02.185626065Z [2024-02-24 04:19:02,185: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:19:02.223229743Z [2024-02-24 04:19:02,222: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:19:02.228062166Z [2024-02-24 04:19:02,227: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:19:02.228344861Z [2024-02-24 04:19:02,227: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:19:02.228743362Z [2024-02-24 04:19:02,228: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:19:02.229043471Z [2024-02-24 04:19:02,228: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:19:02.229866028Z [2024-02-24 04:19:02,229: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:19:02.230215931Z [2024-02-24 04:19:02,229: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:19:02.272516688Z [2024-02-24 04:19:02,272: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:19:02.275819150Z [2024-02-24 04:19:02,275: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:19:02.306618875Z [2024-02-24 04:19:02,306: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:19:02.308982291Z [2024-02-24 04:19:02,308: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:19:02.309135552Z [2024-02-24 04:19:02,308: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:19:02.309305516Z [2024-02-24 04:19:02,309: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:19:02.309385281Z [2024-02-24 04:19:02,309: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:19:02.309754013Z [2024-02-24 04:19:02,309: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:19:02.309969124Z [2024-02-24 04:19:02,309: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:19:02.342754871Z [2024-02-24 04:19:02,342: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:19:02.429904096Z [2024-02-24 04:19:02,429: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:19:04.660637920Z [2024-02-24 04:19:04,660: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ef8d6e9e-6913-403f-bc49-df04f2898f50] succeeded in 4.134526910998829s: None
2024-02-24T04:19:04.995755297Z [2024-02-24 04:19:04,995: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f29eb6d3-63b9-4f5c-ae0f-af3e93ea50d7] succeeded in 4.469910146999609s: None
2024-02-24T04:20:00.395999860Z [2024-02-24 04:20:00,395: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[235b4d46-d421-48a4-b21a-42c6c3920e88] received
2024-02-24T04:20:00.397569395Z [2024-02-24 04:20:00,397: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9f74713d-1f3d-4533-ab19-0f6da0cfceca] received
2024-02-24T04:20:00.403971970Z [2024-02-24 04:20:00,403: INFO/ForkPoolWorker-15] [235b4d46-d421-48a4-b21a-42c6c3920e88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:20:00.404485379Z [2024-02-24 04:20:00,404: INFO/ForkPoolWorker-16] [9f74713d-1f3d-4533-ab19-0f6da0cfceca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:20:00.409755338Z [2024-02-24 04:20:00,409: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6f8b5131-cf1e-4237-bf10-a70ef60263c4] received
2024-02-24T04:20:00.414246706Z [2024-02-24 04:20:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6e89d874-d6c8-4bbb-996b-6760a9ee5da4] received
2024-02-24T04:20:00.417232946Z [2024-02-24 04:20:00,417: INFO/ForkPoolWorker-1] [6f8b5131-cf1e-4237-bf10-a70ef60263c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:20:00.419618679Z [2024-02-24 04:20:00,419: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d9e0061-b1a7-42fd-b739-1da01fb0293d] received
2024-02-24T04:20:00.422407509Z [2024-02-24 04:20:00,422: INFO/ForkPoolWorker-2] [6e89d874-d6c8-4bbb-996b-6760a9ee5da4] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:18:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:20:00.437488996Z [2024-02-24 04:20:00,437: INFO/ForkPoolWorker-3] [1d9e0061-b1a7-42fd-b739-1da01fb0293d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:19:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:20:00.787473596Z [2024-02-24 04:20:00,783: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:20:00.853586448Z [2024-02-24 04:20:00,849: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:20:00.974934724Z [2024-02-24 04:20:00,971: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:20:00.993906753Z [2024-02-24 04:20:00,990: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:20:01.054007918Z [2024-02-24 04:20:01,053: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T04:20:01.058629674Z [2024-02-24 04:20:01,058: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:01.117013843Z [2024-02-24 04:20:01,116: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T04:20:01.118554241Z [2024-02-24 04:20:01,118: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:20:01.118762494Z [2024-02-24 04:20:01,118: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:20:01.118934786Z [2024-02-24 04:20:01,118: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T04:20:01.119294314Z [2024-02-24 04:20:01,119: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:20:01.187087756Z [2024-02-24 04:20:01,183: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:20:01.324656596Z [2024-02-24 04:20:01,324: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:01.800322479Z [2024-02-24 04:20:01,800: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:18:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:02.023248992Z [2024-02-24 04:20:02,022: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[1d9e0061-b1a7-42fd-b739-1da01fb0293d] succeeded in 1.5967804530009744s: None
2024-02-24T04:20:02.510806007Z [2024-02-24 04:20:02,510: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:20:02.514195175Z [2024-02-24 04:20:02,513: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:02.556309587Z [2024-02-24 04:20:02,554: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:20:02.558014270Z [2024-02-24 04:20:02,557: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:02.558029986Z [2024-02-24 04:20:02,557: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:02.558037720Z [2024-02-24 04:20:02,557: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:02.558041589Z [2024-02-24 04:20:02,557: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:20:02.558395905Z [2024-02-24 04:20:02,558: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:20:02.558500188Z [2024-02-24 04:20:02,558: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:02.576360956Z [2024-02-24 04:20:02,575: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[6e89d874-d6c8-4bbb-996b-6760a9ee5da4] succeeded in 2.1604012499992677s: None
2024-02-24T04:20:02.607261560Z [2024-02-24 04:20:02,606: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:20:02.610861590Z [2024-02-24 04:20:02,610: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:02.639195267Z [2024-02-24 04:20:02,638: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:20:02.644157764Z [2024-02-24 04:20:02,643: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:02.644292376Z [2024-02-24 04:20:02,644: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:02.644384749Z [2024-02-24 04:20:02,644: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:02.644431355Z [2024-02-24 04:20:02,644: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:20:02.644684937Z [2024-02-24 04:20:02,644: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:20:02.644733413Z [2024-02-24 04:20:02,644: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:02.645312131Z [2024-02-24 04:20:02,645: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:02.802527463Z [2024-02-24 04:20:02,802: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:02.919839859Z [2024-02-24 04:20:02,919: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:20:02.923195700Z [2024-02-24 04:20:02,922: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:02.970012821Z [2024-02-24 04:20:02,968: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:20:02.973135619Z [2024-02-24 04:20:02,972: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:02.973155287Z [2024-02-24 04:20:02,973: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:02.973319502Z [2024-02-24 04:20:02,973: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:02.973359664Z [2024-02-24 04:20:02,973: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:20:02.973672378Z [2024-02-24 04:20:02,973: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:20:02.973711915Z [2024-02-24 04:20:02,973: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:03.091034134Z [2024-02-24 04:20:03,090: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:19:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:03.503311988Z [2024-02-24 04:20:03,502: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[235b4d46-d421-48a4-b21a-42c6c3920e88] succeeded in 3.104328238998278s: None
2024-02-24T04:20:04.202513619Z [2024-02-24 04:20:04,202: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1d66e2ce-3664-45d2-b128-783d28160e00] received
2024-02-24T04:20:04.214349281Z [2024-02-24 04:20:04,213: INFO/ForkPoolWorker-15] [1d66e2ce-3664-45d2-b128-783d28160e00] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:20:04.505445877Z [2024-02-24 04:20:04,502: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:20:04.989438705Z [2024-02-24 04:20:04,989: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9f74713d-1f3d-4533-ab19-0f6da0cfceca] succeeded in 4.5905857530015055s: None
2024-02-24T04:20:05.214848815Z [2024-02-24 04:20:05,214: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6f8b5131-cf1e-4237-bf10-a70ef60263c4] succeeded in 4.802572352000425s: None
2024-02-24T04:20:05.652450923Z [2024-02-24 04:20:05,652: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:20:05.655695961Z [2024-02-24 04:20:05,655: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:05.675509898Z [2024-02-24 04:20:05,675: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:20:05.677432035Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:05.677449462Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:05.677571239Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:05.677585325Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:20:05.677944196Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:20:05.678071408Z [2024-02-24 04:20:05,677: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:05.767863249Z [2024-02-24 04:20:05,767: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:06.507572856Z [2024-02-24 04:20:06,507: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1d66e2ce-3664-45d2-b128-783d28160e00] succeeded in 2.301782192000246s: None
2024-02-24T04:20:06.633639977Z [2024-02-24 04:20:06,633: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[162b50f0-ee13-49b6-8427-a4811d39d1e7] received
2024-02-24T04:20:06.641808628Z [2024-02-24 04:20:06,641: INFO/ForkPoolWorker-15] [162b50f0-ee13-49b6-8427-a4811d39d1e7] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:20:06.972836429Z [2024-02-24 04:20:06,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:20:08.019658098Z [2024-02-24 04:20:08,019: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:20:08.022866948Z [2024-02-24 04:20:08,022: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:08.050726003Z [2024-02-24 04:20:08,050: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:20:08.052045749Z [2024-02-24 04:20:08,051: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:08.052136376Z [2024-02-24 04:20:08,051: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:08.052199343Z [2024-02-24 04:20:08,052: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:08.052257275Z [2024-02-24 04:20:08,052: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:20:08.052543758Z [2024-02-24 04:20:08,052: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:20:08.052632406Z [2024-02-24 04:20:08,052: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:08.127112542Z [2024-02-24 04:20:08,126: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:15:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:08.720612282Z [2024-02-24 04:20:08,719: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[162b50f0-ee13-49b6-8427-a4811d39d1e7] succeeded in 2.0840202500003215s: None
2024-02-24T04:20:09.195694844Z [2024-02-24 04:20:09,195: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfba7c3b-18a6-48d0-b35a-c15f29a8b270] received
2024-02-24T04:20:09.208551075Z [2024-02-24 04:20:09,208: INFO/ForkPoolWorker-15] [bfba7c3b-18a6-48d0-b35a-c15f29a8b270] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:15:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:20:09.498235507Z [2024-02-24 04:20:09,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:20:10.589490746Z [2024-02-24 04:20:10,588: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:20:10.592499633Z [2024-02-24 04:20:10,592: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:20:10.610532264Z [2024-02-24 04:20:10,610: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:20:10.611985574Z [2024-02-24 04:20:10,611: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:20:10.612111560Z [2024-02-24 04:20:10,611: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:20:10.612289112Z [2024-02-24 04:20:10,612: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:20:10.612383190Z [2024-02-24 04:20:10,612: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:20:10.612741532Z [2024-02-24 04:20:10,612: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:20:10.612846022Z [2024-02-24 04:20:10,612: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:20:10.690700794Z [2024-02-24 04:20:10,690: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:15:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:20:11.319412198Z [2024-02-24 04:20:11,318: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfba7c3b-18a6-48d0-b35a-c15f29a8b270] succeeded in 2.1194555520014546s: None
2024-02-24T04:21:01.091717055Z [2024-02-24 04:21:01,091: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[25ec02b1-3d49-4f7f-9f7f-e36fe47cc690] received
2024-02-24T04:21:01.096669506Z [2024-02-24 04:21:01,096: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5184035b-9868-4e0e-8491-33948e09029e] received
2024-02-24T04:21:01.100312983Z [2024-02-24 04:21:01,100: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[05489bbb-d9df-4850-b7b5-d5f82644683b] received
2024-02-24T04:21:01.108848647Z [2024-02-24 04:21:01,108: INFO/ForkPoolWorker-1] [05489bbb-d9df-4850-b7b5-d5f82644683b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:21:01.120670318Z [2024-02-24 04:21:01,120: INFO/ForkPoolWorker-15] [25ec02b1-3d49-4f7f-9f7f-e36fe47cc690] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:21:01.126742843Z [2024-02-24 04:21:01,126: INFO/ForkPoolWorker-16] [5184035b-9868-4e0e-8491-33948e09029e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:21:01.464552724Z [2024-02-24 04:21:01,461: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:21:01.499290891Z [2024-02-24 04:21:01,495: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:21:01.505393990Z [2024-02-24 04:21:01,500: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:21:01.628055237Z [2024-02-24 04:21:01,627: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:21:01.632187242Z [2024-02-24 04:21:01,631: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:21:01.658568069Z [2024-02-24 04:21:01,658: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:21:01.661218845Z [2024-02-24 04:21:01,660: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:21:01.661587756Z [2024-02-24 04:21:01,661: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:21:01.661944140Z [2024-02-24 04:21:01,661: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:21:01.662585711Z [2024-02-24 04:21:01,662: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:21:01.758375841Z [2024-02-24 04:21:01,758: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:21:02.423931651Z [2024-02-24 04:21:02,420: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[05489bbb-d9df-4850-b7b5-d5f82644683b] succeeded in 1.3181905589990492s: None
2024-02-24T04:21:02.860365463Z [2024-02-24 04:21:02,859: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:21:02.863540704Z [2024-02-24 04:21:02,863: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:21:02.884810819Z [2024-02-24 04:21:02,884: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:21:02.886193560Z [2024-02-24 04:21:02,885: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:21:02.886232510Z [2024-02-24 04:21:02,886: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:21:02.886405878Z [2024-02-24 04:21:02,886: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:21:02.886463893Z [2024-02-24 04:21:02,886: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:21:02.886748655Z [2024-02-24 04:21:02,886: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:21:02.886784704Z [2024-02-24 04:21:02,886: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:21:02.932277114Z [2024-02-24 04:21:02,931: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:21:02.935614503Z [2024-02-24 04:21:02,935: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:21:02.958445367Z [2024-02-24 04:21:02,958: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:21:02.960429343Z [2024-02-24 04:21:02,960: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:21:02.960461665Z [2024-02-24 04:21:02,960: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:21:02.960668367Z [2024-02-24 04:21:02,960: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:21:02.960734918Z [2024-02-24 04:21:02,960: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:21:02.961047515Z [2024-02-24 04:21:02,960: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:21:02.961097749Z [2024-02-24 04:21:02,961: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:21:02.980750177Z [2024-02-24 04:21:02,980: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:21:03.054746569Z [2024-02-24 04:21:03,054: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:21:05.493730527Z [2024-02-24 04:21:05,493: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[25ec02b1-3d49-4f7f-9f7f-e36fe47cc690] succeeded in 4.395381554997584s: None
2024-02-24T04:21:05.826868185Z [2024-02-24 04:21:05,826: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5184035b-9868-4e0e-8491-33948e09029e] succeeded in 4.726218088999303s: None
2024-02-24T04:22:01.023675532Z [2024-02-24 04:22:01,023: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[93398e57-c8c4-4092-ac6b-e526bf72d895] received
2024-02-24T04:22:01.033000829Z [2024-02-24 04:22:01,032: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aeb2f7fc-7556-46f8-a8cd-4ccad235251d] received
2024-02-24T04:22:01.036960795Z [2024-02-24 04:22:01,036: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[30b5cf14-0aba-4e24-9838-b8ada9c7f60a] received
2024-02-24T04:22:01.042476240Z [2024-02-24 04:22:01,042: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c58e4c3c-d27c-4923-9de6-0ec075249623] received
2024-02-24T04:22:01.050807986Z [2024-02-24 04:22:01,050: INFO/ForkPoolWorker-15] [93398e57-c8c4-4092-ac6b-e526bf72d895] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:22:01.060854371Z [2024-02-24 04:22:01,060: INFO/ForkPoolWorker-1] [30b5cf14-0aba-4e24-9838-b8ada9c7f60a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:22:01.064640407Z [2024-02-24 04:22:01,061: INFO/ForkPoolWorker-2] [c58e4c3c-d27c-4923-9de6-0ec075249623] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:21:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:22:01.065626105Z [2024-02-24 04:22:01,065: INFO/ForkPoolWorker-16] [aeb2f7fc-7556-46f8-a8cd-4ccad235251d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:22:01.423882826Z [2024-02-24 04:22:01,420: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:22:01.465644531Z [2024-02-24 04:22:01,462: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:22:01.519846460Z [2024-02-24 04:22:01,516: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:22:01.586123451Z [2024-02-24 04:22:01,582: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:22:01.624506128Z [2024-02-24 04:22:01,624: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:22:01.628338367Z [2024-02-24 04:22:01,627: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:22:01.658286010Z [2024-02-24 04:22:01,658: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:22:01.663298941Z [2024-02-24 04:22:01,663: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:22:01.663370154Z [2024-02-24 04:22:01,663: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:22:01.663436937Z [2024-02-24 04:22:01,663: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:22:01.663789079Z [2024-02-24 04:22:01,663: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:22:01.753974917Z [2024-02-24 04:22:01,753: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:22:01.799468965Z [2024-02-24 04:22:01,799: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:22:02.418341588Z [2024-02-24 04:22:02,415: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aeb2f7fc-7556-46f8-a8cd-4ccad235251d] succeeded in 1.3804794490024506s: None
2024-02-24T04:22:02.429876569Z [2024-02-24 04:22:02,429: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[c58e4c3c-d27c-4923-9de6-0ec075249623] succeeded in 1.385170831999858s: None
2024-02-24T04:22:02.962776428Z [2024-02-24 04:22:02,962: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:22:02.966784075Z [2024-02-24 04:22:02,966: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:22:02.990718873Z [2024-02-24 04:22:02,990: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:22:02.992092196Z [2024-02-24 04:22:02,991: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:22:02.992120689Z [2024-02-24 04:22:02,992: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:22:02.992271066Z [2024-02-24 04:22:02,992: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:22:02.992288326Z [2024-02-24 04:22:02,992: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:22:02.992563796Z [2024-02-24 04:22:02,992: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:22:02.992583863Z [2024-02-24 04:22:02,992: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:22:03.085605059Z [2024-02-24 04:22:03,085: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:22:03.157746385Z [2024-02-24 04:22:03,157: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:22:03.161336919Z [2024-02-24 04:22:03,160: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:22:03.186990221Z [2024-02-24 04:22:03,186: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:22:03.190848336Z [2024-02-24 04:22:03,190: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:22:03.190877224Z [2024-02-24 04:22:03,190: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:22:03.190894769Z [2024-02-24 04:22:03,190: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:22:03.190936378Z [2024-02-24 04:22:03,190: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:22:03.191235349Z [2024-02-24 04:22:03,191: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:22:03.191244454Z [2024-02-24 04:22:03,191: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:22:03.286423261Z [2024-02-24 04:22:03,286: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:21:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:22:05.685093956Z [2024-02-24 04:22:05,684: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[30b5cf14-0aba-4e24-9838-b8ada9c7f60a] succeeded in 4.640217846001178s: None
2024-02-24T04:22:06.087265336Z [2024-02-24 04:22:06,086: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[93398e57-c8c4-4092-ac6b-e526bf72d895] succeeded in 5.061409937999997s: None
2024-02-24T04:23:00.980126860Z [2024-02-24 04:23:00,979: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[20267c4d-380e-4de1-8d5d-6d051614db21] received
2024-02-24T04:23:00.984249127Z [2024-02-24 04:23:00,983: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aea357a0-7df4-4d8d-8cf2-ddbd59d347ce] received
2024-02-24T04:23:00.994036625Z [2024-02-24 04:23:00,993: INFO/ForkPoolWorker-15] [20267c4d-380e-4de1-8d5d-6d051614db21] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:23:00.999682548Z [2024-02-24 04:23:00,999: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec5d435b-1f8f-4e21-a83f-c5219662e424] received
2024-02-24T04:23:01.010482417Z [2024-02-24 04:23:01,010: INFO/ForkPoolWorker-1] [ec5d435b-1f8f-4e21-a83f-c5219662e424] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:23:01.013826651Z [2024-02-24 04:23:01,013: INFO/ForkPoolWorker-16] [aea357a0-7df4-4d8d-8cf2-ddbd59d347ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:23:01.388954879Z [2024-02-24 04:23:01,385: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:23:01.420768181Z [2024-02-24 04:23:01,417: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:23:01.431885979Z [2024-02-24 04:23:01,428: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:23:01.606666158Z [2024-02-24 04:23:01,606: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T04:23:01.615543018Z [2024-02-24 04:23:01,614: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:23:01.688910856Z [2024-02-24 04:23:01,688: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:23:01.694892035Z [2024-02-24 04:23:01,694: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:23:01.695138989Z [2024-02-24 04:23:01,694: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:23:01.695259934Z [2024-02-24 04:23:01,695: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T04:23:01.695608815Z [2024-02-24 04:23:01,695: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:23:01.819228584Z [2024-02-24 04:23:01,818: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:23:02.589262951Z [2024-02-24 04:23:02,588: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[20267c4d-380e-4de1-8d5d-6d051614db21] succeeded in 1.603092741999717s: None
2024-02-24T04:23:02.684103268Z [2024-02-24 04:23:02,682: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:23:02.690170481Z [2024-02-24 04:23:02,688: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:23:02.748423469Z [2024-02-24 04:23:02,745: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:23:02.764181342Z [2024-02-24 04:23:02,756: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:23:02.764205668Z [2024-02-24 04:23:02,756: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:23:02.764210046Z [2024-02-24 04:23:02,756: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:23:02.764213963Z [2024-02-24 04:23:02,757: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:23:02.764217079Z [2024-02-24 04:23:02,757: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:23:02.764220760Z [2024-02-24 04:23:02,757: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:23:02.850361427Z [2024-02-24 04:23:02,849: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:23:02.853587456Z [2024-02-24 04:23:02,853: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:23:02.872266379Z [2024-02-24 04:23:02,872: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:23:02.873627281Z [2024-02-24 04:23:02,873: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:23:02.873645053Z [2024-02-24 04:23:02,873: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:23:02.873822208Z [2024-02-24 04:23:02,873: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:23:02.873888946Z [2024-02-24 04:23:02,873: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:23:02.874292336Z [2024-02-24 04:23:02,874: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:23:02.874327347Z [2024-02-24 04:23:02,874: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:23:02.903318724Z [2024-02-24 04:23:02,902: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:23:02.957742949Z [2024-02-24 04:23:02,957: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:23:05.019992752Z [2024-02-24 04:23:05,019: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ec5d435b-1f8f-4e21-a83f-c5219662e424] succeeded in 4.016901943999983s: None
2024-02-24T04:23:05.282670730Z [2024-02-24 04:23:05,282: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aea357a0-7df4-4d8d-8cf2-ddbd59d347ce] succeeded in 4.28789025900187s: None
2024-02-24T04:24:00.821128860Z [2024-02-24 04:24:00,820: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0237d440-cae2-4b8e-9904-f44945301c10] received
2024-02-24T04:24:00.829431689Z [2024-02-24 04:24:00,828: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a3db0d72-f0c4-4420-a1d8-949fd9652bdd] received
2024-02-24T04:24:00.836624979Z [2024-02-24 04:24:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2a111b70-7c73-46e4-81bc-7a2e83669be1] received
2024-02-24T04:24:00.837584724Z [2024-02-24 04:24:00,837: INFO/ForkPoolWorker-15] [0237d440-cae2-4b8e-9904-f44945301c10] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:22:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:24:00.846138065Z [2024-02-24 04:24:00,845: INFO/ForkPoolWorker-1] [2a111b70-7c73-46e4-81bc-7a2e83669be1] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:24:00.848091284Z [2024-02-24 04:24:00,847: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f1564d5d-0ea4-47da-b90b-1c91b7720acb] received
2024-02-24T04:24:00.848727011Z [2024-02-24 04:24:00,848: INFO/ForkPoolWorker-16] [a3db0d72-f0c4-4420-a1d8-949fd9652bdd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:24:00.859209409Z [2024-02-24 04:24:00,858: INFO/ForkPoolWorker-2] [f1564d5d-0ea4-47da-b90b-1c91b7720acb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:23:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:24:01.187212804Z [2024-02-24 04:24:01,184: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:24:01.250964241Z [2024-02-24 04:24:01,232: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:24:01.280650390Z [2024-02-24 04:24:01,275: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:24:01.365598612Z [2024-02-24 04:24:01,362: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:24:01.528281626Z [2024-02-24 04:24:01,527: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:24:01.532101303Z [2024-02-24 04:24:01,531: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:24:01.574460283Z [2024-02-24 04:24:01,574: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:24:01.575866723Z [2024-02-24 04:24:01,575: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:24:01.576037387Z [2024-02-24 04:24:01,575: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:24:01.576094895Z [2024-02-24 04:24:01,576: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:24:01.576338608Z [2024-02-24 04:24:01,576: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:24:01.585083258Z [2024-02-24 04:24:01,584: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:22:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:24:01.674645639Z [2024-02-24 04:24:01,674: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:24:02.140191077Z [2024-02-24 04:24:02,139: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0237d440-cae2-4b8e-9904-f44945301c10] succeeded in 1.3172819739993429s: None
2024-02-24T04:24:02.320852152Z [2024-02-24 04:24:02,320: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[f1564d5d-0ea4-47da-b90b-1c91b7720acb] succeeded in 1.4711018679990957s: None
2024-02-24T04:24:02.467027638Z [2024-02-24 04:24:02,466: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:24:02.470312302Z [2024-02-24 04:24:02,469: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:24:02.497886842Z [2024-02-24 04:24:02,497: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:24:02.501110650Z [2024-02-24 04:24:02,500: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:24:02.501317847Z [2024-02-24 04:24:02,501: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:24:02.501602300Z [2024-02-24 04:24:02,501: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:24:02.501803097Z [2024-02-24 04:24:02,501: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:24:02.502293147Z [2024-02-24 04:24:02,502: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:24:02.502480400Z [2024-02-24 04:24:02,502: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:24:02.630226272Z [2024-02-24 04:24:02,629: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:24:02.647871833Z [2024-02-24 04:24:02,645: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:24:02.676722569Z [2024-02-24 04:24:02,675: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:24:02.746812975Z [2024-02-24 04:24:02,746: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:24:02.748501069Z [2024-02-24 04:24:02,748: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:24:02.748818288Z [2024-02-24 04:24:02,748: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:24:02.749229140Z [2024-02-24 04:24:02,748: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:24:02.749432509Z [2024-02-24 04:24:02,749: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:24:02.749827201Z [2024-02-24 04:24:02,749: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:24:02.751263012Z [2024-02-24 04:24:02,751: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:24:02.859075833Z [2024-02-24 04:24:02,858: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:23:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:24:04.251716176Z [2024-02-24 04:24:04,250: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2a111b70-7c73-46e4-81bc-7a2e83669be1] succeeded in 3.4116868050004996s: None
2024-02-24T04:24:05.121727932Z [2024-02-24 04:24:05,121: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a3db0d72-f0c4-4420-a1d8-949fd9652bdd] succeeded in 4.281543117998808s: None
2024-02-24T04:25:01.232346799Z [2024-02-24 04:25:01,225: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fede213e-d5dc-48f1-8bba-0b38003dd728] received
2024-02-24T04:25:01.232381589Z [2024-02-24 04:25:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d403afd9-d152-4207-8c21-c35e9929a47c] received
2024-02-24T04:25:01.236943825Z [2024-02-24 04:25:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a7eb3b57-2cd6-4b1d-8c81-6ad10a60bf53] received
2024-02-24T04:25:01.239963530Z [2024-02-24 04:25:01,237: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8485ace0-b6bf-4623-898c-0caaf2703501] received
2024-02-24T04:25:01.261024550Z [2024-02-24 04:25:01,260: INFO/ForkPoolWorker-2] [8485ace0-b6bf-4623-898c-0caaf2703501] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:25:01.282089126Z [2024-02-24 04:25:01,263: INFO/ForkPoolWorker-15] [fede213e-d5dc-48f1-8bba-0b38003dd728] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:25:01.282110938Z [2024-02-24 04:25:01,269: INFO/ForkPoolWorker-16] [d403afd9-d152-4207-8c21-c35e9929a47c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:25:01.288681017Z [2024-02-24 04:25:01,286: INFO/ForkPoolWorker-1] [a7eb3b57-2cd6-4b1d-8c81-6ad10a60bf53] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:25:01.731657859Z [2024-02-24 04:25:01,720: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:25:01.899165562Z [2024-02-24 04:25:01,890: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:25:01.937601034Z [2024-02-24 04:25:01,934: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:25:02.123542180Z [2024-02-24 04:25:02,123: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:25:02.135198797Z [2024-02-24 04:25:02,134: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:02.139716011Z [2024-02-24 04:25:02,135: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:25:02.193092463Z [2024-02-24 04:25:02,192: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:25:02.195464547Z [2024-02-24 04:25:02,195: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:25:02.195743988Z [2024-02-24 04:25:02,195: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:25:02.195883759Z [2024-02-24 04:25:02,195: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:25:02.196178338Z [2024-02-24 04:25:02,196: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:25:02.342825459Z [2024-02-24 04:25:02,342: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:03.294934989Z [2024-02-24 04:25:03,294: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a7eb3b57-2cd6-4b1d-8c81-6ad10a60bf53] succeeded in 2.058994373001042s: None
2024-02-24T04:25:04.151357240Z [2024-02-24 04:25:04,150: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:25:04.163379968Z [2024-02-24 04:25:04,162: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:04.179703714Z [2024-02-24 04:25:04,179: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:25:04.183096082Z [2024-02-24 04:25:04,182: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:04.205627762Z [2024-02-24 04:25:04,205: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:25:04.207124943Z [2024-02-24 04:25:04,206: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:04.207266511Z [2024-02-24 04:25:04,207: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:04.207423024Z [2024-02-24 04:25:04,207: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:04.207498403Z [2024-02-24 04:25:04,207: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:25:04.207809692Z [2024-02-24 04:25:04,207: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:25:04.207913838Z [2024-02-24 04:25:04,207: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:04.222681620Z [2024-02-24 04:25:04,222: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:25:04.224047163Z [2024-02-24 04:25:04,223: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:04.224148777Z [2024-02-24 04:25:04,224: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:04.224317054Z [2024-02-24 04:25:04,224: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:04.224426844Z [2024-02-24 04:25:04,224: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:25:04.225187193Z [2024-02-24 04:25:04,224: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:25:04.225396747Z [2024-02-24 04:25:04,225: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:04.328010714Z [2024-02-24 04:25:04,327: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:04.356190487Z [2024-02-24 04:25:04,355: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:04.472761418Z [2024-02-24 04:25:04,472: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:25:04.476322796Z [2024-02-24 04:25:04,475: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:04.523262705Z [2024-02-24 04:25:04,523: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:25:04.526996854Z [2024-02-24 04:25:04,526: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:04.527456276Z [2024-02-24 04:25:04,527: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:04.527470768Z [2024-02-24 04:25:04,527: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:04.527594205Z [2024-02-24 04:25:04,527: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:25:04.527934677Z [2024-02-24 04:25:04,527: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:25:04.527954046Z [2024-02-24 04:25:04,527: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:04.639332111Z [2024-02-24 04:25:04,639: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:05.142943872Z [2024-02-24 04:25:05,142: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fede213e-d5dc-48f1-8bba-0b38003dd728] succeeded in 3.9110564709990285s: None
2024-02-24T04:25:06.150872764Z [2024-02-24 04:25:06,150: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8b94c1aa-d636-48cf-b0ad-cef6d4e3b098] received
2024-02-24T04:25:06.159788189Z [2024-02-24 04:25:06,159: INFO/ForkPoolWorker-15] [8b94c1aa-d636-48cf-b0ad-cef6d4e3b098] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:25:06.171203298Z [2024-02-24 04:25:06,170: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d403afd9-d152-4207-8c21-c35e9929a47c] succeeded in 4.939080735999596s: None
2024-02-24T04:25:06.453146712Z [2024-02-24 04:25:06,449: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:25:07.650435831Z [2024-02-24 04:25:07,649: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:25:07.653680147Z [2024-02-24 04:25:07,653: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:07.682225980Z [2024-02-24 04:25:07,677: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:25:07.684498925Z [2024-02-24 04:25:07,684: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:07.684649443Z [2024-02-24 04:25:07,684: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:07.684962018Z [2024-02-24 04:25:07,684: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:07.685134824Z [2024-02-24 04:25:07,684: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:25:07.686173050Z [2024-02-24 04:25:07,685: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:25:07.686420482Z [2024-02-24 04:25:07,686: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:07.772597707Z [2024-02-24 04:25:07,772: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:08.149552139Z [2024-02-24 04:25:08,149: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[8485ace0-b6bf-4623-898c-0caaf2703501] succeeded in 6.910479251997458s: None
2024-02-24T04:25:08.460411967Z [2024-02-24 04:25:08,459: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[8b94c1aa-d636-48cf-b0ad-cef6d4e3b098] succeeded in 2.3069773230017745s: None
2024-02-24T04:25:08.754122854Z [2024-02-24 04:25:08,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec6f4d76-6fa8-418b-92f1-ba660c9885ea] received
2024-02-24T04:25:08.765044762Z [2024-02-24 04:25:08,764: INFO/ForkPoolWorker-15] [ec6f4d76-6fa8-418b-92f1-ba660c9885ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:25:09.038370037Z [2024-02-24 04:25:09,034: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:25:10.134065430Z [2024-02-24 04:25:10,133: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:25:10.137259364Z [2024-02-24 04:25:10,136: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:10.160966516Z [2024-02-24 04:25:10,160: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:25:10.163675004Z [2024-02-24 04:25:10,163: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:10.163904978Z [2024-02-24 04:25:10,163: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:10.164293912Z [2024-02-24 04:25:10,163: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:10.164432533Z [2024-02-24 04:25:10,164: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:25:10.164892096Z [2024-02-24 04:25:10,164: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:25:10.165013776Z [2024-02-24 04:25:10,164: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:10.247350620Z [2024-02-24 04:25:10,247: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:20:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:10.739471006Z [2024-02-24 04:25:10,737: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ec6f4d76-6fa8-418b-92f1-ba660c9885ea] succeeded in 1.9824951650007279s: None
2024-02-24T04:25:11.115682750Z [2024-02-24 04:25:11,114: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a4cc0824-f00b-42f3-be02-b0a0686e0596] received
2024-02-24T04:25:11.127139457Z [2024-02-24 04:25:11,126: INFO/ForkPoolWorker-15] [a4cc0824-f00b-42f3-be02-b0a0686e0596] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:20:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:25:11.434238261Z [2024-02-24 04:25:11,430: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:25:12.635736942Z [2024-02-24 04:25:12,635: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:25:12.639678434Z [2024-02-24 04:25:12,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:25:12.733625234Z [2024-02-24 04:25:12,732: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:25:12.735931046Z [2024-02-24 04:25:12,735: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:25:12.736444902Z [2024-02-24 04:25:12,736: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:25:12.736755957Z [2024-02-24 04:25:12,736: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:25:12.736948868Z [2024-02-24 04:25:12,736: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:25:12.737460017Z [2024-02-24 04:25:12,737: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:25:12.737651190Z [2024-02-24 04:25:12,737: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:25:12.828444886Z [2024-02-24 04:25:12,828: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:20:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:13.459564727Z [2024-02-24 04:25:13,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[a4cc0824-f00b-42f3-be02-b0a0686e0596] succeeded in 2.339752902997134s: None
2024-02-24T04:25:38.155422294Z [2024-02-24 04:25:38,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[65041a03-3996-4b94-91d5-4d1e3af0cf21] received
2024-02-24T04:25:38.168706764Z [2024-02-24 04:25:38,168: INFO/ForkPoolWorker-15] [65041a03-3996-4b94-91d5-4d1e3af0cf21] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224042537_564072', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:25:38.427227730Z [2024-02-24 04:25:38,424: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:25:38.721907659Z [2024-02-24 04:25:38,721: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224042537_564072 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:25:39.330419083Z [2024-02-24 04:25:39,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[65041a03-3996-4b94-91d5-4d1e3af0cf21] succeeded in 1.1730214939998405s: None
2024-02-24T04:26:00.455094691Z [2024-02-24 04:26:00,454: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[411c6c55-b34f-4b09-afd8-b28aea32823a] received
2024-02-24T04:26:00.458948547Z [2024-02-24 04:26:00,458: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5a64fa56-5c38-419c-8640-c691cc19da83] received
2024-02-24T04:26:00.463304095Z [2024-02-24 04:26:00,463: INFO/ForkPoolWorker-15] [411c6c55-b34f-4b09-afd8-b28aea32823a] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:24:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:26:00.469764739Z [2024-02-24 04:26:00,469: INFO/ForkPoolWorker-16] [5a64fa56-5c38-419c-8640-c691cc19da83] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:26:00.469999964Z [2024-02-24 04:26:00,469: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae8862a6-f3fe-4733-806a-8c2be6661ee4] received
2024-02-24T04:26:00.473234548Z [2024-02-24 04:26:00,472: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9916861f-aa88-4cf6-b36a-852297799d84] received
2024-02-24T04:26:00.479490691Z [2024-02-24 04:26:00,479: INFO/ForkPoolWorker-1] [ae8862a6-f3fe-4733-806a-8c2be6661ee4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:26:00.486157405Z [2024-02-24 04:26:00,485: INFO/ForkPoolWorker-2] [9916861f-aa88-4cf6-b36a-852297799d84] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:26:00.798439115Z [2024-02-24 04:26:00,795: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:26:00.802576113Z [2024-02-24 04:26:00,799: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:26:00.836126471Z [2024-02-24 04:26:00,829: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:26:00.928058812Z [2024-02-24 04:26:00,924: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:26:01.009533536Z [2024-02-24 04:26:01,009: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:26:01.013643147Z [2024-02-24 04:26:01,013: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:26:01.048007537Z [2024-02-24 04:26:01,047: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:26:01.050958838Z [2024-02-24 04:26:01,050: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:26:01.052021416Z [2024-02-24 04:26:01,050: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:26:01.052176639Z [2024-02-24 04:26:01,051: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:26:01.052458295Z [2024-02-24 04:26:01,052: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:26:01.110946687Z [2024-02-24 04:26:01,110: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:24:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:26:01.145296775Z [2024-02-24 04:26:01,145: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:26:01.864836386Z [2024-02-24 04:26:01,864: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9916861f-aa88-4cf6-b36a-852297799d84] succeeded in 1.3889471629991021s: None
2024-02-24T04:26:01.881157628Z [2024-02-24 04:26:01,880: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[411c6c55-b34f-4b09-afd8-b28aea32823a] succeeded in 1.4244290599999658s: None
2024-02-24T04:26:02.143319213Z [2024-02-24 04:26:02,142: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:26:02.146821508Z [2024-02-24 04:26:02,146: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:26:02.180208783Z [2024-02-24 04:26:02,179: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:26:02.181712295Z [2024-02-24 04:26:02,181: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:26:02.181857563Z [2024-02-24 04:26:02,181: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:26:02.182057429Z [2024-02-24 04:26:02,181: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:26:02.182202641Z [2024-02-24 04:26:02,182: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:26:02.182493098Z [2024-02-24 04:26:02,182: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:26:02.182615818Z [2024-02-24 04:26:02,182: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:26:02.290478762Z [2024-02-24 04:26:02,290: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:26:02.526913068Z [2024-02-24 04:26:02,526: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:26:02.530995224Z [2024-02-24 04:26:02,530: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:26:02.551916375Z [2024-02-24 04:26:02,551: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:26:02.554938847Z [2024-02-24 04:26:02,554: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:26:02.555096693Z [2024-02-24 04:26:02,554: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:26:02.555410194Z [2024-02-24 04:26:02,555: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:26:02.555552673Z [2024-02-24 04:26:02,555: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:26:02.556088190Z [2024-02-24 04:26:02,555: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:26:02.556260053Z [2024-02-24 04:26:02,556: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:26:02.751919230Z [2024-02-24 04:26:02,751: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:26:05.271336899Z [2024-02-24 04:26:05,270: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5a64fa56-5c38-419c-8640-c691cc19da83] succeeded in 4.808585835999111s: None
2024-02-24T04:26:06.315783224Z [2024-02-24 04:26:06,315: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ae8862a6-f3fe-4733-806a-8c2be6661ee4] succeeded in 5.8435510259987495s: None
2024-02-24T04:27:00.845165508Z [2024-02-24 04:27:00,844: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9fea0975-f5fe-4961-a1b5-843ce49eec31] received
2024-02-24T04:27:00.854023768Z [2024-02-24 04:27:00,853: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9ba7c178-3bf8-410d-8a42-a4ce3184e62a] received
2024-02-24T04:27:00.856532576Z [2024-02-24 04:27:00,856: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b40f0a28-4ad8-4852-84c0-5ec3cc857494] received
2024-02-24T04:27:00.863681285Z [2024-02-24 04:27:00,863: INFO/ForkPoolWorker-15] [9fea0975-f5fe-4961-a1b5-843ce49eec31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:27:00.864207198Z [2024-02-24 04:27:00,863: INFO/ForkPoolWorker-1] [b40f0a28-4ad8-4852-84c0-5ec3cc857494] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:27:00.865377138Z [2024-02-24 04:27:00,865: INFO/ForkPoolWorker-16] [9ba7c178-3bf8-410d-8a42-a4ce3184e62a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:27:01.192394765Z [2024-02-24 04:27:01,181: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:27:01.198614113Z [2024-02-24 04:27:01,195: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:27:01.199263860Z [2024-02-24 04:27:01,195: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:27:01.423598967Z [2024-02-24 04:27:01,423: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:27:01.427595226Z [2024-02-24 04:27:01,427: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:27:01.453978096Z [2024-02-24 04:27:01,453: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:27:01.455122218Z [2024-02-24 04:27:01,454: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:27:01.455159023Z [2024-02-24 04:27:01,455: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:27:01.455239174Z [2024-02-24 04:27:01,455: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:27:01.455394633Z [2024-02-24 04:27:01,455: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:27:01.571071513Z [2024-02-24 04:27:01,570: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:27:02.209853703Z [2024-02-24 04:27:02,209: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b40f0a28-4ad8-4852-84c0-5ec3cc857494] succeeded in 1.351827893002337s: None
2024-02-24T04:27:02.415258951Z [2024-02-24 04:27:02,414: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:27:02.427953257Z [2024-02-24 04:27:02,421: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:27:02.468414676Z [2024-02-24 04:27:02,468: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:27:02.470794613Z [2024-02-24 04:27:02,470: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:27:02.471069110Z [2024-02-24 04:27:02,470: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:27:02.471939789Z [2024-02-24 04:27:02,471: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:27:02.472054222Z [2024-02-24 04:27:02,471: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:27:02.472262761Z [2024-02-24 04:27:02,471: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:27:02.472519887Z [2024-02-24 04:27:02,472: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:27:02.472746707Z [2024-02-24 04:27:02,472: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:27:02.475714856Z [2024-02-24 04:27:02,475: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:27:02.505615680Z [2024-02-24 04:27:02,505: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:27:02.509649618Z [2024-02-24 04:27:02,509: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:27:02.509697462Z [2024-02-24 04:27:02,509: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:27:02.509937393Z [2024-02-24 04:27:02,509: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:27:02.509954919Z [2024-02-24 04:27:02,509: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:27:02.510335703Z [2024-02-24 04:27:02,510: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:27:02.510352260Z [2024-02-24 04:27:02,510: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:27:02.599110073Z [2024-02-24 04:27:02,598: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:27:02.632990731Z [2024-02-24 04:27:02,632: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:27:04.211732860Z [2024-02-24 04:27:04,211: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9ba7c178-3bf8-410d-8a42-a4ce3184e62a] succeeded in 3.3554401170003985s: None
2024-02-24T04:27:04.825731785Z [2024-02-24 04:27:04,825: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9fea0975-f5fe-4961-a1b5-843ce49eec31] succeeded in 3.9763237750012195s: None
2024-02-24T04:28:00.658953424Z [2024-02-24 04:28:00,658: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8d4c3b5-a59c-4fb5-95ef-c2708a1f1f24] received
2024-02-24T04:28:00.661859928Z [2024-02-24 04:28:00,661: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[075c26d0-4983-493c-8bb4-dd2b32fe1b1e] received
2024-02-24T04:28:00.670787707Z [2024-02-24 04:28:00,670: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[46f0df2c-8d2b-4130-9591-70c918663b41] received
2024-02-24T04:28:00.674074878Z [2024-02-24 04:28:00,673: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0e0b856f-2b63-4781-b5af-0a51046b88bc] received
2024-02-24T04:28:00.675820450Z [2024-02-24 04:28:00,675: INFO/ForkPoolWorker-15] [e8d4c3b5-a59c-4fb5-95ef-c2708a1f1f24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:28:00.680289006Z [2024-02-24 04:28:00,680: INFO/ForkPoolWorker-16] [075c26d0-4983-493c-8bb4-dd2b32fe1b1e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:26:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:28:00.682934628Z [2024-02-24 04:28:00,681: INFO/ForkPoolWorker-2] [0e0b856f-2b63-4781-b5af-0a51046b88bc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:28:00.683577491Z [2024-02-24 04:28:00,682: INFO/ForkPoolWorker-1] [46f0df2c-8d2b-4130-9591-70c918663b41] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:27:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:28:01.014059276Z [2024-02-24 04:28:01,010: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:28:01.058857764Z [2024-02-24 04:28:01,055: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:28:01.097222506Z [2024-02-24 04:28:01,094: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:28:01.179988624Z [2024-02-24 04:28:01,176: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:28:01.392699380Z [2024-02-24 04:28:01,392: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:28:01.396704765Z [2024-02-24 04:28:01,396: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:28:01.423818447Z [2024-02-24 04:28:01,423: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:28:01.425028191Z [2024-02-24 04:28:01,424: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:28:01.425194364Z [2024-02-24 04:28:01,425: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:28:01.425306766Z [2024-02-24 04:28:01,425: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:28:01.425620990Z [2024-02-24 04:28:01,425: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:28:01.503330155Z [2024-02-24 04:28:01,502: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:26:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:28:01.534099796Z [2024-02-24 04:28:01,533: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:28:02.020268002Z [2024-02-24 04:28:02,019: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[075c26d0-4983-493c-8bb4-dd2b32fe1b1e] succeeded in 1.3566414910019375s: None
2024-02-24T04:28:02.229071397Z [2024-02-24 04:28:02,228: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[46f0df2c-8d2b-4130-9591-70c918663b41] succeeded in 1.5552719570005138s: None
2024-02-24T04:28:02.468307193Z [2024-02-24 04:28:02,467: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:28:02.471935897Z [2024-02-24 04:28:02,471: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:28:02.498777704Z [2024-02-24 04:28:02,498: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:28:02.500545692Z [2024-02-24 04:28:02,500: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:28:02.500743311Z [2024-02-24 04:28:02,500: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:28:02.500962954Z [2024-02-24 04:28:02,500: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:28:02.501080356Z [2024-02-24 04:28:02,500: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:28:02.502038836Z [2024-02-24 04:28:02,501: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:28:02.502154808Z [2024-02-24 04:28:02,502: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:28:02.514691883Z [2024-02-24 04:28:02,514: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:28:02.518111007Z [2024-02-24 04:28:02,517: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:28:02.538767999Z [2024-02-24 04:28:02,538: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:28:02.540148699Z [2024-02-24 04:28:02,539: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:28:02.540274161Z [2024-02-24 04:28:02,540: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:28:02.540458222Z [2024-02-24 04:28:02,540: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:28:02.540530142Z [2024-02-24 04:28:02,540: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:28:02.540859157Z [2024-02-24 04:28:02,540: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:28:02.540972974Z [2024-02-24 04:28:02,540: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:28:02.598863413Z [2024-02-24 04:28:02,598: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:28:02.623616444Z [2024-02-24 04:28:02,623: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:27:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:28:04.878328167Z [2024-02-24 04:28:04,877: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e8d4c3b5-a59c-4fb5-95ef-c2708a1f1f24] succeeded in 4.214184263000789s: None
2024-02-24T04:28:05.728858183Z [2024-02-24 04:28:05,728: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[0e0b856f-2b63-4781-b5af-0a51046b88bc] succeeded in 5.053296916998079s: None
2024-02-24T04:29:00.646578139Z [2024-02-24 04:29:00,646: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54e1f686-36fd-4a2f-b6ef-b53db06aef13] received
2024-02-24T04:29:00.655208720Z [2024-02-24 04:29:00,654: INFO/ForkPoolWorker-15] [54e1f686-36fd-4a2f-b6ef-b53db06aef13] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:29:00.655559795Z [2024-02-24 04:29:00,655: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a923b4ee-471c-4fd9-a537-0f69ca8582e6] received
2024-02-24T04:29:00.657635790Z [2024-02-24 04:29:00,657: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[89aba043-4cf9-446e-b8c7-01ab32783597] received
2024-02-24T04:29:00.663794479Z [2024-02-24 04:29:00,663: INFO/ForkPoolWorker-16] [a923b4ee-471c-4fd9-a537-0f69ca8582e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:29:00.673636707Z [2024-02-24 04:29:00,673: INFO/ForkPoolWorker-1] [89aba043-4cf9-446e-b8c7-01ab32783597] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:29:01.021694384Z [2024-02-24 04:29:01,018: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:29:01.063965463Z [2024-02-24 04:29:01,060: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:29:01.087005679Z [2024-02-24 04:29:01,083: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:29:01.221692853Z [2024-02-24 04:29:01,221: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:29:01.233871345Z [2024-02-24 04:29:01,230: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:29:01.314796735Z [2024-02-24 04:29:01,314: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:29:01.316080531Z [2024-02-24 04:29:01,315: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:29:01.316116974Z [2024-02-24 04:29:01,316: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:29:01.316184761Z [2024-02-24 04:29:01,316: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:29:01.316370895Z [2024-02-24 04:29:01,316: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:29:01.425006373Z [2024-02-24 04:29:01,424: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:29:02.034141884Z [2024-02-24 04:29:02,033: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[89aba043-4cf9-446e-b8c7-01ab32783597] succeeded in 1.373856895002973s: None
2024-02-24T04:29:02.279831814Z [2024-02-24 04:29:02,279: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:29:02.283112960Z [2024-02-24 04:29:02,282: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:29:02.290408683Z [2024-02-24 04:29:02,290: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:29:02.293738210Z [2024-02-24 04:29:02,293: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:29:02.312638651Z [2024-02-24 04:29:02,312: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:29:02.314125428Z [2024-02-24 04:29:02,313: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:29:02.314305162Z [2024-02-24 04:29:02,314: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:29:02.314535968Z [2024-02-24 04:29:02,314: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:29:02.314607100Z [2024-02-24 04:29:02,314: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:29:02.314952938Z [2024-02-24 04:29:02,314: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:29:02.315096791Z [2024-02-24 04:29:02,314: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:29:02.327258774Z [2024-02-24 04:29:02,327: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:29:02.328527691Z [2024-02-24 04:29:02,328: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:29:02.328581587Z [2024-02-24 04:29:02,328: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:29:02.328724901Z [2024-02-24 04:29:02,328: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:29:02.328766716Z [2024-02-24 04:29:02,328: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:29:02.329027178Z [2024-02-24 04:29:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:29:02.329133439Z [2024-02-24 04:29:02,329: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:29:02.429056289Z [2024-02-24 04:29:02,428: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:29:02.429756921Z [2024-02-24 04:29:02,429: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:29:04.194783642Z [2024-02-24 04:29:04,194: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[a923b4ee-471c-4fd9-a537-0f69ca8582e6] succeeded in 3.5376468430004024s: None
2024-02-24T04:29:04.388245331Z [2024-02-24 04:29:04,387: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54e1f686-36fd-4a2f-b6ef-b53db06aef13] succeeded in 3.7387398760001815s: None
2024-02-24T04:30:01.316571078Z [2024-02-24 04:30:01,315: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5ee426f9-5b36-4695-91af-10060aaa7d33] received
2024-02-24T04:30:01.322643206Z [2024-02-24 04:30:01,321: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9b11131c-0fe9-42c9-a141-25111eb77e43] received
2024-02-24T04:30:01.325447318Z [2024-02-24 04:30:01,325: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ffacad1-1e7b-475b-aa05-ce26dccaef2b] received
2024-02-24T04:30:01.326858186Z [2024-02-24 04:30:01,326: INFO/ForkPoolWorker-15] [5ee426f9-5b36-4695-91af-10060aaa7d33] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:30:01.333560046Z [2024-02-24 04:30:01,333: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[86b28799-7778-48a6-8bad-53d2ab1effca] received
2024-02-24T04:30:01.337729938Z [2024-02-24 04:30:01,337: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[490e0f3f-00bf-48f3-a6de-e3ed51f1c44b] received
2024-02-24T04:30:01.348022167Z [2024-02-24 04:30:01,347: INFO/ForkPoolWorker-1] [6ffacad1-1e7b-475b-aa05-ce26dccaef2b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:30:01.354660414Z [2024-02-24 04:30:01,354: INFO/ForkPoolWorker-16] [9b11131c-0fe9-42c9-a141-25111eb77e43] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:29:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:30:01.357505108Z [2024-02-24 04:30:01,357: INFO/ForkPoolWorker-2] [86b28799-7778-48a6-8bad-53d2ab1effca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:30:01.358210667Z [2024-02-24 04:30:01,357: INFO/ForkPoolWorker-3] [490e0f3f-00bf-48f3-a6de-e3ed51f1c44b] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:28:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:30:01.691964043Z [2024-02-24 04:30:01,688: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:30:01.786121164Z [2024-02-24 04:30:01,782: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:30:01.807263633Z [2024-02-24 04:30:01,792: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:30:01.910104287Z [2024-02-24 04:30:01,903: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:30:01.933640339Z [2024-02-24 04:30:01,930: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:30:02.120988745Z [2024-02-24 04:30:02,120: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T04:30:02.124990540Z [2024-02-24 04:30:02,124: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:02.162238296Z [2024-02-24 04:30:02,162: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:30:02.163212488Z [2024-02-24 04:30:02,163: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:30:02.163386713Z [2024-02-24 04:30:02,163: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:30:02.163486506Z [2024-02-24 04:30:02,163: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T04:30:02.163822750Z [2024-02-24 04:30:02,163: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:30:02.293484766Z [2024-02-24 04:30:02,293: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:02.400624097Z [2024-02-24 04:30:02,397: INFO/ForkPoolWorker-3] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:28:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:03.342222601Z [2024-02-24 04:30:03,341: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5ee426f9-5b36-4695-91af-10060aaa7d33] succeeded in 2.0229132079984993s: None
2024-02-24T04:30:03.358024968Z [2024-02-24 04:30:03,357: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[490e0f3f-00bf-48f3-a6de-e3ed51f1c44b] succeeded in 2.0157099420030136s: None
2024-02-24T04:30:03.458917505Z [2024-02-24 04:30:03,458: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:30:03.462113956Z [2024-02-24 04:30:03,461: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:03.489594314Z [2024-02-24 04:30:03,489: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:30:03.491135508Z [2024-02-24 04:30:03,490: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:03.491157640Z [2024-02-24 04:30:03,491: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:03.491306357Z [2024-02-24 04:30:03,491: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:03.491348022Z [2024-02-24 04:30:03,491: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:30:03.491666872Z [2024-02-24 04:30:03,491: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:30:03.491672301Z [2024-02-24 04:30:03,491: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:03.497469296Z [2024-02-24 04:30:03,497: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:30:03.500911388Z [2024-02-24 04:30:03,500: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:03.553257998Z [2024-02-24 04:30:03,552: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:30:03.560103581Z [2024-02-24 04:30:03,559: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:03.560341402Z [2024-02-24 04:30:03,560: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:03.560728307Z [2024-02-24 04:30:03,560: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:03.561115603Z [2024-02-24 04:30:03,560: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:30:03.562253215Z [2024-02-24 04:30:03,561: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:30:03.562694121Z [2024-02-24 04:30:03,562: INFO/ForkPoolWorker-2] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:03.600787092Z [2024-02-24 04:30:03,600: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:03.672527972Z [2024-02-24 04:30:03,672: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:03.827313905Z [2024-02-24 04:30:03,825: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:30:03.830396843Z [2024-02-24 04:30:03,828: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:03.856219386Z [2024-02-24 04:30:03,856: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:30:03.859226914Z [2024-02-24 04:30:03,857: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:03.859249790Z [2024-02-24 04:30:03,857: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:03.859258917Z [2024-02-24 04:30:03,857: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:03.859263117Z [2024-02-24 04:30:03,857: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:30:03.859266376Z [2024-02-24 04:30:03,857: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:30:03.859269483Z [2024-02-24 04:30:03,858: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:03.947016357Z [2024-02-24 04:30:03,946: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:29:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:04.297955386Z [2024-02-24 04:30:04,297: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1e29445b-c540-4634-b110-078122d244da] received
2024-02-24T04:30:04.310181591Z [2024-02-24 04:30:04,309: INFO/ForkPoolWorker-15] [1e29445b-c540-4634-b110-078122d244da] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:30:04.370079369Z [2024-02-24 04:30:04,369: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[86b28799-7778-48a6-8bad-53d2ab1effca] succeeded in 3.0336406140013423s: None
2024-02-24T04:30:04.628148239Z [2024-02-24 04:30:04,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:30:05.220024190Z [2024-02-24 04:30:05,219: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[6ffacad1-1e7b-475b-aa05-ce26dccaef2b] succeeded in 3.8908875980014272s: None
2024-02-24T04:30:05.792907455Z [2024-02-24 04:30:05,792: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:30:05.796176978Z [2024-02-24 04:30:05,795: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:05.820503096Z [2024-02-24 04:30:05,820: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:30:05.823032376Z [2024-02-24 04:30:05,822: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:05.823417471Z [2024-02-24 04:30:05,822: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:05.823881457Z [2024-02-24 04:30:05,823: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:05.824291481Z [2024-02-24 04:30:05,823: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:30:05.825410341Z [2024-02-24 04:30:05,825: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:30:05.825923680Z [2024-02-24 04:30:05,825: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:05.913489407Z [2024-02-24 04:30:05,913: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:06.104481488Z [2024-02-24 04:30:06,103: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9b11131c-0fe9-42c9-a141-25111eb77e43] succeeded in 4.778093313001591s: None
2024-02-24T04:30:06.515648566Z [2024-02-24 04:30:06,514: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[1e29445b-c540-4634-b110-078122d244da] succeeded in 2.2149249629983387s: None
2024-02-24T04:30:06.761500908Z [2024-02-24 04:30:06,761: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d1f50c0-fd8b-4461-9b3d-c54ee0b15a49] received
2024-02-24T04:30:06.769554618Z [2024-02-24 04:30:06,769: INFO/ForkPoolWorker-15] [3d1f50c0-fd8b-4461-9b3d-c54ee0b15a49] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:30:07.123923147Z [2024-02-24 04:30:07,120: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:30:08.292519817Z [2024-02-24 04:30:08,292: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:30:08.295789912Z [2024-02-24 04:30:08,295: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:08.314415596Z [2024-02-24 04:30:08,314: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:30:08.315547926Z [2024-02-24 04:30:08,315: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:08.315576689Z [2024-02-24 04:30:08,315: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:08.315699729Z [2024-02-24 04:30:08,315: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:08.315769752Z [2024-02-24 04:30:08,315: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:30:08.316048624Z [2024-02-24 04:30:08,315: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:30:08.316190633Z [2024-02-24 04:30:08,316: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:08.404123343Z [2024-02-24 04:30:08,403: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:25:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:08.994445725Z [2024-02-24 04:30:08,993: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[3d1f50c0-fd8b-4461-9b3d-c54ee0b15a49] succeeded in 2.230501940000977s: None
2024-02-24T04:30:09.315114032Z [2024-02-24 04:30:09,314: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[39d7bca5-7b7b-4128-b20d-769a71d500ec] received
2024-02-24T04:30:09.322743449Z [2024-02-24 04:30:09,322: INFO/ForkPoolWorker-15] [39d7bca5-7b7b-4128-b20d-769a71d500ec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:25:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:30:09.656796583Z [2024-02-24 04:30:09,653: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:30:10.757568244Z [2024-02-24 04:30:10,757: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:30:10.760683862Z [2024-02-24 04:30:10,760: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:30:10.777497649Z [2024-02-24 04:30:10,777: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:30:10.778821995Z [2024-02-24 04:30:10,778: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:30:10.778881710Z [2024-02-24 04:30:10,778: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:30:10.778931240Z [2024-02-24 04:30:10,778: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:30:10.778948172Z [2024-02-24 04:30:10,778: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:30:10.779282136Z [2024-02-24 04:30:10,779: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:30:10.779291148Z [2024-02-24 04:30:10,779: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:30:10.862133364Z [2024-02-24 04:30:10,861: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:25:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:30:11.448312950Z [2024-02-24 04:30:11,447: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[39d7bca5-7b7b-4128-b20d-769a71d500ec] succeeded in 2.131283024998993s: None
2024-02-24T04:31:00.355450746Z [2024-02-24 04:31:00,355: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f7c68d12-0e59-4bc1-802c-e56a0caeb6ca] received
2024-02-24T04:31:00.362277719Z [2024-02-24 04:31:00,362: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dd875ee3-2217-4bef-a0d4-28cb3cf6e380] received
2024-02-24T04:31:00.366553202Z [2024-02-24 04:31:00,366: INFO/ForkPoolWorker-15] [f7c68d12-0e59-4bc1-802c-e56a0caeb6ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:31:00.371208231Z [2024-02-24 04:31:00,370: INFO/ForkPoolWorker-16] [dd875ee3-2217-4bef-a0d4-28cb3cf6e380] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:31:00.377791387Z [2024-02-24 04:31:00,377: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[27e7b5c1-aa17-41ef-9dda-c3587d455fbb] received
2024-02-24T04:31:00.384709050Z [2024-02-24 04:31:00,384: INFO/ForkPoolWorker-1] [27e7b5c1-aa17-41ef-9dda-c3587d455fbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:31:00.679851719Z [2024-02-24 04:31:00,676: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:31:00.693421242Z [2024-02-24 04:31:00,690: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:31:00.862690347Z [2024-02-24 04:31:00,862: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:31:00.866854494Z [2024-02-24 04:31:00,866: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:31:00.899420181Z [2024-02-24 04:31:00,892: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:31:00.914768251Z [2024-02-24 04:31:00,914: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:31:00.915940101Z [2024-02-24 04:31:00,915: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:31:00.915986430Z [2024-02-24 04:31:00,915: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:31:00.916041850Z [2024-02-24 04:31:00,915: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:31:00.916244376Z [2024-02-24 04:31:00,916: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:31:01.085870303Z [2024-02-24 04:31:01,085: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:31:01.834569914Z [2024-02-24 04:31:01,834: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[27e7b5c1-aa17-41ef-9dda-c3587d455fbb] succeeded in 1.4552299880015198s: None
2024-02-24T04:31:02.118061546Z [2024-02-24 04:31:02,117: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:31:02.121503933Z [2024-02-24 04:31:02,120: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:31:02.156326061Z [2024-02-24 04:31:02,156: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:31:02.158379177Z [2024-02-24 04:31:02,158: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:31:02.158605744Z [2024-02-24 04:31:02,158: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:31:02.158971262Z [2024-02-24 04:31:02,158: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:31:02.159139960Z [2024-02-24 04:31:02,158: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:31:02.159630741Z [2024-02-24 04:31:02,159: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:31:02.159878734Z [2024-02-24 04:31:02,159: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:31:02.255689818Z [2024-02-24 04:31:02,255: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:31:02.333064854Z [2024-02-24 04:31:02,332: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:31:02.336510293Z [2024-02-24 04:31:02,336: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:31:02.361509628Z [2024-02-24 04:31:02,359: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:31:02.362500556Z [2024-02-24 04:31:02,361: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:31:02.362512546Z [2024-02-24 04:31:02,361: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:31:02.362517607Z [2024-02-24 04:31:02,362: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:31:02.362522383Z [2024-02-24 04:31:02,362: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:31:02.362615468Z [2024-02-24 04:31:02,362: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:31:02.363091176Z [2024-02-24 04:31:02,362: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:31:02.482812006Z [2024-02-24 04:31:02,482: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:31:04.202597936Z [2024-02-24 04:31:04,202: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[dd875ee3-2217-4bef-a0d4-28cb3cf6e380] succeeded in 3.838362596998195s: None
2024-02-24T04:31:05.176476047Z [2024-02-24 04:31:05,175: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[f7c68d12-0e59-4bc1-802c-e56a0caeb6ca] succeeded in 4.818452267998509s: None
2024-02-24T04:31:38.683456440Z [2024-02-24 04:31:38,683: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cbfe58b8-4efe-47b5-8b7f-605dc3ce43b3] received
2024-02-24T04:31:38.692936339Z [2024-02-24 04:31:38,692: INFO/ForkPoolWorker-15] [cbfe58b8-4efe-47b5-8b7f-605dc3ce43b3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224043137_479881', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:31:38.972698471Z [2024-02-24 04:31:38,969: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:31:39.273550033Z [2024-02-24 04:31:39,273: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224043137_479881 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:31:39.844473135Z [2024-02-24 04:31:39,843: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cbfe58b8-4efe-47b5-8b7f-605dc3ce43b3] succeeded in 1.1573241829973995s: None
2024-02-24T04:32:01.064066717Z [2024-02-24 04:32:01,063: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[87185fa7-08b6-4d30-9672-58c8c99d4611] received
2024-02-24T04:32:01.068382190Z [2024-02-24 04:32:01,068: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9072d9fb-2a28-4fa0-a49f-9be77d8bdd20] received
2024-02-24T04:32:01.071293742Z [2024-02-24 04:32:01,071: INFO/ForkPoolWorker-15] [87185fa7-08b6-4d30-9672-58c8c99d4611] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:32:01.079431803Z [2024-02-24 04:32:01,079: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a86e6404-f3c9-4d13-b756-38def8525dec] received
2024-02-24T04:32:01.083109385Z [2024-02-24 04:32:01,082: INFO/ForkPoolWorker-16] [9072d9fb-2a28-4fa0-a49f-9be77d8bdd20] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:32:01.087397191Z [2024-02-24 04:32:01,086: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[98fae8c1-9a95-4db7-9d18-2d82536f5c5d] received
2024-02-24T04:32:01.100748113Z [2024-02-24 04:32:01,100: INFO/ForkPoolWorker-2] [98fae8c1-9a95-4db7-9d18-2d82536f5c5d] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:32:01.105650862Z [2024-02-24 04:32:01,104: INFO/ForkPoolWorker-1] [a86e6404-f3c9-4d13-b756-38def8525dec] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:31:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:32:01.482580917Z [2024-02-24 04:32:01,478: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:32:01.486655206Z [2024-02-24 04:32:01,483: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:32:01.587982206Z [2024-02-24 04:32:01,582: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:32:01.628497669Z [2024-02-24 04:32:01,623: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:32:01.649323780Z [2024-02-24 04:32:01,648: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:32:01.653154686Z [2024-02-24 04:32:01,652: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:32:01.682039449Z [2024-02-24 04:32:01,681: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:32:01.683857385Z [2024-02-24 04:32:01,683: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:32:01.684238728Z [2024-02-24 04:32:01,683: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:32:01.684423776Z [2024-02-24 04:32:01,684: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:32:01.685021853Z [2024-02-24 04:32:01,684: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:32:01.805481657Z [2024-02-24 04:32:01,805: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:32:01.808312245Z [2024-02-24 04:32:01,808: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:32:02.473395655Z [2024-02-24 04:32:02,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[87185fa7-08b6-4d30-9672-58c8c99d4611] succeeded in 1.4067061000023386s: None
2024-02-24T04:32:02.495474602Z [2024-02-24 04:32:02,495: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[98fae8c1-9a95-4db7-9d18-2d82536f5c5d] succeeded in 1.4021664159990905s: None
2024-02-24T04:32:03.060584284Z [2024-02-24 04:32:03,060: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:32:03.063808729Z [2024-02-24 04:32:03,063: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:32:03.088170039Z [2024-02-24 04:32:03,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:32:03.091525781Z [2024-02-24 04:32:03,091: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:32:03.091692555Z [2024-02-24 04:32:03,091: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:32:03.091970431Z [2024-02-24 04:32:03,091: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:32:03.092150540Z [2024-02-24 04:32:03,091: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:32:03.092766904Z [2024-02-24 04:32:03,092: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:32:03.093018763Z [2024-02-24 04:32:03,092: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:32:03.139963660Z [2024-02-24 04:32:03,139: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:32:03.143384912Z [2024-02-24 04:32:03,142: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:32:03.172533806Z [2024-02-24 04:32:03,172: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:32:03.174076622Z [2024-02-24 04:32:03,173: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:32:03.174156671Z [2024-02-24 04:32:03,174: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:32:03.174371725Z [2024-02-24 04:32:03,174: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:32:03.174469060Z [2024-02-24 04:32:03,174: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:32:03.174779370Z [2024-02-24 04:32:03,174: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:32:03.174887864Z [2024-02-24 04:32:03,174: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:32:03.207190799Z [2024-02-24 04:32:03,206: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:32:03.287135547Z [2024-02-24 04:32:03,286: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:31:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:32:06.181351722Z [2024-02-24 04:32:06,180: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a86e6404-f3c9-4d13-b756-38def8525dec] succeeded in 5.091202672996587s: None
2024-02-24T04:32:06.601126361Z [2024-02-24 04:32:06,600: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9072d9fb-2a28-4fa0-a49f-9be77d8bdd20] succeeded in 5.52770842999962s: None
2024-02-24T04:33:00.782465961Z [2024-02-24 04:33:00,782: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[916539ba-6315-49d6-8c9d-68ca5f216c31] received
2024-02-24T04:33:00.791835654Z [2024-02-24 04:33:00,791: INFO/ForkPoolWorker-15] [916539ba-6315-49d6-8c9d-68ca5f216c31] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:33:00.796774874Z [2024-02-24 04:33:00,796: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d9f09900-d503-439f-9c70-f9b674db5ca0] received
2024-02-24T04:33:00.808955107Z [2024-02-24 04:33:00,808: INFO/ForkPoolWorker-16] [d9f09900-d503-439f-9c70-f9b674db5ca0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:33:00.835262437Z [2024-02-24 04:33:00,835: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0df568f5-aa1c-44cb-9b7a-e00c4b4a0fd6] received
2024-02-24T04:33:00.873053729Z [2024-02-24 04:33:00,872: INFO/ForkPoolWorker-1] [0df568f5-aa1c-44cb-9b7a-e00c4b4a0fd6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:33:01.126241567Z [2024-02-24 04:33:01,123: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:33:01.261913599Z [2024-02-24 04:33:01,249: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:33:01.401948296Z [2024-02-24 04:33:01,398: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:33:01.600459210Z [2024-02-24 04:33:01,600: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:33:01.605417562Z [2024-02-24 04:33:01,604: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:33:01.652118983Z [2024-02-24 04:33:01,651: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:33:01.655019980Z [2024-02-24 04:33:01,654: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:33:01.655129984Z [2024-02-24 04:33:01,654: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:33:01.655210245Z [2024-02-24 04:33:01,655: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:33:01.655651452Z [2024-02-24 04:33:01,655: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:33:01.822654630Z [2024-02-24 04:33:01,822: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:33:02.780095097Z [2024-02-24 04:33:02,779: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:33:02.801306015Z [2024-02-24 04:33:02,800: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:33:02.869580109Z [2024-02-24 04:33:02,868: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:33:02.871901066Z [2024-02-24 04:33:02,871: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:33:02.871919857Z [2024-02-24 04:33:02,871: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:33:02.871932007Z [2024-02-24 04:33:02,871: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:33:02.871942097Z [2024-02-24 04:33:02,871: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:33:02.872276654Z [2024-02-24 04:33:02,872: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:33:02.872363112Z [2024-02-24 04:33:02,872: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:33:02.880224200Z [2024-02-24 04:33:02,879: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[0df568f5-aa1c-44cb-9b7a-e00c4b4a0fd6] succeeded in 2.0291929699997127s: None
2024-02-24T04:33:02.962945176Z [2024-02-24 04:33:02,962: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:33:03.068122399Z [2024-02-24 04:33:03,067: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:33:03.071353598Z [2024-02-24 04:33:03,070: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:33:03.087813460Z [2024-02-24 04:33:03,087: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:33:03.089062763Z [2024-02-24 04:33:03,088: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:33:03.089285776Z [2024-02-24 04:33:03,089: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:33:03.089388496Z [2024-02-24 04:33:03,089: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:33:03.089431873Z [2024-02-24 04:33:03,089: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:33:03.089735300Z [2024-02-24 04:33:03,089: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:33:03.089825471Z [2024-02-24 04:33:03,089: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:33:03.175014353Z [2024-02-24 04:33:03,174: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:33:05.213256831Z [2024-02-24 04:33:05,212: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[916539ba-6315-49d6-8c9d-68ca5f216c31] succeeded in 4.4265088780011865s: None
2024-02-24T04:33:06.448888969Z [2024-02-24 04:33:06,448: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[d9f09900-d503-439f-9c70-f9b674db5ca0] succeeded in 5.650744984999619s: None
2024-02-24T04:33:38.845572280Z [2024-02-24 04:33:38,845: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[54c2dcc2-a28d-46ef-85e0-657118a9fc5f] received
2024-02-24T04:33:38.858851796Z [2024-02-24 04:33:38,858: INFO/ForkPoolWorker-15] [54c2dcc2-a28d-46ef-85e0-657118a9fc5f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224043337_827370', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:33:39.161262741Z [2024-02-24 04:33:39,158: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:33:39.450999728Z [2024-02-24 04:33:39,450: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224043337_827370 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:33:40.177874773Z [2024-02-24 04:33:40,177: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[54c2dcc2-a28d-46ef-85e0-657118a9fc5f] succeeded in 1.3270005369995488s: None
2024-02-24T04:34:01.124095008Z [2024-02-24 04:34:01,123: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ea6dbad-27c2-4d8a-aad8-40d2bb31ff2d] received
2024-02-24T04:34:01.130534864Z [2024-02-24 04:34:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[616bd8a1-cdf0-4c63-a8ed-de30ead740ce] received
2024-02-24T04:34:01.134520842Z [2024-02-24 04:34:01,134: INFO/ForkPoolWorker-15] [6ea6dbad-27c2-4d8a-aad8-40d2bb31ff2d] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:32:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:34:01.146659792Z [2024-02-24 04:34:01,146: INFO/ForkPoolWorker-16] [616bd8a1-cdf0-4c63-a8ed-de30ead740ce] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:34:01.154897065Z [2024-02-24 04:34:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[17016096-85f3-4d10-b00c-a8a53a455ec5] received
2024-02-24T04:34:01.158477796Z [2024-02-24 04:34:01,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[1c2ef464-cc0f-419b-9539-c9642eaf64ef] received
2024-02-24T04:34:01.179585984Z [2024-02-24 04:34:01,179: INFO/ForkPoolWorker-2] [1c2ef464-cc0f-419b-9539-c9642eaf64ef] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:34:01.203263317Z [2024-02-24 04:34:01,202: INFO/ForkPoolWorker-1] [17016096-85f3-4d10-b00c-a8a53a455ec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:33:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:34:01.635239582Z [2024-02-24 04:34:01,630: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:34:01.712693081Z [2024-02-24 04:34:01,708: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:34:01.739848750Z [2024-02-24 04:34:01,735: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:34:01.760322287Z [2024-02-24 04:34:01,756: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:34:01.972444299Z [2024-02-24 04:34:01,972: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:34:01.977603431Z [2024-02-24 04:34:01,977: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:34:02.046790688Z [2024-02-24 04:34:02,046: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:34:02.047935954Z [2024-02-24 04:34:02,047: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:32:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:34:02.048616647Z [2024-02-24 04:34:02,048: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:34:02.048733871Z [2024-02-24 04:34:02,048: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:34:02.048826631Z [2024-02-24 04:34:02,048: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:34:02.049672308Z [2024-02-24 04:34:02,049: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:34:02.270214167Z [2024-02-24 04:34:02,269: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:34:03.112311322Z [2024-02-24 04:34:03,111: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ea6dbad-27c2-4d8a-aad8-40d2bb31ff2d] succeeded in 1.9863200679974398s: None
2024-02-24T04:34:03.408946040Z [2024-02-24 04:34:03,408: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[1c2ef464-cc0f-419b-9539-c9642eaf64ef] succeeded in 2.2477997440000763s: None
2024-02-24T04:34:03.836727745Z [2024-02-24 04:34:03,835: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:34:03.841346869Z [2024-02-24 04:34:03,839: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:34:03.886963064Z [2024-02-24 04:34:03,886: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:34:03.891507164Z [2024-02-24 04:34:03,891: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:34:03.891602777Z [2024-02-24 04:34:03,891: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:34:03.891794051Z [2024-02-24 04:34:03,891: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:34:03.892005832Z [2024-02-24 04:34:03,891: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:34:03.892245139Z [2024-02-24 04:34:03,892: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:34:03.892293967Z [2024-02-24 04:34:03,892: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:34:03.984382561Z [2024-02-24 04:34:03,984: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:34:04.031813041Z [2024-02-24 04:34:04,031: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:34:04.035044754Z [2024-02-24 04:34:04,034: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:34:04.086682717Z [2024-02-24 04:34:04,086: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:34:04.087911673Z [2024-02-24 04:34:04,087: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:34:04.088037272Z [2024-02-24 04:34:04,087: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:34:04.088177748Z [2024-02-24 04:34:04,088: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:34:04.088252349Z [2024-02-24 04:34:04,088: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:34:04.088502821Z [2024-02-24 04:34:04,088: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:34:04.088564771Z [2024-02-24 04:34:04,088: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:34:04.195112275Z [2024-02-24 04:34:04,194: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:33:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:34:06.345444936Z [2024-02-24 04:34:06,344: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[17016096-85f3-4d10-b00c-a8a53a455ec5] succeeded in 5.178601360999892s: None
2024-02-24T04:34:06.995499289Z [2024-02-24 04:34:06,994: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[616bd8a1-cdf0-4c63-a8ed-de30ead740ce] succeeded in 5.860743329998513s: None
2024-02-24T04:35:00.406586068Z [2024-02-24 04:35:00,406: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bac0b0ed-849a-411b-b09d-93027d4865f6] received
2024-02-24T04:35:00.412028423Z [2024-02-24 04:35:00,411: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4ed549b-0ec5-4f1a-9132-c9078dabcad9] received
2024-02-24T04:35:00.416315530Z [2024-02-24 04:35:00,415: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[00294ee9-e99a-4614-9230-f401c41111fd] received
2024-02-24T04:35:00.416767062Z [2024-02-24 04:35:00,416: INFO/ForkPoolWorker-15] [bac0b0ed-849a-411b-b09d-93027d4865f6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:35:00.426248801Z [2024-02-24 04:35:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ae2975b0-7bc8-4c35-a2a2-bc95b5ff5690] received
2024-02-24T04:35:00.426285835Z [2024-02-24 04:35:00,425: INFO/ForkPoolWorker-16] [e4ed549b-0ec5-4f1a-9132-c9078dabcad9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:35:00.429280359Z [2024-02-24 04:35:00,428: INFO/ForkPoolWorker-1] [00294ee9-e99a-4614-9230-f401c41111fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:35:00.434276111Z [2024-02-24 04:35:00,433: INFO/ForkPoolWorker-2] [ae2975b0-7bc8-4c35-a2a2-bc95b5ff5690] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:35:00.755681209Z [2024-02-24 04:35:00,751: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:35:00.763218578Z [2024-02-24 04:35:00,759: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:35:00.899157001Z [2024-02-24 04:35:00,895: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:35:01.020849027Z [2024-02-24 04:35:01,016: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:35:01.356646778Z [2024-02-24 04:35:01,356: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:35:01.363454997Z [2024-02-24 04:35:01,362: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:01.416224291Z [2024-02-24 04:35:01,415: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:35:01.418752812Z [2024-02-24 04:35:01,418: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:35:01.419006284Z [2024-02-24 04:35:01,418: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:35:01.419152292Z [2024-02-24 04:35:01,418: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:35:01.419572234Z [2024-02-24 04:35:01,419: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:35:01.554022188Z [2024-02-24 04:35:01,553: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:02.264381445Z [2024-02-24 04:35:02,263: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ae2975b0-7bc8-4c35-a2a2-bc95b5ff5690] succeeded in 1.8364671859999362s: None
2024-02-24T04:35:02.285671555Z [2024-02-24 04:35:02,285: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:35:02.289889485Z [2024-02-24 04:35:02,289: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:02.321911180Z [2024-02-24 04:35:02,321: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:35:02.327098651Z [2024-02-24 04:35:02,326: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:02.327399057Z [2024-02-24 04:35:02,327: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:02.327751687Z [2024-02-24 04:35:02,327: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:02.328384757Z [2024-02-24 04:35:02,327: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:35:02.328397371Z [2024-02-24 04:35:02,328: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:35:02.328402082Z [2024-02-24 04:35:02,328: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:02.335518289Z [2024-02-24 04:35:02,335: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:35:02.339141519Z [2024-02-24 04:35:02,338: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:02.357132263Z [2024-02-24 04:35:02,356: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:35:02.361460587Z [2024-02-24 04:35:02,360: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:02.368088058Z [2024-02-24 04:35:02,367: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:35:02.369427356Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:02.369452456Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:02.369554463Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:02.369632943Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:35:02.369869752Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:35:02.369880756Z [2024-02-24 04:35:02,369: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:02.427378538Z [2024-02-24 04:35:02,426: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:35:02.433960022Z [2024-02-24 04:35:02,433: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:02.434135535Z [2024-02-24 04:35:02,433: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:02.434575997Z [2024-02-24 04:35:02,434: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:02.434850648Z [2024-02-24 04:35:02,434: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:35:02.436304976Z [2024-02-24 04:35:02,436: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:35:02.436382061Z [2024-02-24 04:35:02,436: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:02.443291868Z [2024-02-24 04:35:02,442: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:02.468313536Z [2024-02-24 04:35:02,467: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:02.536887041Z [2024-02-24 04:35:02,536: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:03.149888853Z [2024-02-24 04:35:03,149: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bac0b0ed-849a-411b-b09d-93027d4865f6] succeeded in 2.7408874169996125s: None
2024-02-24T04:35:03.231231378Z [2024-02-24 04:35:03,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[778cdd1e-ec28-405a-9978-0afd8772f02f] received
2024-02-24T04:35:03.240187499Z [2024-02-24 04:35:03,239: INFO/ForkPoolWorker-15] [778cdd1e-ec28-405a-9978-0afd8772f02f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:35:03.564029365Z [2024-02-24 04:35:03,560: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:35:04.688126938Z [2024-02-24 04:35:04,687: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:35:04.691422720Z [2024-02-24 04:35:04,690: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:04.721365032Z [2024-02-24 04:35:04,721: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:35:04.723115994Z [2024-02-24 04:35:04,722: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:04.723615576Z [2024-02-24 04:35:04,723: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:04.723852369Z [2024-02-24 04:35:04,723: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:04.723882003Z [2024-02-24 04:35:04,723: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:35:04.724255058Z [2024-02-24 04:35:04,724: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:35:04.724440181Z [2024-02-24 04:35:04,724: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:04.791397573Z [2024-02-24 04:35:04,790: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[00294ee9-e99a-4614-9230-f401c41111fd] succeeded in 4.372153331001755s: None
2024-02-24T04:35:04.814550431Z [2024-02-24 04:35:04,814: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:05.079637501Z [2024-02-24 04:35:05,079: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[e4ed549b-0ec5-4f1a-9132-c9078dabcad9] succeeded in 4.664957240001968s: None
2024-02-24T04:35:05.521153314Z [2024-02-24 04:35:05,520: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[778cdd1e-ec28-405a-9978-0afd8772f02f] succeeded in 2.286609951999708s: None
2024-02-24T04:35:06.051664499Z [2024-02-24 04:35:06,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[53134495-5620-4d9d-9310-386d8c57c384] received
2024-02-24T04:35:06.058725953Z [2024-02-24 04:35:06,058: INFO/ForkPoolWorker-15] [53134495-5620-4d9d-9310-386d8c57c384] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:35:06.342019503Z [2024-02-24 04:35:06,338: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:35:07.481677158Z [2024-02-24 04:35:07,481: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:35:07.485130822Z [2024-02-24 04:35:07,484: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:07.504609317Z [2024-02-24 04:35:07,504: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:35:07.506554145Z [2024-02-24 04:35:07,505: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:07.506571881Z [2024-02-24 04:35:07,505: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:07.506578203Z [2024-02-24 04:35:07,505: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:07.506584744Z [2024-02-24 04:35:07,506: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:35:07.506590134Z [2024-02-24 04:35:07,506: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:35:07.506636286Z [2024-02-24 04:35:07,506: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:07.582028824Z [2024-02-24 04:35:07,581: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:30:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:08.141319687Z [2024-02-24 04:35:08,140: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[53134495-5620-4d9d-9310-386d8c57c384] succeeded in 2.0882953149994137s: None
2024-02-24T04:35:08.404199289Z [2024-02-24 04:35:08,403: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[37f06486-451b-4433-bef6-feb0de31283e] received
2024-02-24T04:35:08.410605712Z [2024-02-24 04:35:08,410: INFO/ForkPoolWorker-15] [37f06486-451b-4433-bef6-feb0de31283e] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:30:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:35:08.717493947Z [2024-02-24 04:35:08,714: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:35:09.853301679Z [2024-02-24 04:35:09,852: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:35:09.856623994Z [2024-02-24 04:35:09,856: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:35:09.875080219Z [2024-02-24 04:35:09,874: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:35:09.875652785Z [2024-02-24 04:35:09,875: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:35:09.875789451Z [2024-02-24 04:35:09,875: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:35:09.875990084Z [2024-02-24 04:35:09,875: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:35:09.876087236Z [2024-02-24 04:35:09,875: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:35:09.876387069Z [2024-02-24 04:35:09,876: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:35:09.877706471Z [2024-02-24 04:35:09,876: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:35:09.951540401Z [2024-02-24 04:35:09,951: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:30:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:35:10.577358107Z [2024-02-24 04:35:10,576: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[37f06486-451b-4433-bef6-feb0de31283e] succeeded in 2.170288346002053s: None
2024-02-24T04:36:00.414943688Z [2024-02-24 04:36:00,414: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[36a6f40a-b3c2-4a29-982d-cd5e1b7d04f3] received
2024-02-24T04:36:00.421149109Z [2024-02-24 04:36:00,420: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d651215-4c2b-4e85-a2eb-0910af73dc09] received
2024-02-24T04:36:00.426538102Z [2024-02-24 04:36:00,426: INFO/ForkPoolWorker-15] [36a6f40a-b3c2-4a29-982d-cd5e1b7d04f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:34:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:36:00.427396194Z [2024-02-24 04:36:00,425: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7377fc2a-84c5-40f2-bf05-4369b47b40a2] received
2024-02-24T04:36:00.428990614Z [2024-02-24 04:36:00,428: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4f3867bf-b6f5-4a62-bcb6-d6ea0d490f20] received
2024-02-24T04:36:00.434581221Z [2024-02-24 04:36:00,434: INFO/ForkPoolWorker-16] [9d651215-4c2b-4e85-a2eb-0910af73dc09] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:36:00.437308882Z [2024-02-24 04:36:00,437: INFO/ForkPoolWorker-1] [7377fc2a-84c5-40f2-bf05-4369b47b40a2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:36:00.437338296Z [2024-02-24 04:36:00,437: INFO/ForkPoolWorker-2] [4f3867bf-b6f5-4a62-bcb6-d6ea0d490f20] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:36:00.731909805Z [2024-02-24 04:36:00,728: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:36:00.783190065Z [2024-02-24 04:36:00,778: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:36:00.800211415Z [2024-02-24 04:36:00,797: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:36:00.861186498Z [2024-02-24 04:36:00,858: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:36:00.941547715Z [2024-02-24 04:36:00,941: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:36:00.945192208Z [2024-02-24 04:36:00,944: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:36:00.978812294Z [2024-02-24 04:36:00,978: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:36:00.981159930Z [2024-02-24 04:36:00,980: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:36:00.981705472Z [2024-02-24 04:36:00,981: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:36:00.983299601Z [2024-02-24 04:36:00,983: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:36:00.983777222Z [2024-02-24 04:36:00,983: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:36:01.097285387Z [2024-02-24 04:36:01,097: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:34:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:36:01.099837403Z [2024-02-24 04:36:01,099: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:36:01.802298598Z [2024-02-24 04:36:01,800: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[36a6f40a-b3c2-4a29-982d-cd5e1b7d04f3] succeeded in 1.3839460630006215s: None
2024-02-24T04:36:01.809095241Z [2024-02-24 04:36:01,808: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[4f3867bf-b6f5-4a62-bcb6-d6ea0d490f20] succeeded in 1.378053690001252s: None
2024-02-24T04:36:02.204557027Z [2024-02-24 04:36:02,204: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:36:02.207911421Z [2024-02-24 04:36:02,207: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:36:02.232135599Z [2024-02-24 04:36:02,231: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:36:02.235399127Z [2024-02-24 04:36:02,234: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:36:02.240317179Z [2024-02-24 04:36:02,240: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:36:02.242548633Z [2024-02-24 04:36:02,242: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:36:02.242875676Z [2024-02-24 04:36:02,242: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:36:02.243182076Z [2024-02-24 04:36:02,242: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:36:02.243498412Z [2024-02-24 04:36:02,243: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:36:02.244260235Z [2024-02-24 04:36:02,244: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:36:02.244666064Z [2024-02-24 04:36:02,244: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:36:02.254328956Z [2024-02-24 04:36:02,254: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:36:02.255691377Z [2024-02-24 04:36:02,255: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:36:02.255932287Z [2024-02-24 04:36:02,255: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:36:02.256049770Z [2024-02-24 04:36:02,255: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:36:02.256192714Z [2024-02-24 04:36:02,256: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:36:02.256501735Z [2024-02-24 04:36:02,256: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:36:02.256637050Z [2024-02-24 04:36:02,256: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:36:02.335900236Z [2024-02-24 04:36:02,335: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:36:02.344960684Z [2024-02-24 04:36:02,344: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:36:03.919711255Z [2024-02-24 04:36:03,919: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7377fc2a-84c5-40f2-bf05-4369b47b40a2] succeeded in 3.4910024410019105s: None
2024-02-24T04:36:05.081305865Z [2024-02-24 04:36:05,080: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[9d651215-4c2b-4e85-a2eb-0910af73dc09] succeeded in 4.658097367999289s: None
2024-02-24T04:37:01.111494926Z [2024-02-24 04:37:01,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[d12a01c9-717f-4708-b797-47dc3df817e6] received
2024-02-24T04:37:01.112612635Z [2024-02-24 04:37:01,112: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec9285ac-77d3-42f1-9348-abe2649229ad] received
2024-02-24T04:37:01.119679779Z [2024-02-24 04:37:01,119: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[782a6da3-5495-4f93-87ce-11473c533c62] received
2024-02-24T04:37:01.121055826Z [2024-02-24 04:37:01,120: INFO/ForkPoolWorker-16] [ec9285ac-77d3-42f1-9348-abe2649229ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:37:01.127100035Z [2024-02-24 04:37:01,126: INFO/ForkPoolWorker-15] [d12a01c9-717f-4708-b797-47dc3df817e6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:37:01.130982631Z [2024-02-24 04:37:01,130: INFO/ForkPoolWorker-1] [782a6da3-5495-4f93-87ce-11473c533c62] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:37:01.471646611Z [2024-02-24 04:37:01,468: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:37:01.491181781Z [2024-02-24 04:37:01,488: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:37:01.504177698Z [2024-02-24 04:37:01,499: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:37:01.645873091Z [2024-02-24 04:37:01,645: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:37:01.649724110Z [2024-02-24 04:37:01,649: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:37:01.672322123Z [2024-02-24 04:37:01,672: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:37:01.673453413Z [2024-02-24 04:37:01,673: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:37:01.673660775Z [2024-02-24 04:37:01,673: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:37:01.673872160Z [2024-02-24 04:37:01,673: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:37:01.674194224Z [2024-02-24 04:37:01,674: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:37:01.790385404Z [2024-02-24 04:37:01,790: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:37:02.463826578Z [2024-02-24 04:37:02,463: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ec9285ac-77d3-42f1-9348-abe2649229ad] succeeded in 1.3501740700012306s: None
2024-02-24T04:37:02.752738907Z [2024-02-24 04:37:02,752: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:37:02.756344614Z [2024-02-24 04:37:02,755: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:37:02.768729586Z [2024-02-24 04:37:02,768: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:37:02.772788117Z [2024-02-24 04:37:02,772: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:37:02.796616793Z [2024-02-24 04:37:02,796: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:37:02.798388714Z [2024-02-24 04:37:02,798: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:37:02.798615060Z [2024-02-24 04:37:02,798: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:37:02.798780777Z [2024-02-24 04:37:02,798: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:37:02.798866351Z [2024-02-24 04:37:02,798: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:37:02.799198323Z [2024-02-24 04:37:02,799: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:37:02.799621302Z [2024-02-24 04:37:02,799: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:37:02.807584674Z [2024-02-24 04:37:02,807: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:37:02.815024177Z [2024-02-24 04:37:02,814: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:37:02.815181537Z [2024-02-24 04:37:02,815: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:37:02.815328712Z [2024-02-24 04:37:02,815: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:37:02.815396931Z [2024-02-24 04:37:02,815: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:37:02.815687845Z [2024-02-24 04:37:02,815: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:37:02.815857764Z [2024-02-24 04:37:02,815: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:37:02.916987083Z [2024-02-24 04:37:02,916: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:37:02.923028397Z [2024-02-24 04:37:02,922: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:37:04.955449684Z [2024-02-24 04:37:04,954: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[782a6da3-5495-4f93-87ce-11473c533c62] succeeded in 3.833462917998986s: None
2024-02-24T04:37:05.543539193Z [2024-02-24 04:37:05,543: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[d12a01c9-717f-4708-b797-47dc3df817e6] succeeded in 4.428269467000064s: None
2024-02-24T04:38:01.064777814Z [2024-02-24 04:38:01,064: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e4e70afb-1fd2-485a-93be-d8cb4f61b9f3] received
2024-02-24T04:38:01.070489948Z [2024-02-24 04:38:01,070: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6c1cae6d-3eb4-4092-951c-46c3571e3d88] received
2024-02-24T04:38:01.076966101Z [2024-02-24 04:38:01,076: INFO/ForkPoolWorker-15] [e4e70afb-1fd2-485a-93be-d8cb4f61b9f3] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:36:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:38:01.080771555Z [2024-02-24 04:38:01,080: INFO/ForkPoolWorker-16] [6c1cae6d-3eb4-4092-951c-46c3571e3d88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:38:01.090562941Z [2024-02-24 04:38:01,090: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2e4439e0-b949-4137-a9e6-3f625badc74a] received
2024-02-24T04:38:01.095740530Z [2024-02-24 04:38:01,095: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[579eba66-f182-46a1-9343-db0c2f723796] received
2024-02-24T04:38:01.100612039Z [2024-02-24 04:38:01,100: INFO/ForkPoolWorker-1] [2e4439e0-b949-4137-a9e6-3f625badc74a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:38:01.102017315Z [2024-02-24 04:38:01,101: INFO/ForkPoolWorker-2] [579eba66-f182-46a1-9343-db0c2f723796] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:37:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:38:01.435313724Z [2024-02-24 04:38:01,431: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:38:01.441656493Z [2024-02-24 04:38:01,437: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:38:01.506253594Z [2024-02-24 04:38:01,503: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:38:01.633096151Z [2024-02-24 04:38:01,628: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:38:01.905207578Z [2024-02-24 04:38:01,904: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:36:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:38:02.052944933Z [2024-02-24 04:38:02,052: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:38:02.063444645Z [2024-02-24 04:38:02,062: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:38:02.095058179Z [2024-02-24 04:38:02,094: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:38:02.096824105Z [2024-02-24 04:38:02,096: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:38:02.097169173Z [2024-02-24 04:38:02,096: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:38:02.097458602Z [2024-02-24 04:38:02,097: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:38:02.098017434Z [2024-02-24 04:38:02,097: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:38:02.245875734Z [2024-02-24 04:38:02,245: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:38:02.918735402Z [2024-02-24 04:38:02,918: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e4e70afb-1fd2-485a-93be-d8cb4f61b9f3] succeeded in 1.851289424001152s: None
2024-02-24T04:38:03.185978957Z [2024-02-24 04:38:03,185: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[579eba66-f182-46a1-9343-db0c2f723796] succeeded in 2.0886755999999878s: None
2024-02-24T04:38:03.202699037Z [2024-02-24 04:38:03,202: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:38:03.208626930Z [2024-02-24 04:38:03,207: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:38:03.242895601Z [2024-02-24 04:38:03,242: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:38:03.247337460Z [2024-02-24 04:38:03,246: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:38:03.247373245Z [2024-02-24 04:38:03,247: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:38:03.247397254Z [2024-02-24 04:38:03,247: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:38:03.247491200Z [2024-02-24 04:38:03,247: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:38:03.247847929Z [2024-02-24 04:38:03,247: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:38:03.247876770Z [2024-02-24 04:38:03,247: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:38:03.358442554Z [2024-02-24 04:38:03,358: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:38:03.359516577Z [2024-02-24 04:38:03,359: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:38:03.361664894Z [2024-02-24 04:38:03,361: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:38:03.387593032Z [2024-02-24 04:38:03,387: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:38:03.389240129Z [2024-02-24 04:38:03,388: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:38:03.389314333Z [2024-02-24 04:38:03,389: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:38:03.389506233Z [2024-02-24 04:38:03,389: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:38:03.389637859Z [2024-02-24 04:38:03,389: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:38:03.389970215Z [2024-02-24 04:38:03,389: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:38:03.390069247Z [2024-02-24 04:38:03,389: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:38:03.477674357Z [2024-02-24 04:38:03,477: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:37:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:38:05.249907545Z [2024-02-24 04:38:05,248: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[2e4439e0-b949-4137-a9e6-3f625badc74a] succeeded in 4.15627348900307s: None
2024-02-24T04:38:05.376156844Z [2024-02-24 04:38:05,374: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6c1cae6d-3eb4-4092-951c-46c3571e3d88] succeeded in 4.302264420999563s: None
2024-02-24T04:39:00.753851275Z [2024-02-24 04:39:00,753: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e665ba44-491e-4b7e-8770-022eaf94584a] received
2024-02-24T04:39:00.758636315Z [2024-02-24 04:39:00,758: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac41769f-0233-4b99-af48-e3e2e6fc8c77] received
2024-02-24T04:39:00.760735695Z [2024-02-24 04:39:00,760: INFO/ForkPoolWorker-15] [e665ba44-491e-4b7e-8770-022eaf94584a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:39:00.767406407Z [2024-02-24 04:39:00,767: INFO/ForkPoolWorker-16] [ac41769f-0233-4b99-af48-e3e2e6fc8c77] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:39:00.768232484Z [2024-02-24 04:39:00,768: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b1f24336-d03c-4c21-aa83-02c566fe2e6b] received
2024-02-24T04:39:00.779957012Z [2024-02-24 04:39:00,779: INFO/ForkPoolWorker-1] [b1f24336-d03c-4c21-aa83-02c566fe2e6b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:39:01.064811402Z [2024-02-24 04:39:01,057: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:39:01.105869302Z [2024-02-24 04:39:01,099: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:39:01.151831889Z [2024-02-24 04:39:01,142: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:39:01.382108913Z [2024-02-24 04:39:01,381: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:39:01.386010021Z [2024-02-24 04:39:01,385: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:39:01.425049599Z [2024-02-24 04:39:01,424: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:39:01.426740302Z [2024-02-24 04:39:01,426: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:39:01.426927506Z [2024-02-24 04:39:01,426: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:39:01.427094631Z [2024-02-24 04:39:01,426: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:39:01.427405743Z [2024-02-24 04:39:01,427: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:39:01.539859243Z [2024-02-24 04:39:01,539: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:39:02.187881709Z [2024-02-24 04:39:02,187: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b1f24336-d03c-4c21-aa83-02c566fe2e6b] succeeded in 1.4179932859988185s: None
2024-02-24T04:39:02.294771283Z [2024-02-24 04:39:02,294: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:39:02.297980414Z [2024-02-24 04:39:02,297: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:39:02.317280452Z [2024-02-24 04:39:02,317: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:39:02.319102982Z [2024-02-24 04:39:02,318: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:39:02.319131688Z [2024-02-24 04:39:02,318: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:39:02.319237259Z [2024-02-24 04:39:02,319: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:39:02.319261331Z [2024-02-24 04:39:02,319: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:39:02.319533258Z [2024-02-24 04:39:02,319: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:39:02.319546637Z [2024-02-24 04:39:02,319: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:39:02.365880893Z [2024-02-24 04:39:02,363: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:39:02.366846828Z [2024-02-24 04:39:02,366: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:39:02.406338364Z [2024-02-24 04:39:02,406: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:39:02.408217796Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:39:02.408243468Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:39:02.408362012Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:39:02.408408501Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:39:02.408607905Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:39:02.408653537Z [2024-02-24 04:39:02,408: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:39:02.425204189Z [2024-02-24 04:39:02,424: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:39:02.508163035Z [2024-02-24 04:39:02,507: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:39:04.625835038Z [2024-02-24 04:39:04,625: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ac41769f-0233-4b99-af48-e3e2e6fc8c77] succeeded in 3.864550643000257s: None
2024-02-24T04:39:05.532225303Z [2024-02-24 04:39:05,531: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e665ba44-491e-4b7e-8770-022eaf94584a] succeeded in 4.776229609000438s: None
2024-02-24T04:40:00.698172524Z [2024-02-24 04:40:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[789c648e-8f9a-486c-b5aa-e656a11cdd16] received
2024-02-24T04:40:00.701180876Z [2024-02-24 04:40:00,700: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c6fb8c4e-59bb-4f76-881e-13ff92109a9f] received
2024-02-24T04:40:00.704030176Z [2024-02-24 04:40:00,703: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[99940f02-f00d-4c6b-8668-f776af844adc] received
2024-02-24T04:40:00.706518707Z [2024-02-24 04:40:00,706: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[792c2327-b7fc-465c-bea7-955da4e16cac] received
2024-02-24T04:40:00.713962679Z [2024-02-24 04:40:00,713: INFO/ForkPoolWorker-16] [c6fb8c4e-59bb-4f76-881e-13ff92109a9f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:40:00.714173183Z [2024-02-24 04:40:00,713: INFO/ForkPoolWorker-1] [99940f02-f00d-4c6b-8668-f776af844adc] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:40:00.717239083Z [2024-02-24 04:40:00,716: INFO/ForkPoolWorker-2] [792c2327-b7fc-465c-bea7-955da4e16cac] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:38:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:40:00.720352786Z [2024-02-24 04:40:00,718: INFO/ForkPoolWorker-15] [789c648e-8f9a-486c-b5aa-e656a11cdd16] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:40:00.724893841Z [2024-02-24 04:40:00,724: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[13e5688a-2740-4cdb-9934-f98176d9a724] received
2024-02-24T04:40:00.782079815Z [2024-02-24 04:40:00,781: INFO/ForkPoolWorker-3] [13e5688a-2740-4cdb-9934-f98176d9a724] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:39:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:40:01.096930677Z [2024-02-24 04:40:01,093: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:40:01.100054148Z [2024-02-24 04:40:01,093: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:40:01.179816814Z [2024-02-24 04:40:01,176: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:40:01.355162657Z [2024-02-24 04:40:01,349: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:40:01.397882397Z [2024-02-24 04:40:01,394: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:40:01.528815442Z [2024-02-24 04:40:01,528: INFO/ForkPoolWorker-2] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:38:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:01.596876060Z [2024-02-24 04:40:01,596: INFO/ForkPoolWorker-3] Getting SDNC list
2024-02-24T04:40:01.603146654Z [2024-02-24 04:40:01,602: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:01.638386005Z [2024-02-24 04:40:01,638: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T04:40:01.642765922Z [2024-02-24 04:40:01,642: INFO/ForkPoolWorker-3] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:40:01.642795004Z [2024-02-24 04:40:01,642: INFO/ForkPoolWorker-3] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:40:01.642850666Z [2024-02-24 04:40:01,642: INFO/ForkPoolWorker-3] Getting SDNC list OK
2024-02-24T04:40:01.643075826Z [2024-02-24 04:40:01,642: INFO/ForkPoolWorker-3] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:40:01.756862684Z [2024-02-24 04:40:01,756: INFO/ForkPoolWorker-3] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:02.468745782Z [2024-02-24 04:40:02,468: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[792c2327-b7fc-465c-bea7-955da4e16cac] succeeded in 1.7599215299997013s: None
2024-02-24T04:40:02.601668254Z [2024-02-24 04:40:02,601: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[13e5688a-2740-4cdb-9934-f98176d9a724] succeeded in 1.8627639059996s: None
2024-02-24T04:40:02.929289540Z [2024-02-24 04:40:02,928: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:40:02.933706012Z [2024-02-24 04:40:02,933: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:02.955842846Z [2024-02-24 04:40:02,955: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:40:02.957185371Z [2024-02-24 04:40:02,956: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:02.957228108Z [2024-02-24 04:40:02,957: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:02.957522910Z [2024-02-24 04:40:02,957: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:02.957643299Z [2024-02-24 04:40:02,957: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:40:02.958163932Z [2024-02-24 04:40:02,957: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:40:02.958230095Z [2024-02-24 04:40:02,958: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:03.063667168Z [2024-02-24 04:40:03,063: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:03.106389968Z [2024-02-24 04:40:03,106: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:40:03.109722448Z [2024-02-24 04:40:03,109: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:03.134057383Z [2024-02-24 04:40:03,133: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:40:03.135517403Z [2024-02-24 04:40:03,135: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:03.135639131Z [2024-02-24 04:40:03,135: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:03.135854933Z [2024-02-24 04:40:03,135: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:03.135980997Z [2024-02-24 04:40:03,135: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:40:03.136307934Z [2024-02-24 04:40:03,136: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:40:03.136442487Z [2024-02-24 04:40:03,136: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:03.172193561Z [2024-02-24 04:40:03,171: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:40:03.175632799Z [2024-02-24 04:40:03,175: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:03.207119370Z [2024-02-24 04:40:03,206: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:40:03.208477020Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:03.208494812Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:03.208611655Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:03.208643689Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:40:03.208865070Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:40:03.208891840Z [2024-02-24 04:40:03,208: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:03.243645491Z [2024-02-24 04:40:03,243: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:03.330286530Z [2024-02-24 04:40:03,329: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:39:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:03.755330769Z [2024-02-24 04:40:03,754: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[99940f02-f00d-4c6b-8668-f776af844adc] succeeded in 3.048591161001241s: None
2024-02-24T04:40:04.589416079Z [2024-02-24 04:40:04,589: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9141c6fb-97fc-4e0d-ab04-58325a1bcf24] received
2024-02-24T04:40:04.609575246Z [2024-02-24 04:40:04,609: INFO/ForkPoolWorker-1] [9141c6fb-97fc-4e0d-ab04-58325a1bcf24] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:40:04.941208752Z [2024-02-24 04:40:04,940: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[c6fb8c4e-59bb-4f76-881e-13ff92109a9f] succeeded in 4.237873124002363s: None
2024-02-24T04:40:04.984777846Z [2024-02-24 04:40:04,981: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:40:05.275967345Z [2024-02-24 04:40:05,275: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[789c648e-8f9a-486c-b5aa-e656a11cdd16] succeeded in 4.5751713490026304s: None
2024-02-24T04:40:06.181947742Z [2024-02-24 04:40:06,181: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:40:06.185021322Z [2024-02-24 04:40:06,184: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:06.208046239Z [2024-02-24 04:40:06,207: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:40:06.209444270Z [2024-02-24 04:40:06,209: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:06.209611476Z [2024-02-24 04:40:06,209: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:06.209815072Z [2024-02-24 04:40:06,209: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:06.209830083Z [2024-02-24 04:40:06,209: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:40:06.210076459Z [2024-02-24 04:40:06,209: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:40:06.210120302Z [2024-02-24 04:40:06,210: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:06.308644407Z [2024-02-24 04:40:06,308: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:06.997680572Z [2024-02-24 04:40:06,997: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9141c6fb-97fc-4e0d-ab04-58325a1bcf24] succeeded in 2.405666888997075s: None
2024-02-24T04:40:07.059871930Z [2024-02-24 04:40:07,059: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[50a2d786-b73e-4f46-a620-d6882987b40d] received
2024-02-24T04:40:07.067495432Z [2024-02-24 04:40:07,067: INFO/ForkPoolWorker-15] [50a2d786-b73e-4f46-a620-d6882987b40d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:40:07.367215550Z [2024-02-24 04:40:07,364: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:40:08.457596039Z [2024-02-24 04:40:08,457: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:40:08.460766723Z [2024-02-24 04:40:08,460: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:08.481285882Z [2024-02-24 04:40:08,481: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:40:08.483453269Z [2024-02-24 04:40:08,483: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:08.483792005Z [2024-02-24 04:40:08,483: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:08.484168728Z [2024-02-24 04:40:08,483: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:08.484342592Z [2024-02-24 04:40:08,484: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:40:08.484859269Z [2024-02-24 04:40:08,484: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:40:08.485096759Z [2024-02-24 04:40:08,484: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:08.577491356Z [2024-02-24 04:40:08,577: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:35:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:09.172785587Z [2024-02-24 04:40:09,172: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[50a2d786-b73e-4f46-a620-d6882987b40d] succeeded in 2.111442088000331s: None
2024-02-24T04:40:09.708478034Z [2024-02-24 04:40:09,708: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[14e8aaca-81a3-4614-bb6f-15c544fe1b78] received
2024-02-24T04:40:09.714654035Z [2024-02-24 04:40:09,714: INFO/ForkPoolWorker-15] [14e8aaca-81a3-4614-bb6f-15c544fe1b78] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:35:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:40:09.982526434Z [2024-02-24 04:40:09,979: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:40:11.073551216Z [2024-02-24 04:40:11,072: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:40:11.076401016Z [2024-02-24 04:40:11,075: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:40:11.095458103Z [2024-02-24 04:40:11,095: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:40:11.097168487Z [2024-02-24 04:40:11,096: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:40:11.097253492Z [2024-02-24 04:40:11,097: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:40:11.097475430Z [2024-02-24 04:40:11,097: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:40:11.097628303Z [2024-02-24 04:40:11,097: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:40:11.098176530Z [2024-02-24 04:40:11,097: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:40:11.098303213Z [2024-02-24 04:40:11,098: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:40:11.269811666Z [2024-02-24 04:40:11,269: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:35:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:40:11.882095539Z [2024-02-24 04:40:11,881: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[14e8aaca-81a3-4614-bb6f-15c544fe1b78] succeeded in 2.171808602000965s: None
2024-02-24T04:41:00.631039594Z [2024-02-24 04:41:00,630: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bf7663b0-cc16-40ca-9905-c36f0e350806] received
2024-02-24T04:41:00.635451801Z [2024-02-24 04:41:00,635: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4bbae208-affc-4340-bbeb-44bbbfbdd0ea] received
2024-02-24T04:41:00.641710696Z [2024-02-24 04:41:00,640: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[a80cac30-6609-48f1-b07c-93171d86f2a0] received
2024-02-24T04:41:00.649663647Z [2024-02-24 04:41:00,649: INFO/ForkPoolWorker-15] [bf7663b0-cc16-40ca-9905-c36f0e350806] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:41:00.652468576Z [2024-02-24 04:41:00,652: INFO/ForkPoolWorker-16] [4bbae208-affc-4340-bbeb-44bbbfbdd0ea] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:41:00.652882203Z [2024-02-24 04:41:00,652: INFO/ForkPoolWorker-1] [a80cac30-6609-48f1-b07c-93171d86f2a0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:41:00.930834723Z [2024-02-24 04:41:00,927: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:41:00.940765578Z [2024-02-24 04:41:00,937: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:41:00.973297000Z [2024-02-24 04:41:00,970: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:41:01.087415504Z [2024-02-24 04:41:01,086: INFO/ForkPoolWorker-15] Getting SDNC list
2024-02-24T04:41:01.091667500Z [2024-02-24 04:41:01,091: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:41:01.120310505Z [2024-02-24 04:41:01,120: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:41:01.121958537Z [2024-02-24 04:41:01,121: INFO/ForkPoolWorker-15] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:41:01.122018846Z [2024-02-24 04:41:01,121: INFO/ForkPoolWorker-15] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:41:01.122079111Z [2024-02-24 04:41:01,122: INFO/ForkPoolWorker-15] Getting SDNC list OK
2024-02-24T04:41:01.122322831Z [2024-02-24 04:41:01,122: INFO/ForkPoolWorker-15] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:41:01.220786643Z [2024-02-24 04:41:01,220: INFO/ForkPoolWorker-15] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:41:01.851831103Z [2024-02-24 04:41:01,851: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bf7663b0-cc16-40ca-9905-c36f0e350806] succeeded in 1.2127566279996245s: None
2024-02-24T04:41:02.106650462Z [2024-02-24 04:41:02,106: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:41:02.109872117Z [2024-02-24 04:41:02,109: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:41:02.139702006Z [2024-02-24 04:41:02,139: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:41:02.141118917Z [2024-02-24 04:41:02,140: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:41:02.141170614Z [2024-02-24 04:41:02,141: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:41:02.141361646Z [2024-02-24 04:41:02,141: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:41:02.141480535Z [2024-02-24 04:41:02,141: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:41:02.141824539Z [2024-02-24 04:41:02,141: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:41:02.142048687Z [2024-02-24 04:41:02,141: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:41:02.243308897Z [2024-02-24 04:41:02,242: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:41:02.284493382Z [2024-02-24 04:41:02,284: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:41:02.287930777Z [2024-02-24 04:41:02,287: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:41:02.311145608Z [2024-02-24 04:41:02,310: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:41:02.312503808Z [2024-02-24 04:41:02,312: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:41:02.312626943Z [2024-02-24 04:41:02,312: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:41:02.312813880Z [2024-02-24 04:41:02,312: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:41:02.312930890Z [2024-02-24 04:41:02,312: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:41:02.313211749Z [2024-02-24 04:41:02,313: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:41:02.313309794Z [2024-02-24 04:41:02,313: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:41:02.474728091Z [2024-02-24 04:41:02,474: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:41:04.305947588Z [2024-02-24 04:41:04,305: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4bbae208-affc-4340-bbeb-44bbbfbdd0ea] succeeded in 3.66698383900075s: None
2024-02-24T04:41:04.747152858Z [2024-02-24 04:41:04,746: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[a80cac30-6609-48f1-b07c-93171d86f2a0] succeeded in 4.100913750000473s: None
2024-02-24T04:41:38.679043730Z [2024-02-24 04:41:38,678: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[0dc172a3-081e-4bbe-9a88-613d685a6ac2] received
2024-02-24T04:41:38.693102585Z [2024-02-24 04:41:38,692: INFO/ForkPoolWorker-15] [0dc172a3-081e-4bbe-9a88-613d685a6ac2] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044137_466331', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:41:38.961149206Z [2024-02-24 04:41:38,958: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:41:39.263272211Z [2024-02-24 04:41:39,262: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224044137_466331 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:41:39.876024158Z [2024-02-24 04:41:39,875: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[0dc172a3-081e-4bbe-9a88-613d685a6ac2] succeeded in 1.1950046860001748s: None
2024-02-24T04:42:00.477003961Z [2024-02-24 04:42:00,476: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[47b13868-0d37-4013-9aee-d81bd9b3e522] received
2024-02-24T04:42:00.482165245Z [2024-02-24 04:42:00,481: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8fa0f995-0145-49db-82e2-dc4922bd8d3b] received
2024-02-24T04:42:00.486936332Z [2024-02-24 04:42:00,486: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b80ed17-d237-4765-8fa9-e0891d7cf6fa] received
2024-02-24T04:42:00.488540513Z [2024-02-24 04:42:00,488: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[94d405af-af77-4a92-9110-c225e760817a] received
2024-02-24T04:42:00.492507604Z [2024-02-24 04:42:00,491: INFO/ForkPoolWorker-15] [47b13868-0d37-4013-9aee-d81bd9b3e522] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:42:00.502451217Z [2024-02-24 04:42:00,502: INFO/ForkPoolWorker-16] [8fa0f995-0145-49db-82e2-dc4922bd8d3b] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:42:00.512443257Z [2024-02-24 04:42:00,512: INFO/ForkPoolWorker-1] [7b80ed17-d237-4765-8fa9-e0891d7cf6fa] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:42:00.513830880Z [2024-02-24 04:42:00,513: INFO/ForkPoolWorker-2] [94d405af-af77-4a92-9110-c225e760817a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:41:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:42:00.783376593Z [2024-02-24 04:42:00,780: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:42:00.902704727Z [2024-02-24 04:42:00,894: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:42:00.969491621Z [2024-02-24 04:42:00,963: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:42:01.055659519Z [2024-02-24 04:42:01,052: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:42:01.229275570Z [2024-02-24 04:42:01,228: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:42:01.245903964Z [2024-02-24 04:42:01,243: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:42:01.344938951Z [2024-02-24 04:42:01,344: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:42:01.346183725Z [2024-02-24 04:42:01,345: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:42:01.346271795Z [2024-02-24 04:42:01,346: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:42:01.346294545Z [2024-02-24 04:42:01,346: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:42:01.346464546Z [2024-02-24 04:42:01,346: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:42:01.459930427Z [2024-02-24 04:42:01,459: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:42:01.516746835Z [2024-02-24 04:42:01,516: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:42:02.344114605Z [2024-02-24 04:42:02,343: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[7b80ed17-d237-4765-8fa9-e0891d7cf6fa] succeeded in 1.8539203480031574s: None
2024-02-24T04:42:02.430140072Z [2024-02-24 04:42:02,429: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[8fa0f995-0145-49db-82e2-dc4922bd8d3b] succeeded in 1.9440762480007834s: None
2024-02-24T04:42:02.564602338Z [2024-02-24 04:42:02,564: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:42:02.568200848Z [2024-02-24 04:42:02,567: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:42:02.591915598Z [2024-02-24 04:42:02,591: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:42:02.593327297Z [2024-02-24 04:42:02,593: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:42:02.593461643Z [2024-02-24 04:42:02,593: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:42:02.593716479Z [2024-02-24 04:42:02,593: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:42:02.593939861Z [2024-02-24 04:42:02,593: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:42:02.594296665Z [2024-02-24 04:42:02,594: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:42:02.594425175Z [2024-02-24 04:42:02,594: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:42:02.734543836Z [2024-02-24 04:42:02,734: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:42:02.801578865Z [2024-02-24 04:42:02,801: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:42:02.806957108Z [2024-02-24 04:42:02,806: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:42:02.849830419Z [2024-02-24 04:42:02,849: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:42:02.851366649Z [2024-02-24 04:42:02,851: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:42:02.851380962Z [2024-02-24 04:42:02,851: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:42:02.851427430Z [2024-02-24 04:42:02,851: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:42:02.851590827Z [2024-02-24 04:42:02,851: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:42:02.854460470Z [2024-02-24 04:42:02,854: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:42:02.854647391Z [2024-02-24 04:42:02,854: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:42:02.990862754Z [2024-02-24 04:42:02,990: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:41:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:42:04.330515320Z [2024-02-24 04:42:04,329: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[47b13868-0d37-4013-9aee-d81bd9b3e522] succeeded in 3.8470189409999875s: None
2024-02-24T04:42:05.170948713Z [2024-02-24 04:42:05,170: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[94d405af-af77-4a92-9110-c225e760817a] succeeded in 4.674264034998487s: None
2024-02-24T04:43:00.491154413Z [2024-02-24 04:43:00,490: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9489ef26-9371-49fe-aebf-4f2c1e52b70a] received
2024-02-24T04:43:00.496020241Z [2024-02-24 04:43:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[70e62ba3-054e-4f15-9ab1-001a8e0985ca] received
2024-02-24T04:43:00.498382857Z [2024-02-24 04:43:00,498: INFO/ForkPoolWorker-15] [9489ef26-9371-49fe-aebf-4f2c1e52b70a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:43:00.500380327Z [2024-02-24 04:43:00,500: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9d8a83b0-4d5e-4724-b7f2-28695b2b4178] received
2024-02-24T04:43:00.506403625Z [2024-02-24 04:43:00,506: INFO/ForkPoolWorker-16] [70e62ba3-054e-4f15-9ab1-001a8e0985ca] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:43:00.515488292Z [2024-02-24 04:43:00,515: INFO/ForkPoolWorker-1] [9d8a83b0-4d5e-4724-b7f2-28695b2b4178] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:43:00.807453281Z [2024-02-24 04:43:00,804: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:43:00.809285128Z [2024-02-24 04:43:00,805: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:43:00.836421078Z [2024-02-24 04:43:00,831: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:43:00.982285244Z [2024-02-24 04:43:00,981: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:43:00.986564539Z [2024-02-24 04:43:00,986: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:43:01.006807482Z [2024-02-24 04:43:01,006: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:43:01.007982431Z [2024-02-24 04:43:01,007: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:43:01.008059855Z [2024-02-24 04:43:01,007: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:43:01.008114870Z [2024-02-24 04:43:01,008: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:43:01.008308771Z [2024-02-24 04:43:01,008: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:43:01.123830437Z [2024-02-24 04:43:01,123: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:43:01.818068695Z [2024-02-24 04:43:01,817: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[70e62ba3-054e-4f15-9ab1-001a8e0985ca] succeeded in 1.3187342889978027s: None
2024-02-24T04:43:02.107965093Z [2024-02-24 04:43:02,107: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:43:02.111469296Z [2024-02-24 04:43:02,111: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:43:02.141894101Z [2024-02-24 04:43:02,141: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:43:02.145180746Z [2024-02-24 04:43:02,144: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:43:02.145577812Z [2024-02-24 04:43:02,145: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:43:02.146157432Z [2024-02-24 04:43:02,145: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:43:02.146769645Z [2024-02-24 04:43:02,146: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:43:02.147511166Z [2024-02-24 04:43:02,147: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:43:02.147834192Z [2024-02-24 04:43:02,147: INFO/ForkPoolWorker-1] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:43:02.163886426Z [2024-02-24 04:43:02,163: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:43:02.167314926Z [2024-02-24 04:43:02,166: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:43:02.196607563Z [2024-02-24 04:43:02,196: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:43:02.203624492Z [2024-02-24 04:43:02,203: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:43:02.204118676Z [2024-02-24 04:43:02,203: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:43:02.204523935Z [2024-02-24 04:43:02,204: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:43:02.204785371Z [2024-02-24 04:43:02,204: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:43:02.205989860Z [2024-02-24 04:43:02,205: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:43:02.206283812Z [2024-02-24 04:43:02,206: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:43:02.261587763Z [2024-02-24 04:43:02,261: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:43:02.306744064Z [2024-02-24 04:43:02,306: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:43:04.157103841Z [2024-02-24 04:43:04,156: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[9489ef26-9371-49fe-aebf-4f2c1e52b70a] succeeded in 3.664236106997123s: None
2024-02-24T04:43:04.571012329Z [2024-02-24 04:43:04,570: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9d8a83b0-4d5e-4724-b7f2-28695b2b4178] succeeded in 4.068011258001206s: None
2024-02-24T04:43:38.596227085Z [2024-02-24 04:43:38,595: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[dc5cd5b8-ebcb-425c-a953-fb7dea83786b] received
2024-02-24T04:43:38.608090635Z [2024-02-24 04:43:38,607: INFO/ForkPoolWorker-15] [dc5cd5b8-ebcb-425c-a953-fb7dea83786b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044337_299070', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:43:38.899104427Z [2024-02-24 04:43:38,895: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:43:39.194027692Z [2024-02-24 04:43:39,193: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224044337_299070 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:43:39.962831810Z [2024-02-24 04:43:39,962: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[dc5cd5b8-ebcb-425c-a953-fb7dea83786b] succeeded in 1.365052648998244s: None
2024-02-24T04:44:01.229954124Z [2024-02-24 04:44:01,227: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6553dfea-7f6f-4484-989c-77ef51cb4d69] received
2024-02-24T04:44:01.232339694Z [2024-02-24 04:44:01,230: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4eef77d0-943a-455c-8b2d-bd20fa49764b] received
2024-02-24T04:44:01.236436745Z [2024-02-24 04:44:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b5d93906-e736-4e55-ace7-1ac0f619d9c4] received
2024-02-24T04:44:01.237010248Z [2024-02-24 04:44:01,236: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32dcbe46-07a0-47cc-82df-495ed2824f0a] received
2024-02-24T04:44:01.246172091Z [2024-02-24 04:44:01,245: INFO/ForkPoolWorker-15] [6553dfea-7f6f-4484-989c-77ef51cb4d69] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:42:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:44:01.248182385Z [2024-02-24 04:44:01,247: INFO/ForkPoolWorker-1] [b5d93906-e736-4e55-ace7-1ac0f619d9c4] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:44:01.248725465Z [2024-02-24 04:44:01,248: INFO/ForkPoolWorker-16] [4eef77d0-943a-455c-8b2d-bd20fa49764b] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:44:01.252969359Z [2024-02-24 04:44:01,252: INFO/ForkPoolWorker-2] [32dcbe46-07a0-47cc-82df-495ed2824f0a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:43:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:44:01.625336448Z [2024-02-24 04:44:01,622: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:44:01.642892365Z [2024-02-24 04:44:01,639: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:44:01.673102108Z [2024-02-24 04:44:01,668: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:44:01.728672707Z [2024-02-24 04:44:01,724: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:44:01.887684389Z [2024-02-24 04:44:01,887: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:42:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:44:01.915151578Z [2024-02-24 04:44:01,914: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:44:01.920615716Z [2024-02-24 04:44:01,920: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:44:01.947512585Z [2024-02-24 04:44:01,947: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:44:01.948875915Z [2024-02-24 04:44:01,948: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:44:01.949597027Z [2024-02-24 04:44:01,948: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:44:01.949802261Z [2024-02-24 04:44:01,949: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:44:01.950178159Z [2024-02-24 04:44:01,949: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:44:02.078911720Z [2024-02-24 04:44:02,078: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:44:02.476744394Z [2024-02-24 04:44:02,476: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6553dfea-7f6f-4484-989c-77ef51cb4d69] succeeded in 1.2454893979993358s: None
2024-02-24T04:44:02.775507955Z [2024-02-24 04:44:02,775: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32dcbe46-07a0-47cc-82df-495ed2824f0a] succeeded in 1.536002755001391s: None
2024-02-24T04:44:03.011259356Z [2024-02-24 04:44:03,010: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:44:03.014487627Z [2024-02-24 04:44:03,014: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:44:03.043619400Z [2024-02-24 04:44:03,043: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:44:03.045323035Z [2024-02-24 04:44:03,045: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:44:03.045480400Z [2024-02-24 04:44:03,045: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:44:03.045691518Z [2024-02-24 04:44:03,045: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:44:03.045891040Z [2024-02-24 04:44:03,045: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:44:03.046215008Z [2024-02-24 04:44:03,046: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:44:03.046724925Z [2024-02-24 04:44:03,046: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:44:03.091393520Z [2024-02-24 04:44:03,091: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:44:03.094641447Z [2024-02-24 04:44:03,094: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:44:03.120905898Z [2024-02-24 04:44:03,120: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:44:03.122348346Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:44:03.122454219Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:44:03.122534843Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:44:03.122593396Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:44:03.122975972Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:44:03.122986584Z [2024-02-24 04:44:03,122: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:44:03.146387362Z [2024-02-24 04:44:03,146: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:44:03.227477242Z [2024-02-24 04:44:03,227: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:43:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:44:04.744254075Z [2024-02-24 04:44:04,743: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[b5d93906-e736-4e55-ace7-1ac0f619d9c4] succeeded in 3.5088500769998063s: None
2024-02-24T04:44:06.810364297Z [2024-02-24 04:44:06,809: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[4eef77d0-943a-455c-8b2d-bd20fa49764b] succeeded in 5.576952521001658s: None
2024-02-24T04:45:01.151730161Z [2024-02-24 04:45:01,151: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5d37d55d-565b-4d8c-9fcd-8272c13bb8bd] received
2024-02-24T04:45:01.154511108Z [2024-02-24 04:45:01,154: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b2d2e356-f667-4a71-9194-1f09331b256a] received
2024-02-24T04:45:01.156487556Z [2024-02-24 04:45:01,156: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9dea38d0-f01b-4022-9113-5f9f07cbbd33] received
2024-02-24T04:45:01.160004200Z [2024-02-24 04:45:01,159: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[9bcf6821-e032-42c2-a77d-651013ad26a6] received
2024-02-24T04:45:01.164844209Z [2024-02-24 04:45:01,164: INFO/ForkPoolWorker-15] [5d37d55d-565b-4d8c-9fcd-8272c13bb8bd] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:45:01.172500312Z [2024-02-24 04:45:01,172: INFO/ForkPoolWorker-2] [9bcf6821-e032-42c2-a77d-651013ad26a6] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:45:01.179985399Z [2024-02-24 04:45:01,179: INFO/ForkPoolWorker-16] [b2d2e356-f667-4a71-9194-1f09331b256a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:45:01.180506902Z [2024-02-24 04:45:01,180: INFO/ForkPoolWorker-1] [9dea38d0-f01b-4022-9113-5f9f07cbbd33] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:45:01.527777268Z [2024-02-24 04:45:01,523: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:45:01.693416707Z [2024-02-24 04:45:01,690: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:45:01.827559042Z [2024-02-24 04:45:01,824: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:45:01.841570574Z [2024-02-24 04:45:01,837: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:45:01.903450706Z [2024-02-24 04:45:01,902: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:45:01.912187109Z [2024-02-24 04:45:01,911: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:01.965505307Z [2024-02-24 04:45:01,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:45:01.968109295Z [2024-02-24 04:45:01,967: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:45:01.968414691Z [2024-02-24 04:45:01,968: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:45:01.968900389Z [2024-02-24 04:45:01,968: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:45:01.970844352Z [2024-02-24 04:45:01,970: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:45:02.075753454Z [2024-02-24 04:45:02,075: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:02.746338119Z [2024-02-24 04:45:02,745: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[b2d2e356-f667-4a71-9194-1f09331b256a] succeeded in 1.588894006999908s: None
2024-02-24T04:45:03.024123721Z [2024-02-24 04:45:03,023: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:45:03.028173418Z [2024-02-24 04:45:03,027: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:03.053683624Z [2024-02-24 04:45:03,053: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:45:03.059131642Z [2024-02-24 04:45:03,058: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:03.059155135Z [2024-02-24 04:45:03,059: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:03.059198336Z [2024-02-24 04:45:03,059: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:03.059246031Z [2024-02-24 04:45:03,059: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:45:03.059525376Z [2024-02-24 04:45:03,059: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:45:03.059548199Z [2024-02-24 04:45:03,059: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:03.159962641Z [2024-02-24 04:45:03,159: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:03.198568826Z [2024-02-24 04:45:03,198: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:45:03.203938782Z [2024-02-24 04:45:03,203: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:03.228891533Z [2024-02-24 04:45:03,228: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:45:03.230509262Z [2024-02-24 04:45:03,230: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:03.230538622Z [2024-02-24 04:45:03,230: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:03.230707763Z [2024-02-24 04:45:03,230: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:03.230764455Z [2024-02-24 04:45:03,230: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:45:03.231051671Z [2024-02-24 04:45:03,230: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:45:03.231117032Z [2024-02-24 04:45:03,231: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:03.251519078Z [2024-02-24 04:45:03,251: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:45:03.255144511Z [2024-02-24 04:45:03,254: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:03.312557300Z [2024-02-24 04:45:03,312: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:45:03.314116276Z [2024-02-24 04:45:03,313: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:03.314217467Z [2024-02-24 04:45:03,314: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:03.314403409Z [2024-02-24 04:45:03,314: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:03.314518409Z [2024-02-24 04:45:03,314: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:45:03.314836201Z [2024-02-24 04:45:03,314: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:45:03.314975293Z [2024-02-24 04:45:03,314: INFO/ForkPoolWorker-1] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:03.332371161Z [2024-02-24 04:45:03,332: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:03.417127633Z [2024-02-24 04:45:03,416: INFO/ForkPoolWorker-1] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:04.106681523Z [2024-02-24 04:45:04,105: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5c2d33e2-dcb6-4a68-bac5-d0ebaa3acc38] received
2024-02-24T04:45:04.124755810Z [2024-02-24 04:45:04,124: INFO/ForkPoolWorker-16] [5c2d33e2-dcb6-4a68-bac5-d0ebaa3acc38] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:45:04.142027638Z [2024-02-24 04:45:04,141: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[9dea38d0-f01b-4022-9113-5f9f07cbbd33] succeeded in 2.982168089998595s: None
2024-02-24T04:45:04.421849991Z [2024-02-24 04:45:04,418: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:45:05.379499865Z [2024-02-24 04:45:05,379: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[5d37d55d-565b-4d8c-9fcd-8272c13bb8bd] succeeded in 4.224705120002909s: None
2024-02-24T04:45:05.513239402Z [2024-02-24 04:45:05,512: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:45:05.516622521Z [2024-02-24 04:45:05,516: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:05.550926094Z [2024-02-24 04:45:05,550: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:45:05.552780094Z [2024-02-24 04:45:05,552: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:05.552817966Z [2024-02-24 04:45:05,552: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:05.553218436Z [2024-02-24 04:45:05,552: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:05.553425901Z [2024-02-24 04:45:05,553: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:45:05.553952096Z [2024-02-24 04:45:05,553: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:45:05.554049693Z [2024-02-24 04:45:05,553: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:05.644712393Z [2024-02-24 04:45:05,644: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:05.686295523Z [2024-02-24 04:45:05,685: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[9bcf6821-e032-42c2-a77d-651013ad26a6] succeeded in 4.5241864700001315s: None
2024-02-24T04:45:06.360918640Z [2024-02-24 04:45:06,360: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5c2d33e2-dcb6-4a68-bac5-d0ebaa3acc38] succeeded in 2.250048906000302s: None
2024-02-24T04:45:06.580595765Z [2024-02-24 04:45:06,580: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bfbfb918-c0ab-494e-865f-9bc140a5fafa] received
2024-02-24T04:45:06.594445233Z [2024-02-24 04:45:06,594: INFO/ForkPoolWorker-15] [bfbfb918-c0ab-494e-865f-9bc140a5fafa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:45:06.928900499Z [2024-02-24 04:45:06,924: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:45:08.074314931Z [2024-02-24 04:45:08,073: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:45:08.077812301Z [2024-02-24 04:45:08,077: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:08.096900611Z [2024-02-24 04:45:08,096: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:45:08.098141599Z [2024-02-24 04:45:08,097: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:08.098215362Z [2024-02-24 04:45:08,098: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:08.098399383Z [2024-02-24 04:45:08,098: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:08.098502249Z [2024-02-24 04:45:08,098: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:45:08.098793161Z [2024-02-24 04:45:08,098: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:45:08.098944408Z [2024-02-24 04:45:08,098: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:08.182857673Z [2024-02-24 04:45:08,182: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:40:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:08.728915016Z [2024-02-24 04:45:08,728: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[bfbfb918-c0ab-494e-865f-9bc140a5fafa] succeeded in 2.143054301999655s: None
2024-02-24T04:45:09.052767024Z [2024-02-24 04:45:09,050: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[566e5af3-981c-4678-8549-94d0db46c294] received
2024-02-24T04:45:09.058643157Z [2024-02-24 04:45:09,058: INFO/ForkPoolWorker-15] [566e5af3-981c-4678-8549-94d0db46c294] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:40:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:45:09.411851929Z [2024-02-24 04:45:09,408: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:45:10.595088733Z [2024-02-24 04:45:10,594: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:45:10.598278268Z [2024-02-24 04:45:10,597: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:45:10.614772927Z [2024-02-24 04:45:10,614: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:45:10.616001017Z [2024-02-24 04:45:10,615: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:45:10.616100207Z [2024-02-24 04:45:10,616: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:45:10.616253522Z [2024-02-24 04:45:10,616: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:45:10.616335734Z [2024-02-24 04:45:10,616: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:45:10.616564175Z [2024-02-24 04:45:10,616: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:45:10.616648004Z [2024-02-24 04:45:10,616: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:45:10.687237795Z [2024-02-24 04:45:10,686: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:40:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:45:11.223880051Z [2024-02-24 04:45:11,222: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[566e5af3-981c-4678-8549-94d0db46c294] succeeded in 2.1688146050000796s: None
2024-02-24T04:46:00.946738770Z [2024-02-24 04:46:00,946: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[4619ccee-0e71-4960-b636-e25d665e5fba] received
2024-02-24T04:46:00.948564394Z [2024-02-24 04:46:00,948: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[95c47671-732b-454c-b4e4-a2e9527c2a88] received
2024-02-24T04:46:00.950314645Z [2024-02-24 04:46:00,950: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[be7bee03-c63e-4bc5-a9c2-48a745392516] received
2024-02-24T04:46:00.952350517Z [2024-02-24 04:46:00,952: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e8ea7667-bd97-4eac-9e7b-033cfb88cfa6] received
2024-02-24T04:46:00.956213541Z [2024-02-24 04:46:00,955: INFO/ForkPoolWorker-15] [4619ccee-0e71-4960-b636-e25d665e5fba] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:44:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:46:00.959215993Z [2024-02-24 04:46:00,959: INFO/ForkPoolWorker-2] [e8ea7667-bd97-4eac-9e7b-033cfb88cfa6] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:46:00.959230897Z [2024-02-24 04:46:00,958: INFO/ForkPoolWorker-16] [95c47671-732b-454c-b4e4-a2e9527c2a88] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:46:00.959827452Z [2024-02-24 04:46:00,959: INFO/ForkPoolWorker-1] [be7bee03-c63e-4bc5-a9c2-48a745392516] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:46:01.337940437Z [2024-02-24 04:46:01,332: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:46:01.416807429Z [2024-02-24 04:46:01,413: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:46:01.441561914Z [2024-02-24 04:46:01,438: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:46:01.508301970Z [2024-02-24 04:46:01,504: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:46:01.668602591Z [2024-02-24 04:46:01,668: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:46:01.682984296Z [2024-02-24 04:46:01,678: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:46:01.726981280Z [2024-02-24 04:46:01,726: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:46:01.728696226Z [2024-02-24 04:46:01,728: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:46:01.728897684Z [2024-02-24 04:46:01,728: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:46:01.729075670Z [2024-02-24 04:46:01,728: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:46:01.729403098Z [2024-02-24 04:46:01,729: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:46:01.762230028Z [2024-02-24 04:46:01,761: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:44:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:46:01.829628533Z [2024-02-24 04:46:01,829: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:46:02.346172919Z [2024-02-24 04:46:02,345: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[4619ccee-0e71-4960-b636-e25d665e5fba] succeeded in 1.3971855119998509s: None
2024-02-24T04:46:02.479584393Z [2024-02-24 04:46:02,479: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[e8ea7667-bd97-4eac-9e7b-033cfb88cfa6] succeeded in 1.5257316539973544s: None
2024-02-24T04:46:02.882483915Z [2024-02-24 04:46:02,882: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:46:02.885631700Z [2024-02-24 04:46:02,885: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:46:02.905969006Z [2024-02-24 04:46:02,905: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:46:02.907186952Z [2024-02-24 04:46:02,906: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:46:02.907198820Z [2024-02-24 04:46:02,907: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:46:02.907316955Z [2024-02-24 04:46:02,907: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:46:02.907333849Z [2024-02-24 04:46:02,907: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:46:02.907580418Z [2024-02-24 04:46:02,907: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:46:02.907595104Z [2024-02-24 04:46:02,907: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:46:02.924933869Z [2024-02-24 04:46:02,924: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:46:02.928217319Z [2024-02-24 04:46:02,927: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:46:02.956068777Z [2024-02-24 04:46:02,955: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:46:02.957530710Z [2024-02-24 04:46:02,957: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:46:02.957661491Z [2024-02-24 04:46:02,957: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:46:02.957968274Z [2024-02-24 04:46:02,957: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:46:02.958087360Z [2024-02-24 04:46:02,957: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:46:02.958391914Z [2024-02-24 04:46:02,958: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:46:02.958507607Z [2024-02-24 04:46:02,958: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:46:02.993218998Z [2024-02-24 04:46:02,992: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:46:03.056655922Z [2024-02-24 04:46:03,056: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:46:06.297960055Z [2024-02-24 04:46:06,297: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[be7bee03-c63e-4bc5-a9c2-48a745392516] succeeded in 5.344927399997687s: None
2024-02-24T04:46:07.015945237Z [2024-02-24 04:46:07,015: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[95c47671-732b-454c-b4e4-a2e9527c2a88] succeeded in 6.065219478998188s: None
2024-02-24T04:47:00.690264731Z [2024-02-24 04:47:00,689: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7dce95ad-ce33-4c91-8f40-d6d57543c8f9] received
2024-02-24T04:47:00.696945864Z [2024-02-24 04:47:00,696: INFO/ForkPoolWorker-15] [7dce95ad-ce33-4c91-8f40-d6d57543c8f9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:47:00.697443371Z [2024-02-24 04:47:00,697: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6022f0d6-d307-4775-ab0e-de36a2d7d29f] received
2024-02-24T04:47:00.700140498Z [2024-02-24 04:47:00,699: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fc763a29-8b09-4233-a950-2475bfbd327e] received
2024-02-24T04:47:00.709883731Z [2024-02-24 04:47:00,709: INFO/ForkPoolWorker-1] [fc763a29-8b09-4233-a950-2475bfbd327e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:47:00.712744834Z [2024-02-24 04:47:00,712: INFO/ForkPoolWorker-16] [6022f0d6-d307-4775-ab0e-de36a2d7d29f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:47:01.010582132Z [2024-02-24 04:47:01,007: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:47:01.011492142Z [2024-02-24 04:47:01,008: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:47:01.012803668Z [2024-02-24 04:47:01,009: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:47:01.168184890Z [2024-02-24 04:47:01,167: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:47:01.172243788Z [2024-02-24 04:47:01,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:47:01.196914689Z [2024-02-24 04:47:01,196: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:47:01.198010643Z [2024-02-24 04:47:01,197: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:47:01.198075432Z [2024-02-24 04:47:01,197: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:47:01.198123775Z [2024-02-24 04:47:01,198: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:47:01.198308823Z [2024-02-24 04:47:01,198: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:47:01.359907079Z [2024-02-24 04:47:01,359: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:47:01.948531866Z [2024-02-24 04:47:01,948: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[fc763a29-8b09-4233-a950-2475bfbd327e] succeeded in 1.2469413420003548s: None
2024-02-24T04:47:02.233289223Z [2024-02-24 04:47:02,232: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:47:02.236746637Z [2024-02-24 04:47:02,236: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:47:02.266673260Z [2024-02-24 04:47:02,266: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:47:02.268920765Z [2024-02-24 04:47:02,268: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:47:02.269216301Z [2024-02-24 04:47:02,268: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:47:02.269640890Z [2024-02-24 04:47:02,269: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:47:02.269861316Z [2024-02-24 04:47:02,269: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:47:02.270413670Z [2024-02-24 04:47:02,270: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:47:02.270589115Z [2024-02-24 04:47:02,270: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:47:02.289685696Z [2024-02-24 04:47:02,289: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:47:02.292926523Z [2024-02-24 04:47:02,292: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:47:02.312633444Z [2024-02-24 04:47:02,312: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:47:02.314259168Z [2024-02-24 04:47:02,313: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:47:02.314282916Z [2024-02-24 04:47:02,314: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:47:02.314575204Z [2024-02-24 04:47:02,314: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:47:02.314682423Z [2024-02-24 04:47:02,314: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:47:02.315241594Z [2024-02-24 04:47:02,315: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:47:02.315253711Z [2024-02-24 04:47:02,315: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:47:02.371392608Z [2024-02-24 04:47:02,370: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:47:02.420598593Z [2024-02-24 04:47:02,420: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:47:04.071838704Z [2024-02-24 04:47:04,071: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[6022f0d6-d307-4775-ab0e-de36a2d7d29f] succeeded in 3.3662492600014957s: None
2024-02-24T04:47:04.262530359Z [2024-02-24 04:47:04,261: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7dce95ad-ce33-4c91-8f40-d6d57543c8f9] succeeded in 3.5697594720004417s: None
2024-02-24T04:48:01.256756228Z [2024-02-24 04:48:01,250: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[fdeb0b3d-1518-43a2-a87f-e3af20513263] received
2024-02-24T04:48:01.256777436Z [2024-02-24 04:48:01,252: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ee3a7b68-af37-4429-94b6-248ba5ca9707] received
2024-02-24T04:48:01.262052651Z [2024-02-24 04:48:01,258: INFO/ForkPoolWorker-15] [fdeb0b3d-1518-43a2-a87f-e3af20513263] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:46:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:48:01.267444550Z [2024-02-24 04:48:01,266: INFO/ForkPoolWorker-16] [ee3a7b68-af37-4429-94b6-248ba5ca9707] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:48:01.291494834Z [2024-02-24 04:48:01,290: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[adc5a242-bde1-4344-9747-1c672b7ccf17] received
2024-02-24T04:48:01.301978029Z [2024-02-24 04:48:01,297: INFO/ForkPoolWorker-1] [adc5a242-bde1-4344-9747-1c672b7ccf17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:48:01.305941810Z [2024-02-24 04:48:01,303: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3fa10f7d-eb18-4954-893c-fb6ff84f5f34] received
2024-02-24T04:48:01.327746117Z [2024-02-24 04:48:01,327: INFO/ForkPoolWorker-2] [3fa10f7d-eb18-4954-893c-fb6ff84f5f34] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:47:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:48:01.628766755Z [2024-02-24 04:48:01,624: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:48:01.660403344Z [2024-02-24 04:48:01,657: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:48:01.660435887Z [2024-02-24 04:48:01,656: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:48:01.693672808Z [2024-02-24 04:48:01,690: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:48:01.864376940Z [2024-02-24 04:48:01,863: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:48:01.868685356Z [2024-02-24 04:48:01,867: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:48:01.904850258Z [2024-02-24 04:48:01,904: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:48:01.905935438Z [2024-02-24 04:48:01,905: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:48:01.906017506Z [2024-02-24 04:48:01,905: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:48:01.906064997Z [2024-02-24 04:48:01,905: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:48:01.906238432Z [2024-02-24 04:48:01,906: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:48:01.971138768Z [2024-02-24 04:48:01,970: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:46:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:48:02.023981987Z [2024-02-24 04:48:02,023: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:48:02.591971831Z [2024-02-24 04:48:02,591: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[3fa10f7d-eb18-4954-893c-fb6ff84f5f34] succeeded in 1.2860507339973992s: None
2024-02-24T04:48:02.610684467Z [2024-02-24 04:48:02,610: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[fdeb0b3d-1518-43a2-a87f-e3af20513263] succeeded in 1.3583277500001714s: None
2024-02-24T04:48:03.124857746Z [2024-02-24 04:48:03,124: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:48:03.128191777Z [2024-02-24 04:48:03,127: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:48:03.153958570Z [2024-02-24 04:48:03,153: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:48:03.155705041Z [2024-02-24 04:48:03,155: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:48:03.155806905Z [2024-02-24 04:48:03,155: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:48:03.155972798Z [2024-02-24 04:48:03,155: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:48:03.156060588Z [2024-02-24 04:48:03,155: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:48:03.156346893Z [2024-02-24 04:48:03,156: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:48:03.156446195Z [2024-02-24 04:48:03,156: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:48:03.178270382Z [2024-02-24 04:48:03,177: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:48:03.181626934Z [2024-02-24 04:48:03,181: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:48:03.203242293Z [2024-02-24 04:48:03,203: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:48:03.204884898Z [2024-02-24 04:48:03,204: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:48:03.205155969Z [2024-02-24 04:48:03,204: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:48:03.205530410Z [2024-02-24 04:48:03,205: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:48:03.205738587Z [2024-02-24 04:48:03,205: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:48:03.206159450Z [2024-02-24 04:48:03,205: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:48:03.206450824Z [2024-02-24 04:48:03,206: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:48:03.256096103Z [2024-02-24 04:48:03,255: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:48:03.307473879Z [2024-02-24 04:48:03,307: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:47:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:48:04.966834174Z [2024-02-24 04:48:04,966: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[adc5a242-bde1-4344-9747-1c672b7ccf17] succeeded in 3.6742297599994345s: None
2024-02-24T04:48:05.789462354Z [2024-02-24 04:48:05,789: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[ee3a7b68-af37-4429-94b6-248ba5ca9707] succeeded in 4.535203718001867s: None
2024-02-24T04:49:00.608705452Z [2024-02-24 04:49:00,608: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[e1b1e894-4823-4aae-957e-62c3c84947e8] received
2024-02-24T04:49:00.620564646Z [2024-02-24 04:49:00,620: INFO/ForkPoolWorker-15] [e1b1e894-4823-4aae-957e-62c3c84947e8] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:49:00.635199718Z [2024-02-24 04:49:00,634: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[77d7faa8-d7e8-49ab-aea5-5cdc2321cf17] received
2024-02-24T04:49:00.651381275Z [2024-02-24 04:49:00,651: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c2e79b8c-018a-4ba6-8078-ab01984f3c8f] received
2024-02-24T04:49:00.652127454Z [2024-02-24 04:49:00,651: INFO/ForkPoolWorker-16] [77d7faa8-d7e8-49ab-aea5-5cdc2321cf17] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:49:00.663840311Z [2024-02-24 04:49:00,663: INFO/ForkPoolWorker-1] [c2e79b8c-018a-4ba6-8078-ab01984f3c8f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:49:01.018404634Z [2024-02-24 04:49:01,012: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:49:01.053860572Z [2024-02-24 04:49:01,050: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:49:01.086267540Z [2024-02-24 04:49:01,082: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:49:01.216338221Z [2024-02-24 04:49:01,215: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:49:01.220771760Z [2024-02-24 04:49:01,220: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:49:01.269064847Z [2024-02-24 04:49:01,268: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:49:01.272334454Z [2024-02-24 04:49:01,271: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:49:01.272342935Z [2024-02-24 04:49:01,271: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:49:01.272346493Z [2024-02-24 04:49:01,271: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:49:01.272349854Z [2024-02-24 04:49:01,272: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:49:01.434399273Z [2024-02-24 04:49:01,434: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:49:02.061016157Z [2024-02-24 04:49:02,060: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[c2e79b8c-018a-4ba6-8078-ab01984f3c8f] succeeded in 1.4025364910012286s: None
2024-02-24T04:49:02.158804893Z [2024-02-24 04:49:02,158: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:49:02.161855363Z [2024-02-24 04:49:02,161: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:49:02.181759566Z [2024-02-24 04:49:02,181: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:49:02.183203408Z [2024-02-24 04:49:02,182: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:49:02.183224931Z [2024-02-24 04:49:02,183: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:49:02.183396042Z [2024-02-24 04:49:02,183: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:49:02.183448093Z [2024-02-24 04:49:02,183: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:49:02.183690390Z [2024-02-24 04:49:02,183: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:49:02.183708458Z [2024-02-24 04:49:02,183: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:49:02.266575313Z [2024-02-24 04:49:02,266: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:49:02.341752844Z [2024-02-24 04:49:02,341: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:49:02.345075264Z [2024-02-24 04:49:02,344: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:49:02.401117988Z [2024-02-24 04:49:02,400: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:49:02.403565536Z [2024-02-24 04:49:02,403: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:49:02.405137153Z [2024-02-24 04:49:02,404: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:49:02.405494132Z [2024-02-24 04:49:02,405: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:49:02.405756946Z [2024-02-24 04:49:02,405: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:49:02.406183183Z [2024-02-24 04:49:02,406: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:49:02.406362548Z [2024-02-24 04:49:02,406: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:49:02.528198379Z [2024-02-24 04:49:02,527: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:49:03.872545275Z [2024-02-24 04:49:03,872: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[77d7faa8-d7e8-49ab-aea5-5cdc2321cf17] succeeded in 3.233638655001414s: None
2024-02-24T04:49:04.575052597Z [2024-02-24 04:49:04,574: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[e1b1e894-4823-4aae-957e-62c3c84947e8] succeeded in 3.960197172000335s: None
2024-02-24T04:49:38.434769085Z [2024-02-24 04:49:38,434: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7c807aaf-da35-42ea-a968-1a76b0342491] received
2024-02-24T04:49:38.446172008Z [2024-02-24 04:49:38,445: INFO/ForkPoolWorker-15] [7c807aaf-da35-42ea-a968-1a76b0342491] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224044937_366794', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:49:38.722691414Z [2024-02-24 04:49:38,719: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:49:39.033437793Z [2024-02-24 04:49:39,033: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224044937_366794 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:49:39.774824620Z [2024-02-24 04:49:39,774: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7c807aaf-da35-42ea-a968-1a76b0342491] succeeded in 1.3380840059980983s: None
2024-02-24T04:50:01.124905275Z [2024-02-24 04:50:01,124: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[76f26589-159b-43c0-b65e-c48ed785cc51] received
2024-02-24T04:50:01.130970144Z [2024-02-24 04:50:01,130: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[003d69ca-fa61-4dcd-8b02-ead4d124167e] received
2024-02-24T04:50:01.132776385Z [2024-02-24 04:50:01,132: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[03ad5c52-8f77-4e1f-8e98-97535075ce3e] received
2024-02-24T04:50:01.137938542Z [2024-02-24 04:50:01,137: INFO/ForkPoolWorker-15] [76f26589-159b-43c0-b65e-c48ed785cc51] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:50:01.139687429Z [2024-02-24 04:50:01,139: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[44760a03-433b-4bc6-b995-be26596b0932] received
2024-02-24T04:50:01.140402084Z [2024-02-24 04:50:01,140: INFO/ForkPoolWorker-1] [03ad5c52-8f77-4e1f-8e98-97535075ce3e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:50:01.142895215Z [2024-02-24 04:50:01,142: INFO/ForkPoolWorker-16] [003d69ca-fa61-4dcd-8b02-ead4d124167e] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:48:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:50:01.151585412Z [2024-02-24 04:50:01,151: INFO/ForkPoolWorker-2] [44760a03-433b-4bc6-b995-be26596b0932] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:50:01.155960897Z [2024-02-24 04:50:01,155: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[c3f089c6-3aa0-4571-9e25-84a63a3f69f0] received
2024-02-24T04:50:01.171632779Z [2024-02-24 04:50:01,171: INFO/ForkPoolWorker-3] [c3f089c6-3aa0-4571-9e25-84a63a3f69f0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:49:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:50:01.552574337Z [2024-02-24 04:50:01,547: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:50:01.750625527Z [2024-02-24 04:50:01,746: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:50:01.818440664Z [2024-02-24 04:50:01,810: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:50:01.991676055Z [2024-02-24 04:50:01,987: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:50:02.154492814Z [2024-02-24 04:50:02,150: INFO/ForkPoolWorker-3] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:50:02.167673633Z [2024-02-24 04:50:02,165: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:50:02.170669298Z [2024-02-24 04:50:02,170: INFO/ForkPoolWorker-16] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:48:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:02.171611206Z [2024-02-24 04:50:02,171: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:02.223024821Z [2024-02-24 04:50:02,222: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:50:02.226813575Z [2024-02-24 04:50:02,226: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:50:02.226846770Z [2024-02-24 04:50:02,226: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:50:02.226976807Z [2024-02-24 04:50:02,226: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:50:02.227526533Z [2024-02-24 04:50:02,227: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:50:02.335756010Z [2024-02-24 04:50:02,335: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:02.993368851Z [2024-02-24 04:50:02,992: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[003d69ca-fa61-4dcd-8b02-ead4d124167e] succeeded in 1.8609045349985536s: None
2024-02-24T04:50:03.278938989Z [2024-02-24 04:50:03,278: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[03ad5c52-8f77-4e1f-8e98-97535075ce3e] succeeded in 2.1446816829993622s: None
2024-02-24T04:50:03.613960755Z [2024-02-24 04:50:03,613: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:50:03.617927955Z [2024-02-24 04:50:03,617: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:03.658978093Z [2024-02-24 04:50:03,658: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:50:03.663059084Z [2024-02-24 04:50:03,662: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:03.663159095Z [2024-02-24 04:50:03,663: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:03.663415720Z [2024-02-24 04:50:03,663: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:03.663429618Z [2024-02-24 04:50:03,663: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:50:03.663995716Z [2024-02-24 04:50:03,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:50:03.666678506Z [2024-02-24 04:50:03,664: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:03.700061343Z [2024-02-24 04:50:03,699: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:50:03.703804896Z [2024-02-24 04:50:03,703: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:03.742330999Z [2024-02-24 04:50:03,742: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:50:03.747142783Z [2024-02-24 04:50:03,746: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:03.747167467Z [2024-02-24 04:50:03,747: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:03.747411186Z [2024-02-24 04:50:03,747: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:03.747419518Z [2024-02-24 04:50:03,747: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:50:03.748482783Z [2024-02-24 04:50:03,747: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:50:03.748497667Z [2024-02-24 04:50:03,747: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:03.756940845Z [2024-02-24 04:50:03,755: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:03.869922340Z [2024-02-24 04:50:03,868: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:03.873675136Z [2024-02-24 04:50:03,872: INFO/ForkPoolWorker-3] Getting VIM list
2024-02-24T04:50:03.879631632Z [2024-02-24 04:50:03,878: INFO/ForkPoolWorker-3] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:03.939256032Z [2024-02-24 04:50:03,939: INFO/ForkPoolWorker-3] Connected to database osm version 1.2
2024-02-24T04:50:03.942391415Z [2024-02-24 04:50:03,942: INFO/ForkPoolWorker-3] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:03.942580111Z [2024-02-24 04:50:03,942: INFO/ForkPoolWorker-3] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:03.942949786Z [2024-02-24 04:50:03,942: INFO/ForkPoolWorker-3] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:03.943172477Z [2024-02-24 04:50:03,942: INFO/ForkPoolWorker-3] Getting VIM list OK
2024-02-24T04:50:03.943523612Z [2024-02-24 04:50:03,943: INFO/ForkPoolWorker-3] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:50:03.943677541Z [2024-02-24 04:50:03,943: INFO/ForkPoolWorker-3] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:04.097325788Z [2024-02-24 04:50:04,096: INFO/ForkPoolWorker-3] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:49:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:04.527880140Z [2024-02-24 04:50:04,527: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[76f26589-159b-43c0-b65e-c48ed785cc51] succeeded in 3.400822080002399s: None
2024-02-24T04:50:05.158894377Z [2024-02-24 04:50:05,158: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[450d6843-d0dc-407c-b1fd-1d013af8eb6a] received
2024-02-24T04:50:05.172656528Z [2024-02-24 04:50:05,172: INFO/ForkPoolWorker-15] [450d6843-d0dc-407c-b1fd-1d013af8eb6a] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:50:05.579154018Z [2024-02-24 04:50:05,571: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:50:05.646582543Z [2024-02-24 04:50:05,646: INFO/ForkPoolWorker-3] Task airflow.executors.celery_executor.execute_command[c3f089c6-3aa0-4571-9e25-84a63a3f69f0] succeeded in 4.48567047799952s: None
2024-02-24T04:50:05.966722508Z [2024-02-24 04:50:05,966: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[44760a03-433b-4bc6-b995-be26596b0932] succeeded in 4.820856771999388s: None
2024-02-24T04:50:06.764932557Z [2024-02-24 04:50:06,764: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:50:06.768320474Z [2024-02-24 04:50:06,767: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:06.790442901Z [2024-02-24 04:50:06,790: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:50:06.792050849Z [2024-02-24 04:50:06,791: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:06.792139937Z [2024-02-24 04:50:06,791: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:06.792307210Z [2024-02-24 04:50:06,791: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:06.792476437Z [2024-02-24 04:50:06,792: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:50:06.792851446Z [2024-02-24 04:50:06,792: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:50:06.792976334Z [2024-02-24 04:50:06,792: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:06.873508596Z [2024-02-24 04:50:06,873: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:07.535151510Z [2024-02-24 04:50:07,534: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[450d6843-d0dc-407c-b1fd-1d013af8eb6a] succeeded in 2.36751293099951s: None
2024-02-24T04:50:07.791301763Z [2024-02-24 04:50:07,791: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ac813c38-7d54-49a1-93ff-11dffb4dd574] received
2024-02-24T04:50:07.799178154Z [2024-02-24 04:50:07,798: INFO/ForkPoolWorker-15] [ac813c38-7d54-49a1-93ff-11dffb4dd574] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:50:08.085439883Z [2024-02-24 04:50:08,082: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:50:09.219366628Z [2024-02-24 04:50:09,218: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:50:09.222646349Z [2024-02-24 04:50:09,222: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:09.241010553Z [2024-02-24 04:50:09,240: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:50:09.242488689Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:09.242580739Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:09.242748390Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:09.242794157Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:50:09.243043699Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:50:09.243324106Z [2024-02-24 04:50:09,242: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:09.342232155Z [2024-02-24 04:50:09,341: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:45:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:09.923996479Z [2024-02-24 04:50:09,923: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[618cf9e9-ac51-4ce2-b7f1-d8f7470bc1c9] received
2024-02-24T04:50:09.938337038Z [2024-02-24 04:50:09,938: INFO/ForkPoolWorker-16] [618cf9e9-ac51-4ce2-b7f1-d8f7470bc1c9] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:45:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:50:09.975894746Z [2024-02-24 04:50:09,975: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ac813c38-7d54-49a1-93ff-11dffb4dd574] succeeded in 2.1814468659977138s: None
2024-02-24T04:50:10.224433735Z [2024-02-24 04:50:10,221: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:50:11.361852775Z [2024-02-24 04:50:11,359: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:50:11.363434074Z [2024-02-24 04:50:11,362: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:50:11.387962577Z [2024-02-24 04:50:11,387: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:50:11.389437073Z [2024-02-24 04:50:11,389: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:50:11.389522519Z [2024-02-24 04:50:11,389: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:50:11.389592732Z [2024-02-24 04:50:11,389: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:50:11.389673086Z [2024-02-24 04:50:11,389: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:50:11.390201731Z [2024-02-24 04:50:11,389: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:50:11.390249908Z [2024-02-24 04:50:11,390: INFO/ForkPoolWorker-16] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:50:11.472189184Z [2024-02-24 04:50:11,471: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:45:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:50:12.111794855Z [2024-02-24 04:50:12,111: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[618cf9e9-ac51-4ce2-b7f1-d8f7470bc1c9] succeeded in 2.183543668001221s: None
2024-02-24T04:51:00.495890386Z [2024-02-24 04:51:00,495: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[633d521b-a33a-4b5d-ba06-1b479e310418] received
2024-02-24T04:51:00.506051508Z [2024-02-24 04:51:00,505: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[19219b12-c8b3-4628-a466-99be54fe832d] received
2024-02-24T04:51:00.506609036Z [2024-02-24 04:51:00,506: INFO/ForkPoolWorker-15] [633d521b-a33a-4b5d-ba06-1b479e310418] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:51:00.508778934Z [2024-02-24 04:51:00,508: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8c1bd05c-222b-471e-8866-59c968da7630] received
2024-02-24T04:51:00.520340340Z [2024-02-24 04:51:00,519: INFO/ForkPoolWorker-16] [19219b12-c8b3-4628-a466-99be54fe832d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:51:00.522061842Z [2024-02-24 04:51:00,521: INFO/ForkPoolWorker-1] [8c1bd05c-222b-471e-8866-59c968da7630] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:51:00.810682935Z [2024-02-24 04:51:00,807: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:51:00.838507872Z [2024-02-24 04:51:00,835: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:51:00.894040849Z [2024-02-24 04:51:00,889: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:51:01.075255443Z [2024-02-24 04:51:01,074: INFO/ForkPoolWorker-1] Getting SDNC list
2024-02-24T04:51:01.079534727Z [2024-02-24 04:51:01,079: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:51:01.105546293Z [2024-02-24 04:51:01,105: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:51:01.106850479Z [2024-02-24 04:51:01,106: INFO/ForkPoolWorker-1] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:51:01.107037919Z [2024-02-24 04:51:01,106: INFO/ForkPoolWorker-1] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:51:01.107159628Z [2024-02-24 04:51:01,107: INFO/ForkPoolWorker-1] Getting SDNC list OK
2024-02-24T04:51:01.107494645Z [2024-02-24 04:51:01,107: INFO/ForkPoolWorker-1] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:51:01.208098825Z [2024-02-24 04:51:01,207: INFO/ForkPoolWorker-1] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:51:01.838900706Z [2024-02-24 04:51:01,838: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8c1bd05c-222b-471e-8866-59c968da7630] succeeded in 1.3266866720005055s: None
2024-02-24T04:51:02.136462938Z [2024-02-24 04:51:02,136: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:51:02.139856657Z [2024-02-24 04:51:02,139: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:51:02.157731614Z [2024-02-24 04:51:02,157: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:51:02.159007879Z [2024-02-24 04:51:02,158: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:51:02.159198470Z [2024-02-24 04:51:02,158: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:51:02.159386297Z [2024-02-24 04:51:02,159: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:51:02.159524373Z [2024-02-24 04:51:02,159: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:51:02.159914105Z [2024-02-24 04:51:02,159: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:51:02.160042451Z [2024-02-24 04:51:02,159: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:51:02.183623630Z [2024-02-24 04:51:02,183: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:51:02.188944424Z [2024-02-24 04:51:02,188: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:51:02.222880438Z [2024-02-24 04:51:02,222: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:51:02.224313182Z [2024-02-24 04:51:02,224: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:51:02.224458741Z [2024-02-24 04:51:02,224: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:51:02.224705497Z [2024-02-24 04:51:02,224: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:51:02.224855447Z [2024-02-24 04:51:02,224: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:51:02.225237785Z [2024-02-24 04:51:02,225: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:51:02.225442714Z [2024-02-24 04:51:02,225: INFO/ForkPoolWorker-16] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:51:02.284893018Z [2024-02-24 04:51:02,284: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:51:02.318654734Z [2024-02-24 04:51:02,318: INFO/ForkPoolWorker-16] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:51:04.201942040Z [2024-02-24 04:51:04,201: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[19219b12-c8b3-4628-a466-99be54fe832d] succeeded in 3.6908781600031944s: None
2024-02-24T04:51:04.299281430Z [2024-02-24 04:51:04,298: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[633d521b-a33a-4b5d-ba06-1b479e310418] succeeded in 3.8001197170015075s: None
2024-02-24T04:51:39.112112666Z [2024-02-24 04:51:39,111: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[91b34d3d-ce03-44f6-9426-7d7b95ca803f] received
2024-02-24T04:51:39.125727491Z [2024-02-24 04:51:39,125: INFO/ForkPoolWorker-15] [91b34d3d-ce03-44f6-9426-7d7b95ca803f] Executing command in Celery: ['airflow', 'tasks', 'run', 'vdu_down', 'main_task', 'vdu_down_20240224045137_174268', '--local', '--subdir', 'DAGS_FOLDER/dags/vdu_down.py']
2024-02-24T04:51:39.383568220Z [2024-02-24 04:51:39,380: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/vdu_down.py
2024-02-24T04:51:39.697930586Z [2024-02-24 04:51:39,697: INFO/ForkPoolWorker-15] Running <TaskInstance: vdu_down.main_task vdu_down_20240224045137_174268 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:51:40.352119542Z [2024-02-24 04:51:40,351: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[91b34d3d-ce03-44f6-9426-7d7b95ca803f] succeeded in 1.2366228799983219s: None
2024-02-24T04:52:00.875737541Z [2024-02-24 04:52:00,875: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b7d27c9-18c5-4737-bc92-1f6bcd567b17] received
2024-02-24T04:52:00.882593285Z [2024-02-24 04:52:00,882: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[f0fcc933-f3a4-486b-97fb-3a3a52eb5ec5] received
2024-02-24T04:52:00.887032791Z [2024-02-24 04:52:00,886: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ea4fefd5-7c6e-4288-b03b-4c5f8db528e0] received
2024-02-24T04:52:00.889487659Z [2024-02-24 04:52:00,889: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2361c2f5-5d72-4d84-9c6f-5d9abd50fc6f] received
2024-02-24T04:52:00.903868188Z [2024-02-24 04:52:00,903: INFO/ForkPoolWorker-16] [f0fcc933-f3a4-486b-97fb-3a3a52eb5ec5] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:52:00.904592873Z [2024-02-24 04:52:00,904: INFO/ForkPoolWorker-1] [ea4fefd5-7c6e-4288-b03b-4c5f8db528e0] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:52:00.906337930Z [2024-02-24 04:52:00,906: INFO/ForkPoolWorker-15] [7b7d27c9-18c5-4737-bc92-1f6bcd567b17] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:52:00.909717483Z [2024-02-24 04:52:00,909: INFO/ForkPoolWorker-2] [2361c2f5-5d72-4d84-9c6f-5d9abd50fc6f] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:51:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:52:01.225255471Z [2024-02-24 04:52:01,220: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:52:01.288806475Z [2024-02-24 04:52:01,281: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:52:01.323428973Z [2024-02-24 04:52:01,313: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:52:01.394642109Z [2024-02-24 04:52:01,391: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:52:01.528340435Z [2024-02-24 04:52:01,527: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:52:01.535528483Z [2024-02-24 04:52:01,534: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:52:01.574196232Z [2024-02-24 04:52:01,573: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:52:01.576533186Z [2024-02-24 04:52:01,576: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:52:01.576896232Z [2024-02-24 04:52:01,576: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:52:01.577211101Z [2024-02-24 04:52:01,576: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:52:01.577644658Z [2024-02-24 04:52:01,577: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:52:01.670258970Z [2024-02-24 04:52:01,669: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:52:01.697487847Z [2024-02-24 04:52:01,697: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:52:02.385024138Z [2024-02-24 04:52:02,383: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[2361c2f5-5d72-4d84-9c6f-5d9abd50fc6f] succeeded in 1.4874266680017172s: None
2024-02-24T04:52:02.458631089Z [2024-02-24 04:52:02,458: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b7d27c9-18c5-4737-bc92-1f6bcd567b17] succeeded in 1.572097805001249s: None
2024-02-24T04:52:02.662361624Z [2024-02-24 04:52:02,659: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:52:02.684881928Z [2024-02-24 04:52:02,673: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:52:02.760750429Z [2024-02-24 04:52:02,760: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:52:02.762256747Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:52:02.762284330Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:52:02.762468139Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:52:02.762477097Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:52:02.762811588Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:52:02.763005843Z [2024-02-24 04:52:02,762: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:52:02.872580988Z [2024-02-24 04:52:02,872: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:52:02.931244238Z [2024-02-24 04:52:02,930: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:52:02.934572355Z [2024-02-24 04:52:02,934: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:52:02.959061908Z [2024-02-24 04:52:02,958: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:52:02.960729526Z [2024-02-24 04:52:02,960: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:52:02.961167583Z [2024-02-24 04:52:02,961: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:52:02.961314616Z [2024-02-24 04:52:02,961: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:52:02.961367697Z [2024-02-24 04:52:02,961: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:52:02.961672974Z [2024-02-24 04:52:02,961: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:52:02.962126155Z [2024-02-24 04:52:02,961: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:52:03.050876880Z [2024-02-24 04:52:03,050: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:51:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:52:04.757347334Z [2024-02-24 04:52:04,756: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[ea4fefd5-7c6e-4288-b03b-4c5f8db528e0] succeeded in 3.866659110997716s: None
2024-02-24T04:52:04.944393006Z [2024-02-24 04:52:04,943: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[f0fcc933-f3a4-486b-97fb-3a3a52eb5ec5] succeeded in 4.060233828997298s: None
2024-02-24T04:53:00.404440013Z [2024-02-24 04:53:00,404: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[2cd497fb-3647-424f-9dba-9c696d7a6f44] received
2024-02-24T04:53:00.408421031Z [2024-02-24 04:53:00,408: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[aa4b3439-85a2-4337-966f-9d57a189da8a] received
2024-02-24T04:53:00.411342351Z [2024-02-24 04:53:00,411: INFO/ForkPoolWorker-15] [2cd497fb-3647-424f-9dba-9c696d7a6f44] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:53:00.413744956Z [2024-02-24 04:53:00,413: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[81645225-d464-4ec2-9cc1-283226a2ca06] received
2024-02-24T04:53:00.416687524Z [2024-02-24 04:53:00,416: INFO/ForkPoolWorker-16] [aa4b3439-85a2-4337-966f-9d57a189da8a] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:53:00.422540955Z [2024-02-24 04:53:00,422: INFO/ForkPoolWorker-1] [81645225-d464-4ec2-9cc1-283226a2ca06] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:53:00.688605481Z [2024-02-24 04:53:00,685: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:53:00.744742373Z [2024-02-24 04:53:00,741: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:53:00.750211798Z [2024-02-24 04:53:00,747: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:53:00.939569319Z [2024-02-24 04:53:00,939: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:53:00.943587008Z [2024-02-24 04:53:00,943: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:53:00.965432290Z [2024-02-24 04:53:00,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:53:00.967525082Z [2024-02-24 04:53:00,967: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:53:00.967739396Z [2024-02-24 04:53:00,967: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:53:00.967859050Z [2024-02-24 04:53:00,967: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:53:00.968132528Z [2024-02-24 04:53:00,967: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:53:01.057402196Z [2024-02-24 04:53:01,057: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:53:01.664663230Z [2024-02-24 04:53:01,664: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[aa4b3439-85a2-4337-966f-9d57a189da8a] succeeded in 1.2542131590016652s: None
2024-02-24T04:53:01.791201303Z [2024-02-24 04:53:01,790: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:53:01.794417531Z [2024-02-24 04:53:01,793: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:53:01.820323422Z [2024-02-24 04:53:01,820: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:53:01.821848456Z [2024-02-24 04:53:01,821: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:53:01.822055701Z [2024-02-24 04:53:01,821: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:53:01.822241928Z [2024-02-24 04:53:01,822: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:53:01.822346054Z [2024-02-24 04:53:01,822: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:53:01.822666746Z [2024-02-24 04:53:01,822: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:53:01.823108543Z [2024-02-24 04:53:01,822: INFO/ForkPoolWorker-15] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:53:01.898929606Z [2024-02-24 04:53:01,898: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:53:02.030902984Z [2024-02-24 04:53:02,030: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:53:02.033660274Z [2024-02-24 04:53:02,033: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:53:02.052314172Z [2024-02-24 04:53:02,052: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:53:02.053754391Z [2024-02-24 04:53:02,053: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:53:02.053913537Z [2024-02-24 04:53:02,053: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:53:02.054110615Z [2024-02-24 04:53:02,053: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:53:02.054213231Z [2024-02-24 04:53:02,054: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:53:02.054548981Z [2024-02-24 04:53:02,054: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:53:02.054671151Z [2024-02-24 04:53:02,054: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:53:02.130898681Z [2024-02-24 04:53:02,130: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:53:03.636786466Z [2024-02-24 04:53:03,636: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[81645225-d464-4ec2-9cc1-283226a2ca06] succeeded in 3.220884267000656s: None
2024-02-24T04:53:03.841471464Z [2024-02-24 04:53:03,840: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[2cd497fb-3647-424f-9dba-9c696d7a6f44] succeeded in 3.434363132000726s: None
2024-02-24T04:54:00.341169580Z [2024-02-24 04:54:00,340: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[7b8ec2b3-d99b-4bfd-9301-6109a8ee28c3] received
2024-02-24T04:54:00.346275890Z [2024-02-24 04:54:00,346: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[90cb25b0-62c3-468c-be19-3414973b42fd] received
2024-02-24T04:54:00.347646172Z [2024-02-24 04:54:00,347: INFO/ForkPoolWorker-15] [7b8ec2b3-d99b-4bfd-9301-6109a8ee28c3] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:54:00.349471876Z [2024-02-24 04:54:00,349: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[96327046-3d9f-42c2-9e78-e6ecd5908231] received
2024-02-24T04:54:00.351457176Z [2024-02-24 04:54:00,351: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[32f178c4-054b-4e45-9293-cf4191dc197d] received
2024-02-24T04:54:00.352699302Z [2024-02-24 04:54:00,352: INFO/ForkPoolWorker-16] [90cb25b0-62c3-468c-be19-3414973b42fd] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:54:00.356535952Z [2024-02-24 04:54:00,356: INFO/ForkPoolWorker-1] [96327046-3d9f-42c2-9e78-e6ecd5908231] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:52:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:54:00.357565644Z [2024-02-24 04:54:00,357: INFO/ForkPoolWorker-2] [32f178c4-054b-4e45-9293-cf4191dc197d] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:53:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:54:00.719850980Z [2024-02-24 04:54:00,716: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:54:00.756191122Z [2024-02-24 04:54:00,746: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:54:00.764406779Z [2024-02-24 04:54:00,760: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:54:00.811406139Z [2024-02-24 04:54:00,808: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:54:00.938313907Z [2024-02-24 04:54:00,937: INFO/ForkPoolWorker-16] Getting SDNC list
2024-02-24T04:54:00.942480503Z [2024-02-24 04:54:00,942: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:54:00.965537187Z [2024-02-24 04:54:00,965: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:54:00.966542519Z [2024-02-24 04:54:00,966: INFO/ForkPoolWorker-16] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:54:00.966709956Z [2024-02-24 04:54:00,966: INFO/ForkPoolWorker-16] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:54:00.966753595Z [2024-02-24 04:54:00,966: INFO/ForkPoolWorker-16] Getting SDNC list OK
2024-02-24T04:54:00.966993865Z [2024-02-24 04:54:00,966: INFO/ForkPoolWorker-16] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:54:01.055343799Z [2024-02-24 04:54:01,055: INFO/ForkPoolWorker-16] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:54:01.127089473Z [2024-02-24 04:54:01,126: INFO/ForkPoolWorker-1] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:52:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:54:01.731365185Z [2024-02-24 04:54:01,730: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[90cb25b0-62c3-468c-be19-3414973b42fd] succeeded in 1.3837544420021004s: None
2024-02-24T04:54:01.760417922Z [2024-02-24 04:54:01,759: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[96327046-3d9f-42c2-9e78-e6ecd5908231] succeeded in 1.409409781001159s: None
2024-02-24T04:54:02.100840648Z [2024-02-24 04:54:02,100: INFO/ForkPoolWorker-2] Getting VIM list
2024-02-24T04:54:02.104093814Z [2024-02-24 04:54:02,103: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:54:02.119650437Z [2024-02-24 04:54:02,119: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:54:02.120882676Z [2024-02-24 04:54:02,120: INFO/ForkPoolWorker-2] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:54:02.120934377Z [2024-02-24 04:54:02,120: INFO/ForkPoolWorker-2] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:54:02.121106402Z [2024-02-24 04:54:02,120: INFO/ForkPoolWorker-2] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:54:02.121164563Z [2024-02-24 04:54:02,121: INFO/ForkPoolWorker-2] Getting VIM list OK
2024-02-24T04:54:02.121418298Z [2024-02-24 04:54:02,121: INFO/ForkPoolWorker-2] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:54:02.121467977Z [2024-02-24 04:54:02,121: INFO/ForkPoolWorker-2] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:54:02.213072089Z [2024-02-24 04:54:02,212: INFO/ForkPoolWorker-2] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:54:02.239378152Z [2024-02-24 04:54:02,239: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:54:02.242674956Z [2024-02-24 04:54:02,242: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:54:02.264948931Z [2024-02-24 04:54:02,264: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:54:02.267428363Z [2024-02-24 04:54:02,266: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:54:02.267789208Z [2024-02-24 04:54:02,267: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:54:02.268198944Z [2024-02-24 04:54:02,267: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:54:02.268462632Z [2024-02-24 04:54:02,268: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:54:02.269445167Z [2024-02-24 04:54:02,268: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:54:02.269735231Z [2024-02-24 04:54:02,269: INFO/ForkPoolWorker-15] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:54:02.354854620Z [2024-02-24 04:54:02,354: INFO/ForkPoolWorker-15] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:53:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:54:04.360699753Z [2024-02-24 04:54:04,360: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[32f178c4-054b-4e45-9293-cf4191dc197d] succeeded in 4.0073057469999185s: None
2024-02-24T04:54:05.085955340Z [2024-02-24 04:54:05,085: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[7b8ec2b3-d99b-4bfd-9301-6109a8ee28c3] succeeded in 4.743190416997095s: None
2024-02-24T04:55:01.233520128Z [2024-02-24 04:55:01,233: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[cfd692c4-e8d6-4d37-b89d-bde782a51caf] received
2024-02-24T04:55:01.241280226Z [2024-02-24 04:55:01,240: INFO/ForkPoolWorker-15] [cfd692c4-e8d6-4d37-b89d-bde782a51caf] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'extract_metrics_from_vnfrs', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:55:01.249543152Z [2024-02-24 04:55:01,244: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[5be229a5-4b79-4d7d-b3e2-ae283d54650c] received
2024-02-24T04:55:01.249569243Z [2024-02-24 04:55:01,246: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bdd3effa-f2b3-43b9-ace7-8e3fd92ee4cb] received
2024-02-24T04:55:01.249573948Z [2024-02-24 04:55:01,248: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[b083eb15-f77c-42cd-90d0-5dcc629a9573] received
2024-02-24T04:55:01.265995329Z [2024-02-24 04:55:01,257: INFO/ForkPoolWorker-1] [bdd3effa-f2b3-43b9-ace7-8e3fd92ee4cb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:55:01.277857481Z [2024-02-24 04:55:01,266: INFO/ForkPoolWorker-16] [5be229a5-4b79-4d7d-b3e2-ae283d54650c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:55:01.277880186Z [2024-02-24 04:55:01,268: INFO/ForkPoolWorker-2] [b083eb15-f77c-42cd-90d0-5dcc629a9573] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:55:01.639789318Z [2024-02-24 04:55:01,636: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:55:01.706603292Z [2024-02-24 04:55:01,700: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:55:01.739191030Z [2024-02-24 04:55:01,735: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:55:01.749905490Z [2024-02-24 04:55:01,746: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:55:01.964914248Z [2024-02-24 04:55:01,964: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:55:01.968780384Z [2024-02-24 04:55:01,968: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:02.045071987Z [2024-02-24 04:55:02,044: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:55:02.048085557Z [2024-02-24 04:55:02,047: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:55:02.048997148Z [2024-02-24 04:55:02,048: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:55:02.049378034Z [2024-02-24 04:55:02,049: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:55:02.049705041Z [2024-02-24 04:55:02,049: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:55:02.182132093Z [2024-02-24 04:55:02,181: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:02.962427264Z [2024-02-24 04:55:02,962: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[b083eb15-f77c-42cd-90d0-5dcc629a9573] succeeded in 1.7127115309995133s: None
2024-02-24T04:55:03.071650970Z [2024-02-24 04:55:03,071: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:55:03.075145328Z [2024-02-24 04:55:03,074: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:03.099518511Z [2024-02-24 04:55:03,099: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:55:03.102236077Z [2024-02-24 04:55:03,101: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:03.102254186Z [2024-02-24 04:55:03,102: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:03.102368277Z [2024-02-24 04:55:03,102: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:03.102440425Z [2024-02-24 04:55:03,102: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:55:03.102703107Z [2024-02-24 04:55:03,102: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:55:03.102718454Z [2024-02-24 04:55:03,102: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:03.192592221Z [2024-02-24 04:55:03,192: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:03.357189551Z [2024-02-24 04:55:03,356: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:55:03.360934325Z [2024-02-24 04:55:03,360: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:03.388073163Z [2024-02-24 04:55:03,387: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:55:03.395964568Z [2024-02-24 04:55:03,395: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:03.397130207Z [2024-02-24 04:55:03,396: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:55:03.401753647Z [2024-02-24 04:55:03,401: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:03.401803860Z [2024-02-24 04:55:03,401: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:03.401943393Z [2024-02-24 04:55:03,401: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:03.401980020Z [2024-02-24 04:55:03,401: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:55:03.402240423Z [2024-02-24 04:55:03,402: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:55:03.402352214Z [2024-02-24 04:55:03,402: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:03.430647086Z [2024-02-24 04:55:03,430: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:55:03.432023749Z [2024-02-24 04:55:03,431: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:03.432090417Z [2024-02-24 04:55:03,431: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:03.432542678Z [2024-02-24 04:55:03,432: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:03.432636183Z [2024-02-24 04:55:03,432: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:55:03.433196522Z [2024-02-24 04:55:03,433: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:55:03.433340180Z [2024-02-24 04:55:03,433: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:03.515117217Z [2024-02-24 04:55:03,514: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.extract_metrics_from_vnfrs scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:03.533335432Z [2024-02-24 04:55:03,533: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:04.239698597Z [2024-02-24 04:55:04,239: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[cfd692c4-e8d6-4d37-b89d-bde782a51caf] succeeded in 3.004437625000719s: None
2024-02-24T04:55:04.719107214Z [2024-02-24 04:55:04,718: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[bdd3effa-f2b3-43b9-ace7-8e3fd92ee4cb] succeeded in 3.470757249997405s: None
2024-02-24T04:55:05.187050356Z [2024-02-24 04:55:05,186: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[da9a96de-ad4c-4627-8e6f-715196f9f48c] received
2024-02-24T04:55:05.195588262Z [2024-02-24 04:55:05,195: INFO/ForkPoolWorker-15] [da9a96de-ad4c-4627-8e6f-715196f9f48c] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'split_metrics', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:55:05.496936303Z [2024-02-24 04:55:05,493: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:55:05.587128898Z [2024-02-24 04:55:05,586: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[5be229a5-4b79-4d7d-b3e2-ae283d54650c] succeeded in 4.3399175819977245s: None
2024-02-24T04:55:06.786803528Z [2024-02-24 04:55:06,786: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:55:06.790565736Z [2024-02-24 04:55:06,790: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:06.816658650Z [2024-02-24 04:55:06,816: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:55:06.818184460Z [2024-02-24 04:55:06,817: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:06.818435121Z [2024-02-24 04:55:06,818: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:06.818705941Z [2024-02-24 04:55:06,818: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:06.818896348Z [2024-02-24 04:55:06,818: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:55:06.819308366Z [2024-02-24 04:55:06,819: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:55:06.819544796Z [2024-02-24 04:55:06,819: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:06.927416215Z [2024-02-24 04:55:06,927: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.split_metrics scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:07.636890796Z [2024-02-24 04:55:07,636: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[da9a96de-ad4c-4627-8e6f-715196f9f48c] succeeded in 2.448433212000964s: None
2024-02-24T04:55:07.920615549Z [2024-02-24 04:55:07,920: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[6ed9f6b6-957c-4eab-8681-8cf3c377edbb] received
2024-02-24T04:55:07.932602603Z [2024-02-24 04:55:07,932: INFO/ForkPoolWorker-15] [6ed9f6b6-957c-4eab-8681-8cf3c377edbb] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'collect_metrics', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py', '--map-index', '0']
2024-02-24T04:55:08.245464188Z [2024-02-24 04:55:08,242: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:55:09.356158711Z [2024-02-24 04:55:09,355: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:55:09.359466708Z [2024-02-24 04:55:09,358: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:09.384944718Z [2024-02-24 04:55:09,384: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:55:09.387368292Z [2024-02-24 04:55:09,386: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:09.387679221Z [2024-02-24 04:55:09,387: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:09.388109368Z [2024-02-24 04:55:09,387: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:09.388238927Z [2024-02-24 04:55:09,388: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:55:09.389022445Z [2024-02-24 04:55:09,388: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:55:09.389231962Z [2024-02-24 04:55:09,388: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:09.502259206Z [2024-02-24 04:55:09,501: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.collect_metrics scheduled__2024-02-24T04:50:00+00:00 map_index=0 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:10.060468628Z [2024-02-24 04:55:10,060: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[6ed9f6b6-957c-4eab-8681-8cf3c377edbb] succeeded in 2.135019146000559s: None
2024-02-24T04:55:10.233317569Z [2024-02-24 04:55:10,232: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[852c6518-a7b5-4249-b359-bfba677a48be] received
2024-02-24T04:55:10.244941695Z [2024-02-24 04:55:10,244: INFO/ForkPoolWorker-15] [852c6518-a7b5-4249-b359-bfba677a48be] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'send_prometheus', 'scheduled__2024-02-24T04:50:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_metrics.py']
2024-02-24T04:55:10.521239935Z [2024-02-24 04:55:10,518: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_metrics.py
2024-02-24T04:55:11.636629337Z [2024-02-24 04:55:11,636: INFO/ForkPoolWorker-15] Getting VIM list
2024-02-24T04:55:11.639661687Z [2024-02-24 04:55:11,639: INFO/ForkPoolWorker-15] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:55:11.661348856Z [2024-02-24 04:55:11,661: INFO/ForkPoolWorker-15] Connected to database osm version 1.2
2024-02-24T04:55:11.662838742Z [2024-02-24 04:55:11,662: INFO/ForkPoolWorker-15] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:55:11.662868175Z [2024-02-24 04:55:11,662: INFO/ForkPoolWorker-15] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:55:11.663021858Z [2024-02-24 04:55:11,662: INFO/ForkPoolWorker-15] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:55:11.663076797Z [2024-02-24 04:55:11,662: INFO/ForkPoolWorker-15] Getting VIM list OK
2024-02-24T04:55:11.663324694Z [2024-02-24 04:55:11,663: INFO/ForkPoolWorker-15] VIM type 'dummy' not supported for collecting VM metrics
2024-02-24T04:55:11.663346388Z [2024-02-24 04:55:11,663: INFO/ForkPoolWorker-15] Creating DAG vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:55:11.776049517Z [2024-02-24 04:55:11,775: INFO/ForkPoolWorker-15] Running <TaskInstance: vm_metrics_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.send_prometheus scheduled__2024-02-24T04:50:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:55:12.401905918Z [2024-02-24 04:55:12,400: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[852c6518-a7b5-4249-b359-bfba677a48be] succeeded in 2.1649605029997474s: None
2024-02-24T04:56:01.195047274Z [2024-02-24 04:56:01,194: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ba93e7ef-8b59-40a8-abad-75dcce576ffc] received
2024-02-24T04:56:01.197232499Z [2024-02-24 04:56:01,196: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[bb2e6993-74fd-4b62-8b81-30d1f42af3aa] received
2024-02-24T04:56:01.204453910Z [2024-02-24 04:56:01,204: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[8998a62e-556e-4f46-a002-0e48bd5a86ad] received
2024-02-24T04:56:01.210430178Z [2024-02-24 04:56:01,209: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[ec31243f-0e17-4667-ad65-02a2e0dbd76e] received
2024-02-24T04:56:01.212113223Z [2024-02-24 04:56:01,211: INFO/ForkPoolWorker-16] [bb2e6993-74fd-4b62-8b81-30d1f42af3aa] Executing command in Celery: ['airflow', 'tasks', 'run', 'vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_all_vm_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vm_status.py']
2024-02-24T04:56:01.233137425Z [2024-02-24 04:56:01,226: INFO/ForkPoolWorker-1] [8998a62e-556e-4f46-a002-0e48bd5a86ad] Executing command in Celery: ['airflow', 'tasks', 'run', 'vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5', 'get_vim_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multivim_vim_status.py']
2024-02-24T04:56:01.237941951Z [2024-02-24 04:56:01,228: INFO/ForkPoolWorker-2] [ec31243f-0e17-4667-ad65-02a2e0dbd76e] Executing command in Celery: ['airflow', 'tasks', 'run', 'sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a', 'get_sdnc_status_and_send_to_prometheus', 'scheduled__2024-02-24T04:55:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/multisdnc_sdnc_status.py']
2024-02-24T04:56:01.237973325Z [2024-02-24 04:56:01,234: INFO/ForkPoolWorker-15] [ba93e7ef-8b59-40a8-abad-75dcce576ffc] Executing command in Celery: ['airflow', 'tasks', 'run', 'ns_topology', 'get_topology', 'scheduled__2024-02-24T04:54:00+00:00', '--local', '--subdir', 'DAGS_FOLDER/dags/ns_topology.py']
2024-02-24T04:56:01.564431823Z [2024-02-24 04:56:01,561: INFO/ForkPoolWorker-15] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/ns_topology.py
2024-02-24T04:56:01.611404273Z [2024-02-24 04:56:01,608: INFO/ForkPoolWorker-16] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vm_status.py
2024-02-24T04:56:01.626636492Z [2024-02-24 04:56:01,623: INFO/ForkPoolWorker-2] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multisdnc_sdnc_status.py
2024-02-24T04:56:01.637935741Z [2024-02-24 04:56:01,634: INFO/ForkPoolWorker-1] Filling up the DagBag from /home/airflow/.local/lib/python3.10/site-packages/osm_ngsa/dags/multivim_vim_status.py
2024-02-24T04:56:01.781547859Z [2024-02-24 04:56:01,781: INFO/ForkPoolWorker-2] Getting SDNC list
2024-02-24T04:56:01.785526006Z [2024-02-24 04:56:01,785: INFO/ForkPoolWorker-2] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:56:01.825212284Z [2024-02-24 04:56:01,824: INFO/ForkPoolWorker-2] Connected to database osm version 1.2
2024-02-24T04:56:01.827011969Z [2024-02-24 04:56:01,826: INFO/ForkPoolWorker-2] Read SDNC c13d502e-0ad7-4135-a646-665a351a480a (sdnc-osm)
2024-02-24T04:56:01.828124142Z [2024-02-24 04:56:01,827: INFO/ForkPoolWorker-2] [{'_id': 'c13d502e-0ad7-4135-a646-665a351a480a', 'name': 'sdnc-osm', 'type': 'onos_vpls'}]
2024-02-24T04:56:01.828268560Z [2024-02-24 04:56:01,828: INFO/ForkPoolWorker-2] Getting SDNC list OK
2024-02-24T04:56:01.828708557Z [2024-02-24 04:56:01,828: INFO/ForkPoolWorker-2] Creating DAG sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a
2024-02-24T04:56:01.931440999Z [2024-02-24 04:56:01,931: INFO/ForkPoolWorker-15] Running <TaskInstance: ns_topology.get_topology scheduled__2024-02-24T04:54:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:56:01.998785345Z [2024-02-24 04:56:01,998: INFO/ForkPoolWorker-2] Running <TaskInstance: sdnc_status_c13d502e-0ad7-4135-a646-665a351a480a.get_sdnc_status_and_send_to_prometheus scheduled__2024-02-24T04:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:56:02.473521613Z [2024-02-24 04:56:02,473: INFO/ForkPoolWorker-15] Task airflow.executors.celery_executor.execute_command[ba93e7ef-8b59-40a8-abad-75dcce576ffc] succeeded in 1.2768934930027172s: None
2024-02-24T04:56:02.780228453Z [2024-02-24 04:56:02,779: INFO/ForkPoolWorker-2] Task airflow.executors.celery_executor.execute_command[ec31243f-0e17-4667-ad65-02a2e0dbd76e] succeeded in 1.5609503449995827s: None
2024-02-24T04:56:02.997470118Z [2024-02-24 04:56:02,997: INFO/ForkPoolWorker-16] Getting VIM list
2024-02-24T04:56:03.000754834Z [2024-02-24 04:56:03,000: INFO/ForkPoolWorker-16] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:56:03.007272405Z [2024-02-24 04:56:03,006: INFO/ForkPoolWorker-1] Getting VIM list
2024-02-24T04:56:03.011634968Z [2024-02-24 04:56:03,011: INFO/ForkPoolWorker-1] {'global': {'loglevel': 'INFO', 'request_timeout': 10}, 'database': {'driver': 'mongo', 'uri': 'mongodb://mongodb-k8s:27017/?replicaSet=rs0', 'name': 'osm', 'commonkey': 'Nn4WdkIDcVzdBx1ye9qvbAxbIo3Jh4Cm'}, 'message': {'driver': 'kafka', 'host': 'kafka', 'port': 9092}}
2024-02-24T04:56:03.022768083Z [2024-02-24 04:56:03,022: INFO/ForkPoolWorker-16] Connected to database osm version 1.2
2024-02-24T04:56:03.024100708Z [2024-02-24 04:56:03,023: INFO/ForkPoolWorker-16] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:56:03.024218595Z [2024-02-24 04:56:03,024: INFO/ForkPoolWorker-16] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:56:03.024353735Z [2024-02-24 04:56:03,024: INFO/ForkPoolWorker-16] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:56:03.024495902Z [2024-02-24 04:56:03,024: INFO/ForkPoolWorker-16] Getting VIM list OK
2024-02-24T04:56:03.024784368Z [2024-02-24 04:56:03,024: INFO/ForkPoolWorker-16] VIM type 'dummy' not supported for collecting VM status
2024-02-24T04:56:03.024997031Z [2024-02-24 04:56:03,024: INFO/ForkPoolWorker-16] Creating DAG vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:56:03.040326274Z [2024-02-24 04:56:03,040: INFO/ForkPoolWorker-1] Connected to database osm version 1.2
2024-02-24T04:56:03.042460303Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] Read VIM 474dcc28-0307-4a0c-916b-6d4b31b9e462 (_system-osm-vim)
2024-02-24T04:56:03.042478851Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] Read VIM 2e85ab10-948b-42e3-b4e1-8962912db3d5 (osm)
2024-02-24T04:56:03.042605375Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] [{'_id': '474dcc28-0307-4a0c-916b-6d4b31b9e462', 'name': '_system-osm-vim', 'vim_type': 'dummy'}, {'_id': '2e85ab10-948b-42e3-b4e1-8962912db3d5', 'name': 'osm', 'vim_type': 'openstack'}]
2024-02-24T04:56:03.042622024Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] Getting VIM list OK
2024-02-24T04:56:03.042915907Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] VIM type 'dummy' not supported for monitoring VIM status
2024-02-24T04:56:03.042932233Z [2024-02-24 04:56:03,042: INFO/ForkPoolWorker-1] Creating DAG vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5
2024-02-24T04:56:03.106924544Z [2024-02-24 04:56:03,106: INFO/ForkPoolWorker-16] Running <TaskInstance: vm_status_vim_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_all_vm_status_and_send_to_prometheus scheduled__2024-02-24T04:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:56:03.141710182Z [2024-02-24 04:56:03,141: INFO/ForkPoolWorker-1] Running <TaskInstance: vim_status_2e85ab10-948b-42e3-b4e1-8962912db3d5.get_vim_status_and_send_to_prometheus scheduled__2024-02-24T04:55:00+00:00 [queued]> on host airflow-worker-0.airflow-worker.osm.svc.cluster.local
2024-02-24T04:56:05.316713278Z [2024-02-24 04:56:05,316: INFO/ForkPoolWorker-16] Task airflow.executors.celery_executor.execute_command[bb2e6993-74fd-4b62-8b81-30d1f42af3aa] succeeded in 4.116352018998441s: None
2024-02-24T04:56:05.317723119Z [2024-02-24 04:56:05,316: INFO/ForkPoolWorker-1] Task airflow.executors.celery_executor.execute_command[8998a62e-556e-4f46-a002-0e48bd5a86ad] succeeded in 4.104285298999457s: None
2024-02-24T04:57:01.039670236Z [2024-02-24 04:57:01,038: INFO/MainProcess] Task airflow.executors.celery_executor.execute_command[3d80ec36-75c3-4666-9090-0c1426177443] received
2024-02-23T23:31:45.502081885Z 
2024-02-23T23:31:45.509947079Z Cleaning logs every 900 seconds
2024-02-23T23:31:45.509960131Z Trimming airflow logs to 15 days.
2024-02-23T23:45:00.606018108Z Trimming airflow logs to 15 days.
2024-02-23T23:45:01.639350605Z Trimming airflow logs to 15 days.
2024-02-24T00:00:00.684837942Z Trimming airflow logs to 15 days.
2024-02-24T00:00:01.762185221Z Trimming airflow logs to 15 days.
2024-02-24T00:15:00.889958906Z Trimming airflow logs to 15 days.
2024-02-24T00:15:01.944993436Z Trimming airflow logs to 15 days.
2024-02-24T00:30:00.999944374Z Trimming airflow logs to 15 days.
2024-02-24T00:45:00.091499104Z Trimming airflow logs to 15 days.
2024-02-24T00:45:01.147160107Z Trimming airflow logs to 15 days.
2024-02-24T01:00:00.274397112Z Trimming airflow logs to 15 days.
2024-02-24T01:00:01.326296460Z Trimming airflow logs to 15 days.
2024-02-24T01:15:00.395873882Z Trimming airflow logs to 15 days.
2024-02-24T01:15:01.450280534Z Trimming airflow logs to 15 days.
2024-02-24T01:30:00.536327717Z Trimming airflow logs to 15 days.
2024-02-24T01:30:01.602089463Z Trimming airflow logs to 15 days.
2024-02-24T01:45:00.668638477Z Trimming airflow logs to 15 days.
2024-02-24T01:45:01.760404957Z Trimming airflow logs to 15 days.
2024-02-24T02:00:00.854514539Z Trimming airflow logs to 15 days.
2024-02-24T02:00:01.957416448Z Trimming airflow logs to 15 days.
2024-02-24T02:15:00.021352897Z Trimming airflow logs to 15 days.
2024-02-24T02:15:01.102084824Z Trimming airflow logs to 15 days.
2024-02-24T02:30:00.246667943Z Trimming airflow logs to 15 days.
2024-02-24T02:30:01.326166438Z Trimming airflow logs to 15 days.
2024-02-24T02:45:00.448735631Z Trimming airflow logs to 15 days.
2024-02-24T02:45:01.591115519Z Trimming airflow logs to 15 days.
2024-02-24T03:00:00.700821154Z Trimming airflow logs to 15 days.
2024-02-24T03:00:01.830125708Z Trimming airflow logs to 15 days.
2024-02-24T03:15:00.989527292Z Trimming airflow logs to 15 days.
2024-02-24T03:30:00.133984600Z Trimming airflow logs to 15 days.
2024-02-24T03:30:01.241194824Z Trimming airflow logs to 15 days.
2024-02-24T03:45:00.379243331Z Trimming airflow logs to 15 days.
2024-02-24T03:45:01.478428473Z Trimming airflow logs to 15 days.
2024-02-24T04:00:00.587672823Z Trimming airflow logs to 15 days.
2024-02-24T04:00:01.738630402Z Trimming airflow logs to 15 days.
2024-02-24T04:15:00.910118416Z Trimming airflow logs to 15 days.
2024-02-24T04:30:00.081984314Z Trimming airflow logs to 15 days.
2024-02-24T04:30:01.198600975Z Trimming airflow logs to 15 days.
2024-02-24T04:45:00.362437871Z Trimming airflow logs to 15 days.
2024-02-24T04:45:01.482060355Z Trimming airflow logs to 15 days.